Go to the Royal Mile Market
The vendors in this market sell some nifty, authentic wares, but the building itself is really the draw here. The market is housed inside an old church that even includes stained glass windows and funky decor all over. You can find anything from tartan scarves to Harry Potter-themed jewelry. It's also centrally located right in the middle of the Royal Mile, making it easily accessible.