Can someone outside my organization see my assets if they use RemoteSpark at my location?

No.

Only users with accounts that are within your organization can see your organization's assets. Users must be in same organization to see each other's pinned assets in a location.

Simply wearing a HoloLens in the same location does not grant access to see assets from that location.