Another possibility would be to use chemical anchors, like an epoxy based mortar kit
Yes don't know why I didn't mention this myself, it's probably the best option where you HAVE to fix to joints. Recently I had to fix two drops of 4" cast downpipe (usual job for a joiner I know ) into a stone building in the cotswolds, old irregular stone , lime mortar and getting a firm fixing was a pain, in the end resorted to chemical fixings.
Bit late for advice now though as I can see that you'ved cracked on with the job