Bug?: I can't travel back to Caer Cyflen after 'escape from the caves'

I finished traveling through the sorak caves, and was asked to 'return to caer cyflen'.  When I got to the map I didn't really look at it and 'entered' Caer Len again, once leaving and m back at the map, there is no Travel button on Caer Cyflen.  There is a exclamation point (!), when looking at the quest log I have a 'X' on Choice: Talk to Beryl and it says I failed that?

I tried returning to the keep, but cannon enter, I tried loading a save I had while in the Sorak caves, and still can't travel once I'm out.

DOH...this group of adventures were doing well :-)