This was on top of the hill . It reminded me of pet cemetery :)
Around the end of the ruins is a hotel/restaurant. To get to the caves go down the stairs by the hotel and follow the signs.
You can join a tour group (tours are available in English) or explore the caves on your own. There was only one floor open when we visited but they told us they were planning to open more in the future.
For more information about the caves click on the links below,