How did the caves form?
Water, falling as rain, collects carbon dioxide which makes it slightly acidic. As it filters through the soil it becomes even more acidic. Consequently the water starts to dissolve the limestone rock, enlarging fractures to the point that you can walk through them. Underground rivers also dissolve the rock but the rivers also carry gravel and sediment which scours the walls of cave passages, serving to enlarge them even more.