The caves were probably tunnels made by some British company during British rule in India so as to take out stones for making porcelains, ceramic materials etc.