This very relevant thread happened a few weeks ago
One theory speculates they could be related to knowledge that fish fossils can be found in mountain caves. (This is because tectonic forces shaped seabeds into mountains over eons).