So, these guys do mainly prey on inverts (though some species are known seasonally to eat a fair number of fish as well) - most species primarily feed on snails (Nassarius snails are commonly eaten by the species I've seen the diets of) and crustaceans (both hard- and soft-shelled, though Xanthid crabs specifically seem highly preferred) as two of their three main dietary components; from there, depending on the species and season, the third component is either Polychaete worms (Nereidid worms, more specifically) or fish (the two species found in the study linked below were
Ophichthus gomesii - the Shrimp Eel - and
Diplectrum bivittatum - the Dwarf Sand Perch; the study goes really into depth on the diets, listing genus and species of prey where possible as well as listing how many specimens of each prey type were found in the stomach contents and what percentage of the total diet they accounted for).
I can't tell what species of Ogocephalus you have there (they all look relatively similar to me), but if you know the species, you may be able to provide a pretty decent, relatively close to natural diet for them (though you'll likely need to cut some corners with the mimicking of what snails and crabs you're feeding, as Nassarius snails aren't the only snail consumed by these guys and buying Xanthid crabs could get really expensive).
And here's a supporting evidence link on diet for anyone who's dubious of only one source:
Ogcocephalus cubifrons The batfish is an odd looking blobby, bumpy arrow-shaped fish with wide-set pectoral fins on 'arms' and small, forward placed pelvic fins underneath its body. It tends to move sluggishly around the sand and rubble bottom or among the seagrass, scavenging for small crabs, sh
www.floridamuseum.ufl.edu
P.S. I'd guess they would eat any bivalves you offer them, but I could be wrong.