This is the only time I have ever seen stalactites and stalagmites surrounded by sandstone! The "cave" is a deep alcove that happens to be right at a limestone layer. The limestone roof seeps and has created cave formations in the alcove. This isn't a true "cave" in my mind because it doesn't go back very deep but is a really neat cave-like feature.

You shouldn't need a headlamp, as the large alcove opening lets in enough light to see the full area. The cave is still dripping, so don't touch the formations so they continue to grow.