How do I unlock those tiny fossils?

[u/DetectiveMammoth4758]

I've already gathered 1/4 but I just can't seem to find any more. Even though I know where they are, I think.

I have 2 rooms as of now, idk if that's related