Is it legal to take rocks from the desert?

We live near the desert and we have some cool geodes there and I was wondering if I could take one. They aren't valuable though, they are all full of common crystals not citrine or amethyst or anything of that value.