Is it natural to have affection for rocks?
Affection is a natural thing. Affection for rocks might or might not involve displaced emotion that could be usefully discussed with a counselor. If it is causing problems in your life, I would talk to someone. If it’s just in the sense of a love of nature that comes out in an enjoyment of rocks and minerals, I wouldn’t worry about it.