Rocks and sand are compressed solid units either rocks or grains of sand. They are not emitting any particles so they can’t be smelled. The sand could get into your nose, but each grain won’t have a smell because it is not giving off anything to smell.
The nose works by detecting very tiny particles, if an object isn’t emitting any particles then there will be no odder.