What is the term used to describe inorganic crystalline substances found naturally in the earth?

A mineral is classified as being the following:

Naturally occurring - this means that it can be found naturally within or on the surface of the planet. A mineral can technically be made in a laboratory environment and still be considered a mineral if it can be found naturally outside of the lab as well. As long as the mineral can be formed under conditions by natural physical processes, it can still be a mineral (an example is a diamond created in a lab).

Inorganic - this separates it from organic matter, which contain carbon and hydrogen bonded to each other (hydrocarbon molecules and carbohydrates are organic).

Solid - it has to be a solid, by definition, so liquids and gaseous matter aren't considered minerals until they eventually crystalize.

Ordered arrangement of atoms - this is the "crystalline" part. A mineral must have a crystal structure.

Consistent chemical composition - this means that the chemical composition of the mineral can be written as a chemical formula.

Technically, ice is a mineral. It's because it satisfies all of the above requirement.