Yet I suspect that this flower-and-butterfly minuteness was also a product of "rationalization," which transformed the glamour of Elfland into mere finesse, and invisibility into a fragility that could hide in a cowslip or shrink behind a blade of grass. It seems to become fashionable soon after the great voyages had begun to make the world seem too narrow to hold both men and elves; when the magic land of Hy Breasail in the West had become the mere Brazils, the land of red-dye-wood. [J.R.R. Tolkien, "On Fairy-Stories," 1947]
The slang meaning "effeminate male homosexual" is first recorded 1895. Fairy ring is from 1590s. Fossil sea urchins found on the English downlands were called fairy loaves.