c. 1400, from horse (n.) + tail (n.). As a kind of plant, from 1530s.
horsepower
horse-race
horseradish
horse-shit
horseshoe
horsetail
horse-whip
horsewoman
horst
Horst Wessel
horsy