"in the first place, before anything else," 1530s, but never a common word (simple first usually serving its place), from first + -ly (2).
firn
first
first-born
first-class
first-hand
firstly
first-rate
first-timer
firth
fiscal
fish