Old English biternys "bitterness, grief;" see bitter + -ness. Figurative sense (of feelings, etc.) is attested earlier than literal sense (of taste), which will surprise no one who reads any amount of Anglo-Saxon literature.
bitt
bitten
bitter
bitter end
bittern
bitterness
bitters
bittersweet
BitTorrent
bitty
bitumen