[O]f all diversions which ingenuity ever devised for the relief of idleness, fishing is the worst qualified to amuse a man who is at once indolent and impatient. [Scott, "Waverly," 1814]
Fishing-boat is from 1732. Fishing rod (1550s) is older than fishing pole (1791). To "go fishing" is as old as Old English on fiscoð gan.