youre folding a suited Ace where by the time the BB almost always calls, youre getting 6/1 odds? I find that hard to believe for most people
Out of position, you have less control - you're unlikely to maximize your profit if you make, nor minimize your loss when you don't.
Your most common flop "hits" will be pair of treys, ace kicker, and pair of aces, crap kicker. Neither are very playable in a field of six, especially out of position. (Especially out of position.)
In the event you hit a four-flush that doesn't go your way, the reverse-implied odds are huge; you're very likely to call down flop and turn bets from someone who has a winner. If you don't get it all in on the flop, and the turn doesn't help you, again, very likely to call a turn bet from a winner.
Meanwhile, the implied odds if you hit your flush - or if you hit a four-flush that comes in - are not as great as they might be. If you flop the flush, there's a good chance you can't get a call. If you flop a flush draw, and try the check-raise, it may go around for free - in which case, if you hit the flush on the turn and bet, you may get no calls. Etc.
Being out of position decreases your implied odds and increases your reverse-implied odds.
ON TOP OF ALL THAT, after calling $14 to get in to a likely $84 pot, you'll have $171 left... that barely breaks a 2:1 stack to pot ratio (2.03). A long-odds hand wants long money behind in order to be able to profit if the longshot comes in. Two to one on the pot
at the beginning of the flop is the opposite of long money.
This also means that on the flop, when you checked and villain bet $40, the pot became $124... you needed to jam to maximize your fold equity. Your raise to $135 (which is only bet +$95) was inviting a call! From villain's perspective, pot was $84 + $40 + $135 = $259, and it was only $95 more to call with any unsuited overpair or even top pair. Since villain had a good club and/or felt they had a read on you, villain opted to jam. And, like you said, the $135 bet was already committing you to the hand. You might as well have jammed, yourself, and had the best possible chance of taking down the $84 pot, uncontested.
(Side note, pet peeve: villain did not jam for your remaining $36. Villain jammed. You called your remaining $36.)