I was a lot like you, Cut. I started watching it when it first came out, and judged it too harshly on some crappy episodes early on. Considering the garbage that made up much of seasons 1 & 2 of TNG, I really had no right to do that!!
Anyway, years later, my wife started watching a few on the Sci-Fi Channel and said "You know, this isn't half-bad."
I started watching it again, a little more open-minded, and thoroughly enjoyed it. I'm with you, though - I think the Xindi arc will get a lot of adherents, and while I didn't dislike season 3, I too thought 4 was the best. Lots of "mini-arcs", with cool background on the Klingons, the Vulcans, the founding of the Federation and Earth's role in it, the Romulans - all trez Trek.
When you are dead, you don't know that you are dead. It is difficult only for others.
It's the same when you are stupid...