I just averaged all of my episode scores for each season. To give you an idea of where I stand on a season by season basis, here are my average scores.
Season One: 5.06
Season Two: 5.65
Season Three: 5.62
Season Four (so far): 6.56
As you can see, season four is my favorite by far.