Goblet of Fire for me as the best balance of seriousness and whimsy. It's the point where the childish perspective really starts to give way to a more mature conflict. Plus, there are a lot of memorable characters and scenes.