I think he started after Harry rescued him. I mean...after that he didn't really harm him anymore, of course they didn't become any pals or somewhat but all the bulliing did kind of smoothen.
In the first books, he surely dislikes him, I think thats pretty clear to see, by his words and his actions.