I also think that it was in the letter that was given to him on the same day that Harry was left there. Dumbledore was probably referring to the bit of the letter which told Petunia to keep him safe.