The actor revealed why he skips watching the 2006 rom-com with his kids each Christmas — despite the film's massive popularity.