It's really a bigger concern when you're traveling with others, and you both leave your Pokemon out and unwatched.

Now is as good as any time to start! They really aren't that hard to care for at all, it's just a matter of keeping them warm until they hatch.