Drafts (or critters) are coming into your home through the base of the door.
If you can feel a draft coming in at floor level, make sure your door is fitted with Frost King’s Aluminum Drip Cap and Door
Sweep, which seals the threshold (where the door meets the floor). To ensure you can easily open and close the door, align the door sweep so it just skims the threshold.