A crack as small as 1/16th of an inch around a window frame can let in as much cold air as leaving the window open 3 inches!
or
No worries, it happens.