Can I take my Chihuahua puppy for a walk in the winter time?

I adopted a Chihuahua puppy awhile ago and he is now 3 1/2 months old and four pounds. He has an arrangement of sweaters, fleeces, and jackets, however no boots or hats. The snow has *finally* melted on the sidewalks here, but the high today is only 32. Can I take him for a short walk if I put on his fleece, jacket, or sweater, or is it simply just too cold?