Agreed. I hate to add restrictions... It actually draws really well. Sometimes when lighting a new fire it'll put the match out! It's just when the wind blows really hard that I get smopke back into the house.
I got one of those vaccustack chimney caps for this reason and it helped me out quite a bit. still not perfect but 90% better I'd say on those very windy days. They are pricey but in my case well worth it.