it's a mystery

In spite of using the same patterns for each size of hat they always come out utterly different than they should. What's up with this?

I think I need to start using seam guide thingy.