The design of the sweater is to be oversized. If you want you can make it to fit closer.
All you have to do is to make less rounds on the yoke.