What specialty are you? Every field has a different time and content for their ITE.
Whether it matters or not is extremely field dependent as well. For Surgery, it's very important - your scores are explicitly shared on any applications for fellowship. For Ob/Gyn, it's also fairly important if you want to do fellowship - while it isn't shared on your application for fellowship directly, most fellowship programs ask you to email them score reports.
OTOH, for Internal Medicine, it's pretty irrelevant, particularly as an intern. The worst consequence I've heard of doing poorly as an intern is your program requiring you to put together a study plan to do better next year. For 2nd and 3rd year sometimes doing well is a requirement for moonlighting but interns can't moonlight anyway.
YMMV with other fields