But will the performance be that b ig of adifference
Barely noticeable in most circumstances.
With DDR3, going from 1066 to 1600 gives you well under 10% better performance in most cases and going from 1600 to 2133 may give you another 5%. Some highly sensitive performance metrics such as 0.1-percentile frame time may show larger improvements but those aren't necessarily perceivable. Going from 2133 to 2400 will yield even smaller gains.
Unless you are a "0.1% frame time variance hunter" or have other similar niche optimization you want to target, high-end DDR4 is largely pointless and 2133-2400 will be perfectly fine. Technically, Intel's chips officially only support up to 2133MT/s anyway.