Basically the memory controller has to work double duty to run 4 sticks instead of 2. Not all memory controllers are fast enough to handle all 4 slots at the full speed. It’s going to depend on your specific motherboard though, it’s not a global rule that 4 sticks is always slower than 2.