Fuel is in constant circulation. Prevents vapor locks and air locks.
I had the same experience with my VW Rabbit back in the 80's. Turned
out to be a slow leak in the head gasket on the #1 cylinder. Turns out
water, with a splash of antifreeze, doesn't compress nearly as well as
air. Above around 3000 rpm there was enough pressure to keep the water
out or some such and below that the presence of water proved a bit of a
damper (as it were) on the whole combustion process. On second
thought, that may have been my Fiat X-19. That or the Rabbit. Either
way, same exact symptoms.
Oh, and I did all the same things (starting with the fuel filter,
rotor, cap, wires, fuel pump, etc) trying to fix it too.
Good luck.