Ok, the arm on the fuel pump rides on a lobe connected to the timing gear. Make sure when you put the pump in that the arm is on the lobe, don't just stick it in there. When you put the arm on the timing gear the gasket surface where the bots go in should not fit right. You have to push it in there so the arm on the pump depresses and then bolt it on.

Was there fuel in the line when you took the old pump off?