outer circumference of the governor shaft. An inside way-out is provided in the governor shaft and includes a first shaft port, a second shaft port and an annular groove. The first shaft port is axially formed in a center of the governor shaft, and one end of the first shaft port communicates with a suction side of the pump, while the other end of the first shaft port is sealed. The annular groove formed in the outer circumference of the governor shaft faces the inner surface of the governor sleeve. The second shaft port extends in a radial direction of the governor shaft across the first shaft port and an inlet of the second shaft port opens to a bottom of the annular groove. An outside way-out isprovided in the governor sleeve. One end of the outside way-out opens in the inner surface of the governor sleeve and faces the outer circumference of the governor shaft. And the other end of the outside way-out communicates with the pump chamber. When the governor sleeve advances, the communication between the inside and outside way-outs is shut off and the communication between the suction side of the pump and the pump chamber is shut off. The fuel pressure in the pump chamber is thereby increased. When the governor sleeve backs, both the way-outs communicate with each other and both of the suction side of the pump and the pump chamber are communicated with each other. The fuel pressure in the pump chamber is thereby decreased. And one of