As a strong couple mode of photon and electron collective oscillation, the movement of an electron can affect the collective plasmon behaviors efficiently. In this paper, we proposed a novel method for modulating the plasmon by directly controlling the movement of the electron but independent of the properties of the medium. This method is demonstrated by a hybrid graphene-dielectric-interdigital electrode structure in the mid-infrared range. It is possible to regulate the confinement of the graphene carrier and stimulate the plasmon in real-time by using the potential wells created by interdigital electrodes. Furthermore, the plasmon frequency can also be modulated utilizing changing the confined area and the density of the carrier. As a result. the frequency has been tuned over a range of ~ 33 cm−1 by applying voltage, and the maximum extinction ratio we measured is 8%. Due to the movement of the electron can also be driven optically, these findings may define a new approach to the all-optical modulator with low pump power.