This paper studies the self-consistent interactions between whistler envelope solitons and electron beams in inhomogeneous plasmas, using a Hamiltonian model of wave-particle interaction where nonlinear equations describing the dynamics of whistler and ion acoustic waves and including a beam current term are coupled with Newton equations. It allows describing the parallel propagation of narrowband whistlers interacting with arbitrary particle distributions in irregular plasmas. It is shown that the whistler envelope soliton does not exchange energy with all the resonant electrons as in the case of whistler turbulence but mostly with those moving in its close vicinity (locality condition), even if the downstream particle distribution is perturbed. During these interactions, the soliton can either damp and accelerate particles, or absorb beam energy and cause electron deceleration. If the energy exchanges are significant, the envelope is deformed; its upstream front can steepen, whereas oscillations can appear on its downstream side. Weak density inhomogeneities as the random fluctuations of the solar wind plasma have no strong impact on the interactions of the whistler soliton with the resonant particles.