For most of the verse, the rhythm is two dotted quarter notes and two eighth notes:
(Many other Zombies songs feature a similar rhythm, including "I Can't Make Up My Mind," "Tell Her No," "I'll Keep Trying," "If It Don't Work Out," and "Time of the Season," although some of these substitute a single quarter note for the two eighth notes.)
The bridge retains this rhythm for the first half of each measure, but the second dotted quarter note is often tied to a regular quarter note (although the program I used to make this notation tied an eighth note to a half note instead):
There's a contrast between the rhythms of these two sections, and this mirrors the lyrics in the bridge: "But if you call me / You've gotta treat me in a different way" (my italics). To some degree, this difference is even emphasized because some of the pitches occur in the same order (E F Bb, in the tenth to twelfth measures in the verse and in the second to fourth and eighth to tenth measures in the bridge), making the contrast a bit more obvious.
Here's a scan of the complete notation, with the disclaimer that I may have something wrong: