Sounds like a problem, the lever activates the camera's internal battery to power the meter.
I have one F2 body that does the same thing as yours, does not stay out. I use it with a DP-2 meter with DS-1 servo-motor. In this configuration, the battery in the servo-motor powers the meter. Using the setup with a Motor-Drive has advantages.