That's interesting Keith, the camera has been in my possession about 6 months or so but seen little use from due to life getting in the way. it actually came from Oz and I bought it from RFF, VVGC and little use from the original owner.
I have changed the batteries before but have no recollection of this being an issue, hence my reticence to start heaving on it.
Whatyou say re. stopping the battery falling out makes sense, my Fuji and Panny have similar but it is visually located on the top of the battery and easily shifted with finger pressure.
I'm going to give it a bit more pressure,here goes...
Edit; I was being a pussy, it popped out straight away with only a tad more force, thanks for the reassurance, it helped!