Umm, did you push the goggles in all the way?
Also, for the close-up range, the lens is farthest away from the film. I had a problem in winter, where my RF arm was sticking, and not moving out of the camera. I could detect the problem because my RF image stopped moving when I was focusing.
Did you detect your RF image not moving, as you were focusing your lens? If yes, your RF arm might be sticking, and that will adversely impact your focusing.
Another check is to remove your lens, and test the arm movement with your finger, especially very very slowly. When my arm was sticking, if I moved it fast, it was moving fine. But at slow movement (like when moved by the cam), it was sticking.
If the arm is fine, I'd check if the goggles were fully pushed onto the mount.