The Canon P, Canon 7, and Bessa R a all pretty good rangefinders for entry level use. These are all interchangeable lens Leica thread mount cameras, well made, not too hard to find, and can be found at reasonable prices, particularly the Canon 7.
The more common Canon rangefinder lenses are also good moderately priced lenses for getting started. The more popular Cosina Voigtlander lenses too are really good, but cost a bit more. There are a few other (slightly harder to find) lens/camera possibilities - hang out on this Web site and you will learn all about them!
Contax IIa, Tanack IV-S, Canon L1, Leotax S, Kardon Civilian, Bessa R2S, Nikon S2, Leica, IIIa, Kalloflex, Kowa 6, Konica Autoreflex T, Canon Ftb QL, Pentax Spotmatic, Minolta SRT-101, Nikon F, Exakta VX