here's another approach, and I am going out on a limb with specific suggestions of NEW equipment.
( There are ways of finding bargains in the used market, but somebody else might have good suggestions).
This is a suggestion for components of Very Low Cost whith expectations of DECENT sound which will please and will not embarrass:
One Vendor only: http://www.needledoctor.com
TURNTABLE: Brand: "Pro-Ject". Model: "Debut Carbon" including the Ortofon Red cartridge in a "combo" deal, $399.00
AMPLIFIER with Phonograph Preamp Included inside: Brand: "Cambridge Audio". Model: "Topaz Integrated AM 10". 35 watts per channel. $349.00
SPEAKERS: Brand: "Mordaunt-Short". Model: "Carnival 1" bookshelf-size. $199.00 the pair.
For $1,147. PLUS shipping, this is a complete, and decent, system with full Moving Magnet Phonograph capability and sufficient inputs to add other music sources outlined in the amplifier description.
You can see each component's description in the website/store of Needledoctor.
PS: let us know how it goes, as you develop ideas and look into the suggestions.