Look for an older turntable on the used market. I'm not sure what was common in UK, but there were a number of decent British turntables, as well as European and Japanese.
Ariston, Heybrook, Dual, Technics, Pioneer, Yamaha, and a few more, all made a lot of turntables that should bereasonably priced. OK, I don't know what the market is like for the first two over there, but you might get lucky. Avoid anything light and plastic.
If you can find a shop with one from around 1980, and compare it to the new USB things, just by picking it up, you will know immediately what I mean.
You will need a phono pre-amp, and possibly a new cartridge or stylus. If you have an older amp or receiver with a phono section in it, you should not need another phono pre-amp.
Turntable ==> phono preamp ==> amplifier ==> speakers. (This may seem obvious, but not to everybody.)
You might find something at a boot sale or thrift shop, second-hand shop, or online. Feel free to ask about what you find.
Keep them spinning.