I bought my first synth in the mid-80s: a Casio CZ-1000. In 2001 I bought a Yamaha Motif 8.
Today, I use a computer with KXStudio as my operating system, and I have more than 200 synths. All for free. (I also have wav/soundfont/gig players, drum machines, DAWs, samplers...)
You can find many VST instruments for free on websites like VSTplanet. Some are better than others, but it's a good place to start to learn what sound synthesis is all about.
There's a whole world of musicmaking to be discovered!