Here are some tools I just could not do without. They were my first tools and provided a good foundation to build on. Click on the pictures and it'll take you to where it is available.
First, the third hand with the tweezers. This can hold just about anything so you can solder. It keeps your hands free to hold your solder and torch. It is still something I use every day. There are more elaborate styles out there, but this one is versatile for simple projects. These tweezers are also available without the third hand and are essential. They self close (you pinch to open) so they hold things for you!
This is a charcoal block. I love to use it to solder. It doesn't get as hot as a fire brick, it controls "atmosphere" so less firescale forms and it works beautifully to melt and ball silver. I have found it to be much more useful than a firebrick. I must say, however, since they are small, I work with a firebrick underneath it, just for safety.
Until I could really saw well I found using shears to cut out my bezels was much more time efficient as well as it allowed me to be more precise. I had to file more, but in the long run, these saved me a few ruined bezel plates! These shears are SHARP! so be careful. It's hard to work with stiches in your finger!
This next one is a little cheat: it costs more than $20.00, but only a little. This was my first torch and I found it to be more than enough for soldering thinner ring shanks, balling wire, making bezels, etc. It doesn't get as hot as my acetylene torch which was great. I melted fewer thin bezel wires that way!
I found that starting small gave me confidence so that I could build on my skills and venture onto bigger and better tools.
I hope this gives you aspiring metalsmiths a little info that will give you some confidence as well as information on great startup supplies.