Get a cheap bike, don't save up for something 'nicer'. Espeically if it means waiting and unlearning everything you just picked up. It's riding season, go find a starter bike. Then you only have to carry cheap insurance (liability) and no reason to carry comprehensive (and put high collision deductible) if the deductible is higher than you paid for the bike. Solves all your problems right there.
Totally agreed, just get out there and ride. It's not about looking flash, you can have fun on pretty much anything that starts up.