Assuming they cannot drive I would head for either two places..
Center of Aus, somewhere with a water supply. I'm assuming I wouldn't be the only one headed there and there would be some kind of fortified town. Positive is I'm not sure how heavy zombie populations along the coast would survive crossing hundreds of kilometers of harsh desert--they would probably be feasted on by carrion birds and dingoes as they traveled. Negative to this would be disruption of food supplies and great difficulty in growing own food.
Southwest Tasmania. Very low population, very remote and rugged country, plenty of water and ability to grow foods. Wildlife to eat, fuel to burn for cooking and heating. Very difficult for zombies to climb mountains and they would probably fall prey carrion birds and other animals. I would want to live high up in a rugged area hard to access and to have many packs of dogs to sniff out and attack approaching zombies, important in an area with potentially poor visibility. Negative would be getting there in the first place, I would need to find someone with a plane to fly me there as I'm sure the ports would be full of zombies.
Because of food supplies issues I would take the second choice if possible. Once established hunting parties could begin eradicating zombies from Tasmania, being a low population place this would IMHO be doable from a position of strength and with planning.
Think about this way, this Zombie world is the worst of the worst possibilities. The outbreak was successful and that 90% of the population got the disease. So the 10% would go down in the beginning, by the time you get any of these plans in action your looking at about only 6% now. Theres hope but the situation wouldn't be that good to start out with. Its a mix between Walking dead and Dawn of the Dead.
I had the same Ideas as you for the most part.
Here's my plan for Zombie survival.
1) I would gather supplies in the Army bag that is in my house and along with the book bag that I own. Food, clothes, Socks, and reading material(survival books,medicine). There is this water bottle, it has a filter inside of it. this means provided no Zombies died in the water I can drink from any source.
2) I would then steal a 4x4vechile. I live in Georgia(a lot of gun shops around) and head over to a shop where I would see if I can get a P90, maybe even if there is silencers. I would pick out a sniper rifle, along with any glocks, I would also carry a lot of ammo.
3) Then I would begin moving about looking for any military bases, picking up people along the way and teaching how to survive like me. If I can't find any filled bases, I will then with my people secure the military bases with high fences and defenses all along the wall. I would with a team of trained people go out with silenced weapons go and pick up supplies like seed,soil, and any supplies to build green houses.
4) I would then see if there is a water source near by to tap into. If so I would use books I have to build up the base to one that could sustain a good size population.
5) once stable I would send out teams(kinda like SG teams) to then go out and clear the area, bleach and burn the dead bodies.
Thats it for now. I am bad at making lists on the spot. Theres more, but thats the Plan A.