I don't exactly know if your budgie was bitting you or he was just preening you, you see, your budgie will be "bitting" your hands and other parts of your body for the rest of his life.
Did he run away in his safe corner when you tried to touch him? Was he screeching? You can usually tell if a budgie is angry/scared by their bodylanguage.
I am not very experienced with budgie behaviour/bonding like other people here are, but that was how I started bonding with my budgies, I used to feed them seeds from my hand and they slowly got more confortable until they decided to jump on my hand and preen it even if I didn't have any special treats for them. Now they even come without any invitation on my hands or shoulder and start preening me.