My rabbits flick their feet at me all of the time in annoyance. Feel privileged and loved. It means he feels comfortable and safe enough around you to let you know he's annoyed with you.
I would try removing the hide. Sometimes they're good for new rabbits to have a safe place they know they can retreat to, but once a rabbit is settled in and is starting to feel comfortable in their new home, a hide can sometimes just be a place they go to avoid the process of bonding with you. Which really isn't ideal. A new rabbit needs a chance to learn that you can be trusted, and form a closer bond, which won't happen if he always goes and hides/avoids. So I would try removing the hide so he can't just avoid contact. Then see how it goes. If you feel it makes him too stressed, you can always put it back.
An alternative would be to train him to go into a pet carrier(using his treats) and move him to a different location. Then you can move him to another small room or area, like the bathroom(use rugs if he doesn't like slick floors), where you can sit and have bonding time with him. You just don't want an area that's too large or has places he'll hop away and hide or avoid contact. It could be he just isn't ready for you to be sitting in his space, as he's not sure enough of you yet for that.
Also, try different times when you sit with him. Rabbits are most active in the morning and evenings, so those may be good times to sit with him, when he'll be most active and maybe more curious about you. Or you may find that during the day when he's less active and is sleepy, that he does better with you during these times.
Don't be afraid to switch things up and try something else if you feel one approach or method isn't working out well. Rabbits all have different personalities, so what works well for one rabbit, may not work as well for another.
With knowing when to start trying to pet and give head rubs, first he needs to feel comfortable approaching you and coming near you. Once he is consistently doing that, you can start slowly offering a hand out when he's near, and let him sniff your hand. Once he feels comfortable with that, then you can try a little head scratch. Just brief, to gauge his reaction and if he's comfortable with that. Then once you can consistently do that, he may be ready for full on head rubs.
When he settles down near you in a loaf or flop, or he presses his head under your hand, or gives you a head nudge, then those can be signals he's ready and will accept mutual grooming from you(eg. head rubs). Once he does accept head rubs, I would stick with that until he's very comfortable, as head grooming is most often how rabbits start mutually grooming each other. Then when he's comfortable with that, you can try other places like cheek rubs, ear rubs, and the body. Though you may find there are certain places he doesn't like to be petted. Like some intact males don't like to be petted near their rump, as that can be a place of attack when confronted by other unneutered male rabbits.
https://rabbitsindoors.weebly.com/bonding-with-your-bunny.html