You can hire a bike from Woods Cycles, which is opposite the Spar.  Graham (who was brought up in Mundesley) knows everything about bikes and cycling in the area.  

For those who are bringing their own bikes, there are loads of fantastic places to explore.  Try this website to whet your appetite.