The city of Norwich, 30 minutes drive away, is a beautiful medieval city with a cathedral and castle. It has excellent shops, with most of the big names featuring.
The North Norfolk coast has a host of small shops selling exclusive artwork, ceramics and other high quality crafts. There are also lots of specialist delicatessens selling scrumptious, high quality foods.
And there are are local market days, which can be found here.