A pub tucked away in a small North Norfolk village which became an unexpected celebrity hot spot has announced temporary close.