Just limit to the same valid location check as BaseBlockPosition, no reason to restrict to the world border. Ref: GH-3165
Fixes GH-3165