Try to Powercycle/clear your cache on the console: https://dovetailgames.kayako.com/Kn...-restart-or-power-cycle-your-xbox-one-console
Im on XBox One too, and I had the same problem, but after powercycling the console the invisible wall was gone...