So there are a different studies that show how our senses adapt when they are forced to be interpreted differently. For example, someone who is wearing goggles that vertically flip the image would eventually see the world right-side-up once their brain adapts to the input. Continuing this idea, here's a scenario: have someone (maybe a child) always wear VR, and place a 360 degree camera on their head. Take an adjusted version of the front facing 180 degrees and display to the left eye, take an adjusted version of the rear facing 180 degrees and display to the right eye. Once the brain adapts, could the viewer be seeing in 360 degrees in an coherent way?