Explanation
Foveated streaming is an optimization technique for immersive content delivery that leverages eye tracking to transmit only the area where the user is looking in high resolution, while reducing quality in the peripheral field of vision. Inspired by how the human eye works (the fovea only perceives fine details in a narrow zone), this method drastically reduces the bandwidth and computing power needed without any perceptible loss of visual quality.
Real-world example
While watching a streamed 360° video, the area directly in front of your eyes is in sharp 4K, while the sides are blurry — but since your eyes cannot perceive details in the periphery, you notice nothing.
Practical applications
- Streaming ultra-high-resolution 360° videos (8K+) over limited connections by transmitting full detail only where the user is looking
- Cloud VR rendering: reducing server-to-headset bandwidth by concentrating pixels on the fovea
- Large-scale multiplayer experiences: optimizing network load per user
- Professional applications (medical, industrial) requiring both high resolution and low latency
Foveated rendering vs foveated streaming
Foveated rendering
- GPU-side optimization: the rendering engine computes fewer details in the periphery
- Reduces local graphics load (30–50% performance gain)
- Requires an eye tracker built into the headset
- Used by Meta (Quest Pro), Apple (Vision Pro), PlayStation VR2
Example: The Quest Pro renders 100% of pixels at the center of gaze and only 25% in the periphery, enabling richer graphics
Foveated streaming
- Network-side optimization: only the foveal zone is transmitted at full resolution
- Reduces required bandwidth (up to 70–80% savings)
- Critical for cloud VR and high-resolution 360° streaming
- Requires low latency between eye tracking and stream adaptation
Example: A 12K 360° stream is delivered, but only a 2K patch around the gaze point is sent at full quality; the rest is in low resolution
VR scenario
A company streams a 12K 360° virtual tour of its factory to remote investors wearing VR headsets with eye tracking. Thanks to foveated streaming, each viewer receives an optimized feed: the exact area they are looking at (a machine, a control panel) is transmitted at full resolution, while the rest of the 360° sphere arrives in reduced quality. Result: excellent perceived quality with only 20% of the bandwidth a full 12K stream would require.
Why it matters in professional VR
- Foveated streaming is the key to delivering ultra-high-resolution 360° content (8K, 12K) over current networks
- It makes cloud VR rendering viable by reducing bandwidth to levels compatible with 5G and Wi-Fi 6
- Combined with eye tracking, it delivers performance gains with no perceptible compromise on visual quality
- An essential technology for the future of XR streaming, driven by advances in embedded eye tracking