beaming mixed reality experiences from the cloud edge to any client
In the future, improving performance in video encoding makes it possible to deliver broadcast quality interactive experiences at modest bitrates to all consumers on all devices. Emerging services will stream experiences from the cloud and cloud edge - virtual reality, augmented reality, and interactive video - with low latency indistinguishable from a local PC. On emerging 5G networks, users will experience the performance of a high performance computer on lightweight VR and AR glasses with applications processed and encoded to video with low latency in the cloud. NGCodec is working with Ericsson and other industry leaders to demonstrate VR over 5G. In 2018 we provide the first demo of interactive VR on a live 5G network at the Ericsson Silicon Valley Experience Center, encoding video to H.265/HEVC at less than 20Mbits/second using the HTC Vive at full resolution and framerate spec with no perceived latency when compared to use on a desktop PC.
ULTRA LOW LATENCY
Meeting the 20ms motion to photon latency budget target for VR. Supporting 4ms video encode, providing quarter frame encoding time at 90FPS.
Employing efficient codecs like H.265/HEVC and soon AV1 to provide maximum image quality and lowest possible bandwidth requirements.
EMPOWERING 5G XR
Ready to be tested in cloud edge system architectures for 5G streaming. Already deployed today on Ericsson’s 5G test network in Santa Clara, CA.
Enables Wireless and Cloud VR solutions to use standard 802.11ac WiFi,
which has 10x the range and no line-of-sight issues, unlike 60GHz 802.11ad
Significant spectrum efficiency enables multiuser, error robustness,
and sharing of spectrum resources
H.265/HEVC standard based compression enables use of
existing mobile HMD chipsets as decoders vr-mr
Subframe end-to-end latency
0.2% (500:1) compression ratio
2160x1200p90 (8K possible)
8-bit & 10-bit support
4:2:0 (4:4:4 possible in future)
Enhanced compression tools (B frames, multiview,
screen content coding, etc. can be added)
Ultra Low Latency Encoding
NGCodec’s patented RealityCodec™ is a low-delay H.265/HEVC encoder IP core which enables wireless and cloud VR. This solution to video encoding provides video connectivity between an experience run on the cloud, encoded in the cloud, and delivered by low latency video stream to an untethered, mobile, VR head mounted display.
Paired with high availability, low latency, high bandwidth wireless networks, VR can be delivered with a 0.4% (250:1) video compression ratio with no perceived latency or difference to a standard desktop PC VR configuration using a standard HDMI interface. The system is designed to scale with increasing VR resolution and frame rate requirements from today’s 2K+ horizontal resolution to achieve higher pixel densities and potentially greater field-of-view systems.
Today, the system provides 250:1 H.265/HEVC compression for the HTC VIVE at native resolution and framerate (2160 x 1200 at 90fps) resulting in a 20Mb/s video stream and sub-10ms latency and is being demonstrated on wired and wireless networks, with a technology demonstration on 5G hardware underway.
NGCodec is targeting 100Mb/s second streams using upcoming Alliance for Open Media AV1 compression for systems with up to 8K resolution and 120fps framerates targeting emerging 5G wireless networks
Empowering 5G XR
The system is designed for high bandwidth, low latency networks including today’s state of the art Wi-Fi solutions and future 5G networks. The system has been demonstrated on Ericsson’s 5G test network at their 5G Experience Lab in Santa Clara, California delivering low latency video with no perceptible difference when compared to a wired HDMI connection.
The system has also been demonstrated using Celeno’s 5GHz 802.11ac Wi-Fi featuring dynamic channel-switching capabilities designed to circumvent problems that arise when the spectrum becomes busy. Together, the result is 0.4% (250:1) video compression without the use of HDMI cables and with no perceived latency.