Wireless and Cloud Virtual Reality (VR/AR/MR)

WiFi 5GHz 802.11ac ▪︎ Fiber Optics ▪︎ 4.5/5G LTE

NGCodec and Celeno have joined forces to deliver a Wireless and Cloud Virtual Reality (VR) solution using NGCodec’s RealityCodec™, a low delay H.265/HEVC encoder IP core, paired with Celeno’s 5GHz 802.11ac WiFi. RealityCodec enables wireless and cloud VR by replacing the now-ubiquitous HDMI cable with a video encoder to transmit video via WiFi. Celeno WiFi’s dynamic channel-switching capabilities circumvent problems that arise when the spectrum becomes busy. Together, the result is 0.4% (250:1) video compression without the use of HDMI cables and with no perceived latency.

KEY BENEFITS

  • Enables Wireless and Cloud VR solutions to use standard 802.11ac WiFi, which has 10x the range and no line-of-sight issues, unlike 60GHz 802.11ad
  • Significant spectrum efficiency enables multiuser, error robustness, and sharing of spectrum resources
  • H.265/HEVC standard based compression enables use of existing mobile HMD chipsets as decoders

FEATURES SUMMARY

  • Sub frame end-to-end latency
  • 0.2% (500:1) compression ratio
  • 2160x1200p90 (8K possible)
  • 8-bit & 10-bit support
  • 4:2:0 (4:4:4 possible in future)
  • Enhanced compression tools (B frames, multiview, screen content coding, etc. can be added)
NGCodec and Celeno Demo Overview

WIRELESS VR DEMO: NGCODEC & CELENO

A joint demo from NGCodec and Celeno consists of VR content running on a high-end desktop PC with a NVIDIA Quadro M6000 GPU. 

The frame buffer of the GPU is fed via PCIe to the NGCodec FPGA PCIe encoder. The NGCodec RealityCodec H.265/HEVC low delay encoder compresses the output from the GPU at 90 fps and then streams it via ethernet to the Celeno 802.11ac WiFi radio. The Celeno chipset sends the real-time video stream over 5GHz 802.11ac standard based WiFi.

A Celeno 802.11ac WiFi radio receives the video stream and sends it via Ethernet to an H.265/HEVC low delay video decoder running in an FPGA. The video is then output via HDMI and sent to the HTC Vive HMD for display. 

NGCodec enables an untethered VR experience, which delivers higher fidelity and longer battery life than traditional mobile VR. When low latency 4.5/5G and fiber networks are available, the same solution can be deployed to deliver a Cloud VR/AR/MR experience.

NB: Amazon Web Services (AWS) deployed FPGA F1 instances in late 2016 and NGCodec was the first company to use them.