Viewing entries in
VR/AR/MR

Comment

NGCodec Presents the Next Generation of Video at CES 2019

The Intersection of 5G and Emerging Video Standards Makes it Possible to Deliver Live Streams at Broadcast Quality to Any Screen

NGCoded has the highest performance, lowest latency, best visual quality video encoders available and is demonstrating the future of live video streams and mixed reality experiences at CES 2019. If you would like to meet with us, use our online scheduling tool at www.ngcodec.com/ces online or visit our booth at Sands Expo Center,Level 1, Hall G, Booth 52786 at CES 2019.  

Video streams are a massive component - 70% -  of internet traffic and growing fast. At CES 2019 NGCodec will for the first time have our own booth and will be demonstrating the future of live, interactive internet video. We are announcing our upcoming AV1 support and double density encoding - a 2X performance improvement - coming later this year. We are also demonstrating VR encoding for real time, interactive games at the full resolution and spec of the HTC Vive featuring our latest latency improvements, delivering an ultra low latency video stream with performance and visual quality indistinguishable from the native stream at less than 20Mbits/second.

Today’s Fastest, Highest Visual Quality Video Encoders

Today, NGCodec has the highest performance video encoder available and the only encoders which can provide broadcast quality live streams on H.265/HEVC and VP9. It produces encoded video at the highest quality and lowest bitrate employing the latest video standards. At CES 2019 you can see our new NGCodec developer platform, a small dedicated video encoder for prototyping cloud-scale encoding.

Emerging codecs including H.265/HEVC and VP9 offer higher compression rates with the same or better visual quality and encoding costs. Implementations vary – the compression rate and visual quality of a given encoder can be dramatically different. NGCodec has developed state-of-the-art encoders, using Xilinx FPGAs, providing over 30% better compression with H.265/HEVC and VP9 compared to existing H.264/AVC encoders targeting live workloads. For video streaming, better compression means reduction in bandwidth.

Google, Twitch, and NGCodec recently published a VP9 implementation white paper on hardware based encoding for live VP9 encoding and Twitch has created a pubic test stream as a technology demonstration. You need VP9 decoder support in your browser which is available with Chrome and can be viewed at https://www.twitch.tv/vp9dev online.

“FPGA-based real-time VP9 encoding can deliver at least 25% bitrate savings compared to the highest-quality H.264 encoders deployed in Twitch’s production today.” -- The Twitch Blog, December 2018

A 5G Future - Streaming Interactive Applications to VR/AR Screens

In the future, improving performance in video encoding makes it possible to deliver broadcast quality interactive experiences at modest bitrates to all consumers on all devices. Emerging services will stream experiences from the cloud and cloud edge - virtual reality, augmented reality, and interactive video - with low latency indistinguishable from a local PC.

On emerging 5G networks, users can experience the performance of a high performance computer on lightweight VR and AR glasses with applications processed and encoded to video with low latency in the cloud. NGCodec is working with Ericsson and other industry leaders to demonstrate VR over 5G. In 2018 we provide the first demo of interactive VR on a live 5G network at the Ericsson Silicon Valley Experience Center, encoding video to H.265/HEVC at less than 20Mbits/second using the HTC Vive at full resolution and framerate spec with no perceived latency when compared to use on a desktop PC.
For more information feel free to reach out to info@ngcodec.com or feel free to book some time with our online tool www.ngcodec.com/ces at CES 2019.

Comment

Comment

My brief experience with the new Oculus Go HMD

Its a great $199 standalone HMD. Battery life is quite short. CG content is poor. This is one of the main limitations of Mobile HMD. I wish it used USB-C instead of Micro USB. 

8K 360VR and 180VR is great. Unfortunately there is not so much today. The majority is 4K or lower resolution. IMHO 360VR and 180VR at resolution lower than 4K is unwatchable. Even 4K is poor. 

 

Comment

Comment

NGCodec Joins New Huawei 5G Cloud VR/AR/MR SIG at Mobile World Congress 2018

Barcelona, Spain. NGCodec, a pioneer in cloud video processing, has joined the 5G Cloud VR/AR/MR Special Interest Group (SIG) established by Huawei’s Wireless Xlabs at the 2018 Mobile World Congress (MWC). The participants include leading VR and wireless technology providers seeking to stream experiences through the cloud targeting upcoming 5G wireless networks. Consumer applications hold the promise of speeding the adoption of 5G, but must break new ground, beyond today’s ubiquitous mobile broadband networks. NGCodec believes that streaming the cloud directly to the user interface can create a new wave of consumer application innovation. This vision is detailed in a new white paper by TIRIAS Research entitled “The Instantaneous Cloud: Emerging Consumer Applications of 5G Wireless Networks” now available at www.ngcodec.com online.

“NGCodec is working actively with service and network providers to demonstrate the synergy between low latency 5G wireless networks and high quality, low latency video streaming technology,” said the company’s new VP of Worldwide Business Development, Ian Jefferson. “Today’s Cloud video streaming technology from NGCodec designed for the most demanding live video streaming applications will continue to develop in support of upcoming cloud VR services on 5G networks.”

“Without new consumer applications, 5G will be unable to drive new models or monetization and risks slow adoption.” said Oliver Gunasekara CEO and Founder of NGCodec. “Taking advantage of the massive improvement in latency with 5G technology can unlock an instantaneous cloud with new and inventive business models. The next generation of immersive, high performance VR/AR/MR applications will be streamed directly to affordable and ubiquitous mobile devices.”

The company’s RealityCodec™  is optimized for low latency, streaming VR over a network with no noticeable difference between the encoded stream and a directly connected head mounted display. Today, this technology delivers broadcast quality H.265/HEVC for real-time streaming in the Amazon EC2 F1 Cloud and low latency H.265/HEVC for interactive virtual reality.

About NGCodec Inc.
NGCodec® has been in passionate pursuit of next generation video compression since 2012. With the support of investors including Xilinx, NGCodec’s agile startup team has created Reality Codec™, a compressor-decompressor technology optimized for ultra-low latency, high-quality applications. Headquartered in Sunnyvale, California, NGCodec leverages FPGA acceleration in the Cloud to lower encoding costs by 10x over traditional CPU encoders. Learn more at www.ngcodec.com online.

5G Cloud VR SIG Meeting on Monday 26th February at MWC 2018

5G Cloud VR SIG Meeting on Monday 26th February at MWC 2018

Comment

Comment

NGCodec CES 2018 Round up

ces-logo.png

 

NGCodec was at the America’s Seed Fund Powered by the National Science Foundation at Eureka Park. It was a great show and we demonstrated our RealityCodec Video compression technology for VR application. Cloud-based VR is an emerging application for cloud video encoding where high end graphics applications are run in the cloud, and output is converted to compressed video streams for rapid transmission to untethered mobile users. The performance of cloud servers is 20x that of smartphone clients, bringing today's PC class performance to any head-mounted display. Our RealityCodec is optimized for ultra low latency enabling streaming VR content over a network with no noticeable difference between the encoded stream and a directly connected head mounted display. By deploying mobile edge servers with built-in RealityCodec encoders, we believe service providers will be well positioned to provide VR experiences as a service to consumers in the near term.

The demo set up at CES2018 consisted a PC running a high-end game powered by SteamVR and rendered using a high-performance Nvidia PC graphics card. The uncompressed video graphics from the Nvidia card were fed as input to the Hardware accelerated FPGA RealityCodec Ultra Low Latency Encoder. The output of the encoder was connected to a low latency decoder through a network switch with the decoder output connected to the HMD over HDMI. The head and hand movements from the user were also captured in real-time and fed back to the PC application to render the next frame.

Check the video below where Oliver Gunasekara, our CEO explains and showcases the technology.

Comment

Comment

Five Critical blockers to immersive cloud VR

pexels-photo-123335.jpeg

Desktop VR has phenomenal mature ecosystems but suffers from the limitation that users are wired due to high bandwidth needed to transfer video from the desktop to the HMD. On the other hand, standalone Mobile VR suffers from serious processing and battery life limitations. Cloud VR, which marries the two technologies, is an excellent fit and this white paper by Tirias Research highlights the current industry challenges and the solution proposed using Cloud VR.

The cloud VR framework while practical is still in it's infancy and has problems which have to be solved before it can be deployed. Fortunately, the technical solution to these problems exist today and with efforts and collaboration amongst industry leaders, this solution is deployable in the near term.

So, what are the five key blockers that prevent an immersive Cloud VR experience today?

  • Low Latency Video Encode: The cloud VR architecture leverages the full processing capability of Desktop VRs and compresses the Video 300:1 and streams it across the cloud network. For the VR application, where frames are rendered based on user head movements, it means a very low end-end latency compression engine is required while preserving the fidelity of graphics rendered. NGCodec's hardware accelarated reality codec has ultra low sub-frame encode latency and solves this problem. NGCodec has also demonstrated the quality and latency of this encoder at CES2018.
  • Low Latency network: Seamless VR applications typically need an motion-to-photon latency of ~20ms. If video is rendered, compressed and delivered through a network, it's critical that network providers ensure network latency is bare minimum and 5G infrastructure and fiber optics plus WiFi can deliver ~2ms latency, ~0.1ms jitter and very low packet loss.
  • Proximity to the edge: It's crucial that cloud servers performing the heavy duty rendering and encoding be deployed at high density 'edge locations' to ensure maximum coverage. E.g. in a metropolitan area like NYC at an epicenter with up to 200 mile radius coverage. Due to speed of light and 50% overhead going through equipment every 60 miles is ~1ms round trip latency on a fiber optic network.
  • Low Latency Video Decode: The addition of a compression layer in VR processor will naturally require a decompresser at the consumption head set end. For a seamless experience, the HMD has to, in addition to the modem, also incorporate a low latency video decoder. It's important that a standard compliant decoder enabled with Low latency decode mode be integrated in chipset inside the HMD. The low latency video decode must be coupled with a low latency display controller.  
  • Inside out 6DoF tracking: 3DoF tracking currently used in most mobile HMDs has its limitations which 6DoF tracking is expected to alleviate and most leading HMD makers are working to incorporate built-in 6DoF tracking in the next generation HMDs. Furthermore, the outside-in tracking used in current Desktop VRs also needs to be replaced with Inside-Out architecture to avoid the need for the user to install external tracking infrastructure.

 

Download Cloud VR White Paper

 

Comment

Comment

Industry definitions of Immersive Visual Experiences (VR/AR/MR)

Over a year ago (December 2016) the Consumer Technology Association (CTA)™ reality working group* defined the following industry definitions:

  • "Virtual Reality" (VR) creates a digital environment that replaces the user’s real-world environment.
  • "Augmented Reality" (AR) overlays digitally-created content into the user’s real-world environment.
  • "Mixed Reality" (MR) is an experience that seamlessly blends the user’s real-world environment and digitally-created content, where both environments can coexist and interact with each other.
  • "360° Video" or "360 Video" allows the user to look in every direction around him/her.

I think they are a great start to help get consistency in the industry. I would add that VR and MR require a Head Mounted Display (HMD) where as AR uses a Smartphone or Tablet display. I would also add the following definitions:

  • 3DoF allow the viewer to change their view using three kinds (‘degrees’) of movement. (Three Degrees of Freedom i.e Yaw, Pitch, Roll).
  • 6DoF allow the viewer to change their view using six kinds (‘degrees’) of movement. (Six Degrees of Freedom).

I would expect they could be combined. E.g. a 360 Video 6DoF experence. Typically 6DoF camera capture light fields and point clouds. Below is a graphic from Facebook on 6DoF.

Above is video given at the Facebook developer conference in April 2017

Above is video given at the Facebook developer conference in April 2017

*The CTA reality working group includes member companies Amazon, AMD, Dolby Laboratories, the Fox Innovation Lab at Twentieth Century Fox, GoPro, HTC Vive, Intel, Meta, Microsoft, NVIDIA, Reverge VR, Samsung, Sony, STRIVR, Technicolor, and Translink Capital.

Comment

Comment

NGCodec Closes $8M Series A, Launches Live Broadcast H.265/HEVC Cloud Video Encoding and Demonstrates Cloud VR

Company Demonstrates Broadcast & Virtual Reality Solutions with the National Science Foundation at 2018 Consumer Electronics Show Eureka Park (Booth 50322)

Upcoming AV1 Codec Support and Trial Deployments on 5G Network Technology to Follow with the Close of $8M in New Funding

Las Vegas, Nevada. Today NGCodec, the pioneer in cloud video processing, announced the availability of broadcast quality H.265/HEVC for real-time streaming in the Amazon AWS Marketplace and ultra low latency H.265/HEVC for interactive virtual reality (VR) and mixed reality (MR). Streaming content from the cloud will activate the first billion users in VR by effectively transforming smartphones into high performance VR/MR clients. Broadcast quality video encoding will allow broadcasters to stream live events to millions of viewers with the same visual quality (VQ) as video on demand (VOD). The availability of the NGCodec H.265/HEVC encoder, followed in 2018 by support for the new Alliance for Open Media (AOM) AV1 Codec will provide the highest quality video encoding technology for real-time, interactive entertainment powered by scalable cloud infrastructures. Today’s high-speed fiber optic and emerging 5G wireless technology will deliver these experiences to users everywhere.

“NGCodec RealityCodec™ delivers the best video quality for live H.265/HEVC video encoding in the AWS EC2 F1 public cloud” said Marc Todd Founder and CEO of Skreens. “It took just a few days to integrate and the SaaS based pricing avoids larger upfront costs.” Skreens, an NGCodec customer, delivers multi-video fusion solutions for broadcast, streaming, and AV to mobile, desktop and IOT users.

“We have worked diligently to bring our advanced video codecs to the Amazon Cloud and to demonstrate the potential for cloud media and virtual reality.” said Oliver Gunasekara CEO and Co-Founder of NGCodec. “Closing our Series A round will propel our technology into the 5G era, bringing our total raised to $15.9M from world-class institutions." 


“NGCodec is delivering two technically challenging entertainment experiences through the cloud: real time, live broadcast and low-latency, high resolution VR and MR,” said the company’s new CTO and VP of Algorithms, Pavel Novotny. “Our broadcast quality video processing technology will allow broadcasters to stream the highest quality live video at 60 frames per second to millions of viewers delivered with the same VQ as VOD with scalable cloud servers. Our VR streaming technology renders 90 frames per second and scales to meet the increasing resolution and frame rate demands of next generation headsets. Both will migrate to our AV1 codec implementation later in 2018 for even higher compression”


The company is demonstrating RealityCodec for VR at the America’s Seed Fund Powered by the National Science Foundation at 2018 CES Eureka Park (Booth 50322). Cloud-based VR is an emerging application for cloud video encoding where applications are run in the cloud, and output is converted to compressed video streams for rapid transmission to untethered mobile users. The performance of cloud computers is 20x that of smartphone clients, bringing PC class performance to any head-mounted display. RealityCodec is optimized for low latency, streaming VR over a network with no noticeable difference between the encoded stream and a directly connected head mounted display. To further explore the future of VR streaming, NGCodec and Tirias Research have announced the publication of a free white paper on the potential for cloud to activate a billion VR/MR users available at www.ngcodec.com/ces online.


NGCodec creates algorithms, silicon logic and FPGA implementations for cloud video processing, powering the next generation of real-time media experiences. The company’s RealityCodec technology streams interactive and real-time media at the highest performance levels. The company is announcing the completion of its most recent financing round of $8M bringing the total invested to date to $15.9M. 

About NGCodec Inc.

NGCodec® has been in passionate pursuit of next generation video compression since 2012. With the support of investors including Xilinx, NGCodec’s agile startup team has created Reality Codec™, a compressor-decompressor technology optimized for ultra-low latency, high-quality applications. Headquartered in Sunnyvale, California, NGCodec leverages FPGA acceleration in the Cloud to lower encoding costs by 10x over traditional CPU encoders. Learn more at https://ngcodec.com/ces or @NGCodec. NGCodec can be found On the NSF booth in Eureka Park, Sands Expo Level 1 Hall G, Booth Number 50322

 

Media Contact

Oliver Gunasekara, CEO

pr@ngcodec.com
 

Comment

Comment

NGCodec demos Cloud VR at CES 2018

We have been choose by the National Science Foundation (NSF) to showcase our Cloud VR engineering innovations on the NSF booth (#50322) in Eureka Park Marketplace at CES 2018. NSF awards about $200 million annually to startups and small businesses. NGCodec has received almost $1M in grants from the NSF.

You can read more in the NSF press release Future consumer technology from NSF at CES 2018 Eureka Park.

If you would like to see a demo then please use the widget on this page.

Comment