Skip to main content

Chevy’s augmented reality test drive puts you behind the wheel of your dream car

The same video game technology that powers Microsoft’s Gears of War 4 and Epic Games’ new Battle Breakers game is also being used by Chevrolet.

But the car company isn’t employing Unreal Engine 4 to drive a new video game experience. Instead, this technology is changing the concept of car customization at Chevrolet. And it has the potential to revolutionize the entire auto industry, thanks to a brand new Blackbird motion tracking vehicle that can literally transform into any vehicle – from a ’69 Camaro to a Chevy FNR concept car.

Both of these concepts are on display at the Game Developers Conference in San Francisco this week at Epic’s booth. And they’re made possible by real-time rendering, a long-time staple of the video game industry that’s now expanding beyond entertainment across other verticals.

Recommended Videos

“We live in a world that’s increasingly becoming digital,” Kim Libreri, Epic Games’ chief technology officer, told Digital Trends. “The ability for a game engine, especially Unreal Engine 4, to bridge the gap between our real world and the virtual world, is an important aspect of where we’re going. Augmented reality’s on the horizon.”

“Augmented reality’s on the horizon.”

Augmented reality is already a reality. And Epic has teamed up with ad agency The Mill and Chevrolet to superimpose photorealistic vehicles like the Camaro ZL1 on top of an actual vehicle (dubbed the Blackbird) that’s capturing a 360-degree view of the Angeles Crest Highway in Los Angeles (minus the LA traffic). While Chevy and The Mill have experimented with this augmented reality concept in the past, it was always done in post production.

Sam Russell, general director of global marketing for Chevrolet, told Digital Trends back in 2013 The Mill took a C6 Corvette and decorated it with motion tracking markers to shoot a live action commercial. Then in post production they rendered the C7 Corvette over it using 3D computer-generated modeling.

“That opened the idea of doing a generic customizable motion tracking vehicle set up for just this,” Russell said.

And the Blackbird, which has also been called Raven, was born. The simple black car was used to shoot commercials for the Chevy Sonic, but there was still an issue. The film crew couldn’t accurately get a sense for what the new vehicle looked like in the shot until after the spot was filmed. They needed some type of technology that could not only produce photorealistic imagery, but accurately depict lighting and shadows – all in real-time while housed in a mobile camera SUV (in this case a Mercedes-Benz ML) that chased the Blackbird.

Enter Epic Games, which has greatly expanded its clientele beyond video game makers over the past few years. The independent developer has also steered into the automobile industry through its Unreal Engine Enterprise division, working with companies like McLaren, Jaguar, BMW, McLaren, Toyota’s Australian unit and now Chevrolet.

The Race

The end result of this first marriage between real-time game rendering and real-world Hollywood-style commercial production debuts today from Chevy. “The Race” is a 60-second video that pits the 2017 Camaro ZL1 against the Chevy FNR concept car. There’s also a ’69 Camaro available for this demo, which debuts at GDC.

The “aha” moment comes when you realized that none of these vehicles ever touched the pavement in LA. They’re all AR creations born of a video game engine, and powered by a high-end consumer PC with an NVIDIA graphics card.

Libreri believes what people are going to take out of this prototype video is, “Wow, when AR really comes, it could be amazing.”

“If you can’t tell the difference between what’s real and what’s virtual, it’s a game changer in terms of what you can do,” Libreri said. “Right now when you think of consumer AR, it’s something like laying simple penguins over a background. What we wanted to do with this is really show people that using current NVIDIA hardware, look what we can do. Imagine what the world’s going to be like in five years from now.”

“If you can’t tell the difference between what’s real and what’s virtual, it’s a game changer.”

Russell is excited what he can do today. As a marketing exec, it’s his job to generate excitement about vehicles before they’re released. And that poses a lot of logistical problems, including the lack of actual vehicles for expensive commercial shoots, or the need to keep the actual cars under wraps for specific auto shows. The Blackbird can transform into any vehicle, and anyone who happens to catch a video or picture of it will have no idea what that transformation will be. Only the film crew, which can see the CGi vehicle in real-time, know the secret identity.

“The cars are never identical for different markets, whether they change the color or the wheel or a feature on the car like chrome mirrors or integrated blinkers,” Russell said. “Now you just have one car on the shoot and you can render versions for every market with the computer. It’ll save hundreds of thousands of dollars on a same-day shoot and millions of dollars on a global shoot.”

Custom Cars: Let’s Get Digital

Chevy has also teamed with Epic Games to create a car configurator using Unreal Engine 4 and the very same assets that power “The Race.”  In fact, you can customize the Camaro and then watch your version of the vehicle take on the concept car.

Libreri believes car manufacturers will be happy that a car configurator can actually produce something that looks like their cars, and they’re going to see the options that open up a much more deeper engagement.

“With this Blackbird technology that The Mill has, they could put cars on racing tracks, drive through beautiful locations, and it’d be the car you just customized,” Libreri said.

At GDC, Epic is showcasing a giant touch screen TV that allows anyone to customize the new Camaro to their liking. The company has even integrated Google Tango AR into the demo, allowing the smartphone to act like a video camera inside the virtual world so you can look at the vehicle from any angle.

“Out on horizon, one of the more powerful sales tools we have is helping people imagine themselves in that vehicle,” Russell said. “Today’s TV ads aren’t customizable. When you go to car configurators today with all the colors and wheels types and options, we want you to imagine the vehicle you want. This technology allows us to run footage of the customer’s actual car. And we can customize the ad to the car they want to buy. Eventually, we’ll be able to place the people inside the footage ith virtual reality. There are a lot of possibilities for this technology.”

Libreri said the same customized car could be used in a video game experience in the future.

“There’s no reason that they couldn’t make a companion driving application at whatever their favorite test track is,” Libreri said. “That’s the nice thing about using a game engine because when we build an asset, it doesn’t need to just be a high quality piece of computer graphics like you would make for a movie or a TV show, it can be an actual virtual vehicle with steering, suspension and friction.”

Video game technology is helping Chevy find new roads today, but the bigger implications are just on the horizon. In a customizable, digital world, ordering the exact car you want through the cloud will become commonplace, just as virtual reality replaces the need to have new vehicles parked at dealership lots. And you’ll no longer have to imagine what you look like behind the wheel, you’ll be able to experience it – virtually. It’s also nice for those who have a need for speed, since speed limits won’t hold anyone back using this technology.

John Gaudiosi
Former Digital Trends Contributor
John Gaudiosi has been covering video games for over 25 years, dating back to his work for The Washington Post while in…
EV sales surge could continue as Trump delays ending federal rebates, report says
Second-Gen Rivian R1S on a road

A surge in sales of electric vehicles in the final months of last year could continue well into 2025, as consumers continue to take advantage of federal tax incentives while they last, according to a report by the Associated Press.
On the day of his inauguration, President Donald Trump signed an executive order titled “Unleashing American Energy”, which says the government is “considering the elimination of unfair subsidies and other ill-conceived government-imposed market distortions that favor EVs over other technologies.”
During his campaign, Trump’s team said it was planning to end the Biden administration’s $7,500 tax credit on the purchase or lease of an EV, although it did not provide a timeline for doing so.
Americans rushed to take advantage of the incentive, helping fuel a surge of more than 15% in EV sales in the fourth quarter, according to Cox Automotive.
Recent surveys show that incentives have played a major role in fueling EV sales over the past few years, and that a majority of Americans are in favor of government incentives to help with the purchase of an EV.
Meanwhile, the wording in Trump’s executive order, which says his administration is still 'considering' its options, leaves room for ambiguity about the timing of its application.
“Temporarily, sales of EVs could skyrocket as car-buyers rush to take advantage of existing tax credits,” the report by the Associated Press says.
In order to repeal the EV tax credit, the Trump administration will need to obtain the approval of congress. The process will likely take place as part of broader negotiations on extending Trump’s first-term tax cuts, which are due to expire near the end of 2025.
It’s also not entirely clear if the Trump administration will seek to end the whole of the $7,500 EV tax incentive. In order to obtain the incentive for the purchase of an EV, restrictions apply for high-income households and for EVs with non-U.S. made batteries. But those restrictions don’t apply to leasing an EV.
According to Cox Automotive, members of the Trump administration are particularly keen on ending “this leasing loophole, which was created partly to appease Korean and Japanese automakers, who have invested billions in U.S. EV manufacturing.”
Ending rebates and other subsidies for EVs is also likely to meet challenges, be they legal or political, from different actors.
The Zero Emission Transportation Association (ZETA), a trade group whose members include the likes of Tesla, Waymo, Rivian, and Uber, has come out in support of incentives for both the production and the sale of EVs.
ZETA says the incentives for both EV and battery-makers have led to enormous investments and job gains in Republican-dominated states like Ohio, Kentucky, Michigan, and Georgia.

Read more
Tesla Model Y Juniper vs Rivian R1S: Can Tesla’s newest take out a much more expensive vehicle?
Tesla Model Y 2025.

Tesla and Rivian actually have a lot in common. Both are relatively new companies in the grand scheme of things, at least compared to the legacy automakers that are now switching to EVs, but their actual vehicles are pretty different. The Tesla Model Y is the most popular electric vehicle in America, serving as a high-tech crossover for those interested in buying a Tesla. The Rivian R1S is Rivian's electric SUV, obviously boasting a larger body, but also putting tech first.

On top of the Tesla Model Y being the most popular EV right now, it's also in the midst of getting a major refresh in the form of the Model Y Juniper. We're still early on in the rollout of that refresh, though. While Tesla has released the Model Y Juniper in its base form in China, the version of the vehicle being sold in the US right now is the so-called Launch Edition New Model Y, which is a high-performance version of the Model Y Juniper that comes with a high price tag. For this comparison, we'll use the specs from the both the entry-level Model Y Juniper being sold in China, and the launch edition New Model Y being sold in the U.S. Keep in mind, however, that until the Model Y Juniper gets a wider U.S. release, only the previous-generation Model Y is being sold alongside the Launch Edition New Model Y

Read more
Tesla Model Y Juniper vs Kia EV9: Can the new Model Y beat a large SUV?
White Tesla Model Y Juniper at a Supercharger

America's most popular electric vehicle, the Tesla Model Y, is getting a major refresh. Tesla already launched the Tesla Model Y Juniper in China, but now it's bringing the vehicle to the US.

Of course, the new Model Y has to go up against a host of competitive electric vehicles, some of which are larger, some faster, and some even cheaper. The Kia EV9 has been hailed for being one of the few full-size electric SUVs that offers a high-quality driving experience without completely breaking the bank.

Read more