News

DMP puts AI and imaging to work to build safer vehicles

Your mirror really is smarter with new camera and display system powered by DMP

Jon Peddie

 

In 2017, there were 511,455 crashes in the US involving a large truck or a bus. Of those, 4,455 were crashes with fatalities. In the EU, trucks account for about 2% of the vehicles on the road but represent 15% of fatalities. Many of these crashes can be attributed to limited visibility from the cockpit, including multiple blind spots. DMP is working with partners to build smart mirrors that can reduce the rate of such accidents and fatalities due to those blind spots.

DMP and its partners have built a system based on six cameras: two on each side of the vehicle one in the front and one in the back they're connected to multiple displays giving the driver a 360-degree view of their surrounding, and thanks to the combination of AI with machine vision as well as dynamic augmented reality rendering the system can provide real-time warnings to the driver about potential hazards. The integrated AI can detect cars, bikes, pedestrians, traffic lights, crossings, etc., alerts the driver to dangers. We're told, DMP's software also detects near-miss accidents based on training with accident scene data.

The company has been working with Tier 1 automotive partners using their data to train the software. A hardware partner has built the platform and it is being tested in by a Japanese truck OEM.  DMP has also announced a partnership with Finnish company Basemark in a development deal to integrate the Rocksolid graphics engine for UI and compute. 

 

 

 

DMP ZIATM DMP’sV720 AI Processor IP Core

 

The system uses DMP's  DV720 integrated with the ZIA Classifier and software. The DV720 offers a small footprint, high performance, and FP16 high accuracy. It runs at 1 GHz based on a 12 nm process. That provides 1152 GFLOPS@1GHz (576MAC). At 100MHz–420Mhz@Ultrascale+ MPSoC. It can run Floating Point 16, and Int8 direct input. Performance is enhanced by using high bandwidth on-chip RAM.

 

DMP ZIATM Classifier Driving Analysis AI Stack

 

Another benefit of replacing traditional mirrors with a smart mirror system actual mirrors no longer need to be placed outside of the cockpit. This system is using high-end Sony sensors and LCDs that can be placed inside the vehicle, thus enabling a more aerodynamic solution that leads to reduced drag and thereby lower fuel or energy consumption.