Sony Releases First Automotive Camera Sensor Handling RAW and YUV Images

Sony Semiconductor Solutions Unveils the ISX038 CMOS Image Sensor for Automotive Cameras

Atsugi, Japan — Sony Semiconductor Solutions Corporation (SSS) has announced a groundbreaking advancement in the field of automotive camera technology with the introduction of the ISX038 CMOS image sensor. This innovative sensor is the first of its kind in the industry that can simultaneously process and output both RAW and YUV images, thereby enhancing the functionality of automotive cameras in various applications.

Dual Image Processing Capabilities

The ISX038 CMOS image sensor boasts a proprietary Image Signal Processor (ISP) that enables it to handle and output RAW and YUV images at the same time. RAW images are crucial for external environment detection and recognition, particularly in advanced driver-assistance systems (ADAS) and autonomous driving (AD) technologies. On the other hand, YUV images are typically used for infotainment purposes such as drive recorders and augmented reality (AR) applications.

By integrating these dual capabilities into a single sensor, SSS aims to simplify automotive camera systems, effectively reducing the need for multiple cameras. This not only saves space within the vehicle but also cuts down on costs and power consumption.

Technical Specifications

The ISX038 sensor features a stacked structure, combining a pixel chip and a logic chip with a signal processing circuit. This design is complemented by SSS’s proprietary ISP on the logic chip, providing high-precision detection and recognition capabilities for the vehicle’s external environment. The sensor’s dimensions and specifications are particularly noteworthy:

• Model Name: ISX038
• Effective Pixels: Approximately 8.39 megapixels (3,857 x 2,177)
• Image Size: Diagonal 9.30 mm (1/1.72-type)
• Unit Cell Size: 2.1 μm x 2.1 μm
• Frame Rate: 30 frames per second (fps) for dual output of RAW and YUV images
• Sensitivity: 880 mV for green pixel (Standard value F5.6, 1/30 second cumulative)
• Dynamic Range: 106 dB with LED flicker mitigation; 130 dB with dynamic range priority
• Interface: MIPI CSI-2 serial output with options for single port with 4-lanes or dual port with 2-lanes per port
• Package Size: 11.85 mm x 8.60 mm
  

  Enhancing Automotive Camera Systems
  

  The rapid advancements in ADAS and AD technologies have led to increasing demands on automotive cameras. However, the limited space available for installing these cameras poses a challenge. The ISX038 addresses this issue by offering enhanced functionalities within a compact design. By providing both detection and infotainment capabilities, this sensor enables a single camera to perform tasks that previously required multiple devices.

  The integration of the ISX038 sensor with the EyeQ6 System-on-a-Chip (SoC) from Mobileye further supports its application in ADAS and AD technologies. This compatibility broadens the potential use cases for the ISX038, making it a versatile solution for modern automotive needs.

  Wide Dynamic Range and LED Flicker Mitigation
  

  A significant feature of the ISX038 is its ability to maintain a wide dynamic range even when using High Dynamic Range (HDR) and LED flicker mitigation simultaneously. This is particularly essential in automotive applications where cameras must accurately detect and recognize objects in varying light conditions, such as the transition from bright daylight to a shadowed tunnel entrance.

  The sensor employs a proprietary pixel structure and a unique exposure method that enhances saturation illuminance. This results in a dynamic range of 106 dB, which can extend to 130 dB in dynamic range priority mode. Such capabilities also help minimize motion artifacts, which are a common challenge when capturing moving subjects in HDR.

  Compatibility and Compliance
  

  The ISX038 sensor is designed to be compatible with SSS’s existing line of products, particularly those already in use for ADAS and AD applications. This compatibility allows automotive manufacturers to leverage previously collected data assets, such as driving data, thereby streamlining the development process for new systems.

  The sensor also complies with the AEC-Q100 Grade 2 automotive electronic component reliability tests, ensuring its durability and reliability in automotive applications. Moreover, the development process for the ISX038 aligns with the ISO 26262 road vehicle functional safety standard at the ASIL-B(D) level, enhancing its reliability in safety-critical automotive systems.

  Conclusion
  

  Sony Semiconductor Solutions Corporation’s introduction of the ISX038 CMOS image sensor marks a significant advancement in automotive camera technology. By offering simultaneous RAW and YUV image processing, the sensor provides a versatile, space-saving, and cost-effective solution for modern vehicles. Its wide dynamic range and LED flicker mitigation capabilities further enhance its utility in diverse lighting conditions, making it an ideal choice for automotive manufacturers seeking to integrate advanced driver-assistance and autonomous driving technologies. With its compatibility and compliance with industry standards, the ISX038 stands poised to play a pivotal role in the future of automotive imaging systems.

For more Information, Refer to this article.