Driver State Sensor - Research

The Seeing Machines DSS-R or Driver State Sensor for Research, is a robust, automatic sensor platform that produces data for operator fatigue and operator distraction research. The DSS-R delivers rich data with minimal effort and is suitable for both large and small scale studies.

Driver State Sensor - Capabilities

Built on Seeing Machines’ faceLAB® technology, the DSS-R is a cost-effective sensor platform designed specifically for driver behavior research. It is the first system to enable real-time naturalistic driver monitoring for both small and large scale studies. Its rugged design and fully automatic operation makes the DSS-R ideally suited for permanent, unsupervised installations, making constant subject interruptions a thing of the past. The DSS-R lets you observe driver behavior in a truly naturalistic setting: the subject’s own vehicle.

The DSS-R uses cutting edge video processing technology to unobtrusively measure 3D head pose and eyelid motion parameters of the driver, delivering critical information on both fatigue and distraction. For fatigue, the DSS-R produces raw eye closure data and generates two metrics: micro-sleep event detection and PERCLOS. Driver distraction is monitored through the observation of driver head movement, and the DSS-R can determine whether attention is targeted on or off road. Optionally, customizable alerts can be generated when either fatigue or distraction is detected.

DSS-R in Research

The DSS-R is designed to facilitate straightforward multi-vehicle driver behavior and fatigue research, and produces real-time measurements of:

• 3D Head pose: X,Y,Z location and head pitch, yaw and roll
• Eyelid closure for each eye, with optional video recording of the eyes during fatigue events for post study evaluation
• GPS location and vehicle speed
• Fatigue and Distraction events

The DSS-R’s automatic operation allows easy deployment in production vehicles that allow only sporadic data retrieval. Data can be logged either to portable hard drive, memory stick, or the network. The data output is also compatible with mobile telemetry data systems for true remote logging.

The DSS-R is a valuable data gathering tool for research into a wide range of subject areas. The zero-calibration nature of the system makes it perfect for:

Large sample-size fatigue and vigilance research:

• Prototype new fatigue detection techniques
• Investigate effects of driver scheduling
• Assess fatigue aware HMI’s and warning systems

Detection of driver attention and distraction:

• Easily conduct large-scale vehicle ergonomics or road design assessments
• Modulate warnings and IVIS feedback based on driver awareness and workload. These can include lane departure warning systems, forward and side collision warning systems, pedestrian detection systems and other alerts from navigation and communication devices
• Prototype new convenience functions such as automatic mirror and seat adjustment and face recognition for automatic personalization of vehicle settings

Detection of fatigue events.

Distinct traces (green) during distraction outside road center cluster (red)

Today, many of these studies require extensive and laborious manual video data annotation. With the DSS-R, this cost is significantly reduced, freeing up resources for more productive analysis.

DSS-R: Data collection made easy

Fully automatic operation means the DSS-R can handle all normal driving conditions – no intervention required. Once installed in a vehicle, the DSS-R starts up and shuts down automatically with engine ignition and does not require any special procedure for powering off the vehicle. Data collection commences automatically, without the driver needing to interact with the system. There are no computer interface components like a screen, mouse or keyboard, so the driver can concentrate on the driving task.

Sophisticated internal signal processing optimises all face tracking parameters in real-time to ensure highest possible data quality and tracking performance, and all tracking data comes complete with confidence metrics. The DSS-R employs entirely new, patented computer vision techniques that deliver groundbreaking improvements in performance, tracking head rotations of +/- 90° from a single camera. Computer controlled Infra Red illumination provides evenly lit conditions for automatic transition from day to night-time driving.

The DSS-R operates seamlessly with eye glasses and IR transparent sunglasses. The face tracking in the DSS-R automatically detects if the subject wears or removes glasses mid-drive, and likewise requires no intervention even when changing drivers.

Data visualisation is provided via Seeing Machines free WorldView software, allowing real-time sampling of DSS-R units via the network, or full playback of data from log files. Native Matlab importing of log files is also supported for post analysis.

The DSS-R is also fully remote-accessible via network, allowing rapid initial setup using a laptop. The military-spec hardware platform handles the extreme temperature ranges that typically occur in vehicles and will withstand shock of up to 50G.