Skip to main content
TruGen Vision Understanding powered by Hawkeye-2 is a real-time video analysis system designed for live monitoring and proctoring. It connects to a live video stream and continuously analyses participant behaviour using AI. The platform can:
  • Detect emotions
  • Track where a person is looking
  • Monitor head movement and attention
  • Count the number of people visible on screen
  • Detect deepfake video feeds
  • Detect whether lip movement is in sync with the audio and video of the user on the call
It’s especially useful for:
  • Online exam proctoring
  • Interview monitoring
  • Compliance and security checks
  • Attention and engagement tracking

​
How It Works

The system connects to a live video session, processes video frames in real time, and sends results instantly to dashboards, apps, or external systems. It can also trigger alerts or actions automatically when certain conditions are detected, such as:
  • A participant repeatedly looking away
  • Multiple people appearing on screen
  • Signs of stress or distraction

​
Key Features

Emotion Detection

Identifies emotional states in real time — Happy, Neutral, Sad, Angry, Fearful, and Surprised.

Head Pose Tracking

Detects whether the person is looking left, right, up, down, or straight ahead.

Eye Gaze Tracking

Tracks eye movement to understand attention and focus across all directions.

Face Count Detection

Detects how many people are visible in the frame at any given moment.

Deepfake Detection

Monitors the video stream to detect and flag deepfaked or lip-synced video.

Lip Sync Detection

Verifies that the participant’s lip movement matches the audio in the session.

​
Real-Time Alerts & Automation

The system supports custom triggers and automated actions. For example:
  • If someone looks away more than 5 times, automatically:
    • Send an alert
    • Trigger a webhook
    • Notify a moderator or proctor

​
Built for Scale

Vision Understanding is optimised for real-time performance and can run multiple AI analysis modules simultaneously with low latency. Each instance runs in its own infrastructure component, ensuring no impact on conversational quality or performance.

​
Common Use Cases

​
What’s Next?

Foundation Models

Learn about Hawkeye-2 and Huma-3, the models powering TruGen agents.

External Meetings

Join and monitor external meetings with Vision Understanding enabled.