Zidio is an AI-powered emotion analysis system designed for real-time monitoring of employee well-being in workplace environments. It leverages facial expression and voice tone detection to infer emotional states, map them to workplace moods, and trigger alerts when stress is detected.
Zidio captures real-time facial expressions using your webcam and detects the corresponding emotion using DeepFace.
The Streamlit dashboard updates every few seconds to show:
- 🧍 Facial Emotion
- 🎙️ Speech Emotion
- 🧠 Final Mapped Mood
- 🚨 Alerts if stress is detected multiple times
A bar chart displays mood trends dynamically.
All detections are logged in real time with timestamps using a SQLite backend.
Zidio sends automated email alerts to HR when stress or burnout is detected repeatedly within a session.
Example:
"Zidio detected repeated stress indicators.
Final Mood: BURNED OUT
Please take appropriate HR action."
✅ Facial Emotion Detection
Detects emotions using DeepFace on live webcam frames every ~4 seconds.
✅ Speech Emotion Recognition
Uses Whisper + HuggingFace to analyze tone and transcribe speech every ~10 seconds.
✅ Workplace Mood Mapping
Emotions are mapped to states like Calm, Engaged, Stressed, Burned Out.
✅ Stress Alerts
Triggers alerts when "stressed" is detected in 3 out of the last 5 readings.
✅ Streamlit Dashboard
Real-time mood tracking UI with auto-refresh and filtering.
✅ Backend Logging
FastAPI logs all emotion events to a local SQLite database.
| Layer | Tools/Frameworks |
|---|---|
| Frontend | Streamlit |
| Backend | FastAPI |
| ML Models | DeepFace, Whisper, HuggingFace Transformers |
| DB | SQLite |
| Deployment | Docker |






