Design Emotion Detection - System Design | WinJob

Multimodal affect analytics at automotive and CX scale

Affectiva-class platform ingests camera and microphone streams, returns calibrated valence-arousal-dominance vectors with consent-aware retention for fleet and media tenants.

Numbers to state early

Metric A: 18M sessions/day
Metric B: p95 120ms edge
Metric C: 99.9% uptime

Mechanism

The hot path Fleet SDK → Consent Gate → Affect API must honor biometric consent and calibrated dimensional affect—not single-label emoji classes. Open with Ekman-plus-dimensional model—not a single happy/sad label. Cite biometric sensitivity and opt-in capture before drawing GPUs.

Failure and edge cases

Revoked consent mid-stream must halt inference within 30s and purge in-flight buffers.
Face occlusion with loud vocal stress should not collapse to neutral via naive averaging.
OTA model mismatch across vehicle platforms requires digest pin and crash-rate rollback.
Cross-tenant query attempts must hard-fail at connection pool boundary.

When discussing Multimodal affect analytics at automotive and CX scale, anchor on Affectiva/Beyond Verbal/Amazon-style multimodal affect for automotive cabins, call centers, and media analytics—not generic sentiment APIs.

Java

javaOne Dark Pro

1 public final class AffectSnapshot1 {
2   public enum Quality { HIGH, DEGRADED, VOCAL_ONLY }
3   private final String windowId;
4   private final double valence;
5   private final double arousal;
6   private final Quality quality;
7  
8   public boolean shouldAbstain(double entropyLimit) {
9     return quality == Quality.DEGRADED && arousal > entropyLimit;
10   }
11 }

Python

pythonOne Dark Pro

1 from dataclasses import dataclass
2 from enum import Enum
3  
4 class Quality(str, Enum):
5     HIGH = "high"
6     DEGRADED = "degraded"
7     VOCAL_ONLY = "vocal_only"
8  
9 @dataclass(frozen=True)
10 class AffectSnapshot1:
11     window_id: str
12     valence: float
13     arousal: float
14     quality: Quality
15  
16     def should_abstain(self, entropy_limit: float) -> bool:
17         return self.quality == Quality.DEGRADED and self.arousal > entropy_limit

TypeScript

typescriptOne Dark Pro

1 export type AffectQuality = "high" | "degraded" | "vocal_only";
2 export interface AffectSnapshot1 {
3   windowId: string;
4   valence: number;
5   arousal: number;
6   quality: AffectQuality;
7 }
8 export function shouldAbstain(s: AffectSnapshot1, limit: number): boolean {
9   return s.quality === "degraded" && s.arousal > limit;
10 }

Why interviewers care

Emotion Detection interviews reward crisp scope, explicit trade-offs, and failure stories—not generic microservice diagrams.

Interview checkpoint

Name one failure story for Multimodal affect analytics at automotive and CX scale that proves you understand real outages, not happy-path diagrams.

Key Highlights

•18M sessions/day
•Fleet SDK → Consent Gate → Affect API
•Affectiva-class platform ingests camera and microphone streams, returns calibrat

1	public final class AffectSnapshot1 {
2	public enum Quality { HIGH, DEGRADED, VOCAL_ONLY }
3	private final String windowId;
4	private final double valence;
5	private final double arousal;
6	private final Quality quality;
7
8	public boolean shouldAbstain(double entropyLimit) {
9	return quality == Quality.DEGRADED && arousal > entropyLimit;
10	}
11	}

1	from dataclasses import dataclass
2	from enum import Enum
3
4	class Quality(str, Enum):
5	HIGH = "high"
6	DEGRADED = "degraded"
7	VOCAL_ONLY = "vocal_only"
8
9	@dataclass(frozen=True)
10	class AffectSnapshot1:
11	window_id: str
12	valence: float
13	arousal: float
14	quality: Quality
15
16	def should_abstain(self, entropy_limit: float) -> bool:
17	return self.quality == Quality.DEGRADED and self.arousal > entropy_limit

1	export type AffectQuality = "high" \| "degraded" \| "vocal_only";
2	export interface AffectSnapshot1 {
3	windowId: string;
4	valence: number;
5	arousal: number;
6	quality: AffectQuality;
7	}
8	export function shouldAbstain(s: AffectSnapshot1, limit: number): boolean {
9	return s.quality === "degraded" && s.arousal > limit;
10	}