Bio-Sync Operator OS: Real-Time Biometric Swarm Governance with Presage SmartSpectra rPPG

This is a submission for the Presage SmartSpectra SDK Challenge.

⚠️ NON-MEDICAL INFORMATIONAL DISCLAIMER:

Bio-Sync Operator OS and the Presage SmartSpectra SDK integration are experimental research and developer engineering tools designed solely for neuro-ergonomic human-computer interface resonance and autonomous multi-agent throttle governance. THEY DO NOT DIAGNOSE, TREAT, CURE, MONITOR, OR PREVENT ANY DISEASE OR MEDICAL CONDITION. They are not medical devices and must never be used for clinical decision-making.

What I Built

As autonomous AI multi-agent swarms (like Benni OS, Project Benjamin, and Nemesis Gateway) execute hundreds of high-velocity operations per second—ranging from database migrations and GitHub pull request merges to automated financial settlements—the human-in-the-loop operator experiences severe cognitive overload, vigilance fatigue, and acute autonomic stress spikes.

Traditional developer dashboards are completely blind to human physiological strain. When an operator is panicking or experiencing severe autonomic fatigue, they are far more likely to make catastrophic release errors, click accidental approvals, or trigger untested infrastructure teardowns.

Bio-Sync Operator OS bridges human physiology directly to the autonomous multi-agent swarm:

1. Contactless Optical rPPG Sensing via Presage SmartSpectra SDK: Measures real-time pulse rate (BPM), Heart Rate Variability (HRV RMSSD), respiration rate (BRPM), and optical Blood Volume Pulse (BVP) waveforms directly through a standard laptop webcam without any wearables, smartwatches, or electrodes.
2. 120 FPS Resonant Kinetic Canvas (Benni-Canvas Engine): Couples the interface's physics to the operator's cardiac and respiratory phases using 2nd-order harmonic spring ODEs, providing subconscious neuro-ergonomic visual stabilization.
3. Autonomous Swarm Governor: Calculates an observable Operator Stress Index (OSI) that dynamically paces high-risk agent actions, enforces cooling leases, and triggers an emergency circuit-breaker on critical infrastructure actions when operator strain exceeds safety boundaries.

Demo

• 🌐 Live Interactive 120 FPS Web App: https://benni-os.net/bio-sync/
• 💻 Open-Source GitHub Repository: https://github.com/BenniAlencar/bio-sync-operator-os

Architecture & Data Flow

flowchart TD
    subgraph Sensing ["1. Contactless Sensing Layer (Presage SmartSpectra SDK)"]
        Cam["Standard Webcam / Video Stream"] --> ROI["Facial ROI Hemoglobin Reflectance"]
        ROI --> rPPG["Optical rPPG Extraction Engine"]
        rPPG --> Privacy["PrivacyGuard: Zero-Cloud RAM Isolation"]
    end

    subgraph Signals ["2. Physiological Telemetry Extraction"]
        Privacy --> Pulse["Cardiac Pulse (BPM) & BVP Waveform"]
        Privacy --> Resp["Respiration Rate (BRPM) & Phase"]
        Privacy --> HRV["Heart Rate Variability (RMSSD / SDNN)"]
    end

    subgraph Resonance ["3. 120 FPS Kinetic Resonator (Benni-Canvas)"]
        Resp --> Spring["2nd-Order Spring ODE: omega_n = 2*pi*(BR/60)"]
        HRV --> Damping["Adaptive Damping: zeta(HRV)"]
        Pulse --> Bokeh["Optical Bokeh CoC & Spectral Luminescence"]
        Spring --> Canvas120["120 FPS Resonant Living Canvas"]
    end

    subgraph Governance ["4. Autonomous Swarm Governor (Project Benjamin & Nemesis)"]
        Pulse & Resp & HRV --> OSI["Operator Stress Index (OSI) Fusion"]
        OSI --> Tier{"Autonomic Tier Evaluation"}
        Tier -->|OPTIMAL: OSI < 0.30| Pass["Unrestricted Swarm Dispatch"]
        Tier -->|ELEVATED: 0.30 - 0.60| Pace["Micro-Throttle High-Risk Agents (1s)"]
        Tier -->|STRAINED: 0.60 - 0.80| Lease["Dynamic Cooling Lease (5s - 15s)"]
        Tier -->|CRITICAL: OSI >= 0.80| Breaker["Emergency Circuit-Breaker: Freeze Destructive Ops"]
    end

    Canvas120 --> Operator["Human Operator (Subconscious Neuro-Feedback)"]
    Breaker --> Swarm["Autonomous Multi-Agent Swarm (Nemesis Gateway 97 Connectors)"]

Real-Time Terminal Telemetry HUD

========================================================================
   BIO-SYNC OPERATOR OS :: REAL-TIME TELEMETRY ENGINE
   Powered by Presage SmartSpectra SDK & Benni-Canvas Resonator
========================================================================
[SECURITY GATE] Consent Granted. Zero-Cloud Local Pipeline Activated.

[OPTIMAL ] HR:  72.0 bpm | BR: 14.0 brpm | HRV: 48.0 ms | BVP: [------------O-------] | OSI: 0.12 | Bokeh: 16.0px | GOV: [APPROVED]
[ELEVATED] HR:  88.0 bpm | BR: 18.0 brpm | HRV: 32.0 ms | BVP: [----------------O---] | OSI: 0.48 | Bokeh: 18.2px | GOV: [PACED (1s)]
[CRITICAL] HR: 118.0 bpm | BR: 26.0 brpm | HRV: 16.0 ms | BVP: [---O----------------] | OSI: 0.84 | Bokeh: 20.0px | GOV: [CIRCUIT BREAKER 30s]

Code

The complete source code is licensed under Apache 2.0 and publicly available on GitHub:

⭐ Repository: https://github.com/BenniAlencar/bio-sync-operator-os

Setup & Local Installation

# 1. Clone repository
git clone https://github.com/BenniAlencar/bio-sync-operator-os.git
cd bio-sync-operator-os

# 2. Install package locally
pip install -e .

# 3. Run unit test suite (10/10 verified passing)
pytest tests/ -v

# 4. Launch interactive terminal HUD
bio-sync demo --duration 15

# 5. Launch 120 FPS Web Experience
python -m http.server 8080 -d web
# Navigate to http://localhost:8080

How It Responds to Human Signals

Bio-Sync Operator OS couples contactless human signals captured by the Presage SmartSpectra SDK across two synchronized response domains:

1. The 120 FPS Resonant Kinetic Canvas (Benni-Canvas Engine)

Rather than treating the user interface as a static array of rectangular div boxes, the Benni-Canvas integrates motion physics directly with the operator's biological rhythm using a continuous 2nd-order harmonic spring ODE:

$$\ddot{x}(t) + 2\zeta\omega_n \dot{x}(t) + \omega_n^2 x(t) = \omega_n^2 F_{bio}(t)$$

• Breathing Lock ($\omega_n$): The spring's natural frequency is locked to real-time respiration ($ ext{BRPM}$): $$\omega_n = 2\pi \cdot \frac{\text{BRPM}}{60} \quad [\text{rad/s}]$$
• Vagal Tone Damping ($\zeta$): The damping ratio adapts continuously to Heart Rate Variability (RMSSD): $$\zeta = 1.4 - 0.693 \cdot \text{clamp}\left(\frac{\text{RMSSD} - 15}{65}, 0, 1\right)$$ When relaxed (high vagal tone), $\zeta \approx 0.707$ (silky critical damping). Under stress (low HRV), $\zeta \ge 1.2$ (overdamped, grounding the UI to reduce cognitive visual agitation).
• Subconscious Optical Bokeh ($c_{CoC}$): Expands depth-of-field blur on inhalation and tightens on exhalation, inducing calm parasympathetic entrainment.

2. Autonomous Swarm Governor (Project Benjamin & Nemesis Gateway)

The governor calculates an observable Operator Stress Index (OSI) in range $[0.0, 1.0]$:

$$\text{OSI} = w_1 \cdot \text{clamp}\left(\frac{\text{HR} - \text{HR}{base}}{40}, 0, 1\right) + w_2 \cdot \left(1 - \text{clamp}\left(\frac{\text{RMSSD} - 15}{\text{RMSSD}{norm} - 15}, 0, 1\right)\right) + w_3 \cdot \text{clamp}\left(\frac{\text{BR} - \text{BR}_{base}}{12}, 0, 1\right)$$

Consent and Data Handling

Judges and privacy auditors can inspect our zero-cloud compliance guarantees directly in src/bio_sync/privacy_guard.py:

1. Explicit Informed 3-Way Consent: No camera optical stream is initialized until the operator explicitly confirms:
   • Camera access consent for optical rPPG vital signs extraction.
   • Zero-cloud local processing acknowledgment.
   • Non-medical research disclaimer acceptance.
2. Zero-Cloud In-Memory Invariant: Video frames and optical buffers are confined strictly to transient local device RAM. No video frames, facial photographs, or raw camera buffers are ever stored on persistent disk or transmitted to any remote cloud API.
3. Instant Deterministic Kill-Switch: Revoking consent immediately terminates the media stream, zeroes out all telemetry buffers, and logs an immutable cryptographic audit record with session nonces.
4. Non-Medical Boundary: Bio-Sync Operator OS explicitly rejects any clinical diagnostic claims.

Prize Categories

We are entering Bio-Sync Operator OS in the following categories:

1. 🏆 Best Overall Human-Sensing Experience: Seamlessly connects contactless webcam rPPG into a breathtaking 120 FPS living canvas coupled to the human nervous system.
2. 🛡️ Best Thoughtful Real-World Use: Solves the critical real-world problem of developer cognitive burnout and catastrophic mistake prevention during autonomous multi-agent swarm operations, with rigorous zero-cloud privacy architecture.
3. ✨ Most Creative or Delightful Use: Replaces boring static metric numbers with an organic, breathing interface where optical bokeh, spring ODE physics, and bioluminescence ebb and flow with human respiration.

Authored by Benni Alencar (@bennialencar) • Ecosystem Architect at Benni OS.