Skip to content
AIDIFFICULTY: ExpertSTATUS: Prototype

Harizeon Congent

Distributed AI Agent Coordination & Task Queue Sync

GitHub Repository
Client / ScopeAutonomous Systems Initiative
My RoleLead Systems Engineer
Duration4 Months
Completion Date2026-05-18

1. SYSTEM OVERVIEW

Executive Summary

A distributed system architecture and orchestrator that coordinates local AI agents across multiple devices with real-time state synchronization.

Business Problem

Running AI agents on single devices hits hardware walls, while cloud deployments create high running costs and compromise data privacy.

Business Impact Value

Enables teams to coordinate local consumer hardware to run complex AI workflows, reducing cloud costs and protecting data.

Key Engineering Goals
  • Synchronize agent state across multiple local systems with low latency
  • Distribute and queue tasks based on active node capacities
  • Deliver interactive dashboards to manage agent work queues
My System Responsibilities
  • Designed state tracking models to sync data across local nodes
  • Developed dispatch simulation widgets representing agent coordination
  • Configured secure messaging protocols to protect agent instructions

2. SYSTEM FEATURES

Task Dispatch DashboardComplexity: Medium

Interactive dashboard orchestrating task assignments and agent capacities.

Impl:React state engine managing active queue rates.
Agent State TrackingComplexity: Medium

Tracks status updates and resources across connected hardware nodes.

Impl:Dynamic object maps tracking connection statuses.
Secure Local MessagingComplexity: High

Protects communication between devices utilizing local encryption.

Impl:Private keys verifying connections.

3. SYSTEM ARCHITECTURE

Distributed orchestration system. Master hubs coordinate queues and assign workloads to local node devices using private local connections.

Topology Vector Diagram
User Task ──> Orchestration Master (Rust) ──> Task Queue Manager
                                                    │
       ┌────────────────────────────────────────────┘
       ▼
Local Node A (Tauri) <──[Encrypted RPC Stream]── Local Node B (Mobile App)
Pipeline flow sequences
User dispatches new task from dashboard interface
Master hub parses resource demands and checks active node list
Task queues and routes to the most suitable idle device node
Device node executes instructions and reports telemetry updates
State sync outputs complete status back to user panels
Repo directory structure
harizeon-congent/
├── src-tauri/                 # Rust core code
│   ├── src/
│   │   ├── main.rs            # Orchestrator entry
│   │   └── queue.rs           # Task queue logic
├── src/                       # Frontend application
│   ├── components/
│   │   └── Dispatcher.tsx     # Queue controller
│   └── App.tsx

4. INTERACTIVE SIMULATOR WIDGET

Run active operations audits utilizing the custom sandbox telemetry receiver widget below.

Dispatch tasks dynamically across synchronized hardware node networks.

Active Device Nodes
3 Nodes
Queue Pending Length
7 Jobs

5. ENGINEERING ARCHITECTURE DECISIONS (ADRs)

Decision ProfileSelect coordination model for distributed local node devices
Context

Devices connect and disconnect unpredictably on local networks, needing automatic sync.

Alternatives Checked
  • Centralized database polling
  • Distributed Hash Tables (DHT)
  • Raft-based master consensus
Selected Decision

Raft-based master consensus

Advantages
  • Guarantees absolute consistency on queue allocations
  • Automatic selection of new masters if active ones drop offline
  • Lightweight local execution footprint
Disadvantages
  • High network packet traffic under heavy node counts
  • Requires structured node membership lists
Trade-off details

Accepted high consensus network traffic to ensure total consistency and prevent duplicate task assignments.

Future Scaling direction

Integrate gossip protocols to manage node listings and lower consensus traffic overhead.

6. DETAILED TECHNOLOGY STACK

backend
• Rust (Orchestration Engine)• Tauri
frontend
• React Native• TypeScript
security
• Local private TLS certificates• Encryption
monitoring
• Node heartbeat signals

7. SECURITY REVIEW & POSTURE

Private TLS verification

Intruders on local networks could spoof nodes and steal agent instructions.

Mitigation StrategyPre-shared local root certificate authorities encrypting all node connections.

8. PERFORMANCE METRICS TELEMETRY

State Sync Latency<12ms

Optim:Using binary serialization patterns and lightweight local UDP connection streams.

9. ENGINEERING CHALLENGES & RESOLUTIONS

Vulnerability Bottleneck

Nodes frequently dropped offline mid-execution, causing tasks to get stuck in processing states indefinitely.

Root Cause:Platform lacked active heartbeat checks to monitor node health and handle task reassignments.

System Investigation

Monitored logs under high node churn, confirming that dead nodes remained assigned to active tasks.

Engineering Solution

Implemented heartbeat monitors. If a node fails to check in for 15 seconds, the master marks it offline and returns tasks to the queue.

Trade-offs accepted

Slightly increased local network traffic due to continuous check-in signals.

Lessons Derived

Distributed systems must assume failures are normal and implement active checks to verify node health.

10. SYSTEM LESSONS LEARNED

Engineering Lessons

Rust is excellent for building memory-safe and predictable orchestrator components.

Architecture Lessons

Event-driven queues are critical to prevent packet blockages when nodes disconnect.

Business Lessons

Utilizing local hardware resources reduces enterprise running costs and increases data privacy.

System Redesign Plans

I would convert the state sync to run over WebRTC to support browser nodes without local installation.

11. ROADMAP & TECHNICAL DEBT

  • Support browser nodes using WebRTC connections
  • Integrate local model execution configurations
  • Add predictive task scheduling algorithms

12. GITHUB SOURCE EXPLORER

Audit raw repository script configurations directly inside the active terminal workspace.

HarizuAru/Portfoliomain
Open on GitHub
Workspace Files
1
Encoding: UTF-8Lines: 1
Let's discuss your project

Interested in building a secure auto-scaling platform similar to this?

Keep exploring

Related Projects

All projects →
AI · WebDemo

ResumeAI Optimization Platform

An AI-powered resume optimizer analyzing professional summaries against target job descriptions, providing real-time ATS scores and impact-driven writing tips.

ArchitectureResume Text → Client Parser → ATS Score · API → LLM → Rewrite

  • llm
  • typescript
  • react
  • security
  • product-ux
NetworkingPrototype

OptiCore Core Router Simulator

A routing engine simulator analyzing OSPF vs EIGRP performance under varying traffic levels and Access Control List (ACL) constraints, complete with interactive configuration widgets and raw data export.

ArchitectureConfig Inputs → Interpolation Engine → Telemetry Panels

  • python
  • networking
  • simulation
  • telemetry
  • react
Networking · WebPrototype

OptiNet

A prototype mapping network telemetry streams to visualize delay, jitter, and packet drop trends.

ArchitectureTrigger → Telemetry Calculator → Dashboard

  • networking
  • telemetry
  • react
  • React
  • TypeScript