Distributed ML infrastructure
NEXUS
Distributed ML inference orchestration platform.
Documented system flow
How NEXUS is structured
Select a node to inspect its role.
JWT-secured APIs
REST entry points protected with JWT authentication.
Interactive readme
Explore NEXUS
A concise, source-backed implementation record with the available project actions.
What is documented
- Architected a distributed inference system with JWT-secured REST APIs, token-bucket rate limiting, and consistent-hash routing across worker nodes.
- Built a Python ONNX Runtime worker pool with dynamic batching and heartbeat-based health tracking.
- Instrumented end-to-end metrics with Prometheus and shipped through GitHub Actions with a Helm-based Kubernetes deployment.
Technology used
JavaSpring BootgRPCRedisMySQLDockerHelmKubernetesPythonONNX RuntimePrometheus
Source: supplied Resume. This is a concise visualization of documented components, not a full internal deployment blueprint.