Software Engineer

About the role

We are looking for a Senior Software Engineer to join our growing engineering team. In this role, you will design and build distributed backend systems, lead critical API design decisions, and drive the deployment and operationalization of machine learning models in production. You will work at the intersection of platform infrastructure and application development, making a direct impact on product quality and engineering standards.

What you will do

• Design, build, and maintain scalable backend services and APIs using Go.
• Deploy, manage, and monitor LLM and ML model workloads in production environments.
• Develop and operate Kubernetes-based infrastructure, writing controllers, operators, and Helm charts as needed.
• Collaborate with product and platform teams to define API contracts and integration patterns.
• Lead technical discussions, conduct code reviews, and mentor junior engineers.
• Identify and resolve performance bottlenecks across services and infrastructure layers.

What we are looking for

• 5+ years of professional software engineering experience in backend or infrastructure roles.
• Strong proficiency in Go — idiomatic code, concurrency patterns, error handling, and testing.
• Solid understanding of Kubernetes — workloads, scheduling, networking, and cluster operations.
• Hands-on experience deploying and serving LLM or ML models (e.g. vLLM, TorchServe, Triton, or similar).
• Proven track record designing and implementing RESTful APIs — including versioning, error contracts, and authentication.
• Comfortable working across the stack: cloud-native services, distributed systems.

Nice to have

• Experience with workflow orchestration systems such as Temporal or Argo Workflows.
• Familiarity with GPU infrastructure, NVIDIA operator, or ML acceleration technologies.
• Exposure to GitOps practices and tools like ArgoCD or Flux.
• Contributions to open-source projects in the cloud-native or ML ecosystem.

Compensation & Benefits

For India-based candidates, we offer a competitive base salary along with equity options, providing an opportunity to share in the success and growth of Armada.