Distributed Software Engineer

About The Role

Cerebras Systems is a pioneer in large-scale AI Supercomputers. These multi-exaflop supercomputers are deployed in some of the biggest datacenters. These supercomputers are built using our Wafer-Scale Cluster technology - a cluster of several Wafer Scale Engine (WSE) chips. The Cluster engineering team is responsible for delivering software that are all-things related to cluster.

Responsibilities

• Automate bare-metal configuration of networking, OS, and application software in large clusters of Cerebras WSE, servers, and switches.
• Additional push button workflows for cluster upgrades, downgrades, and security patching with key metrics to minimize downtime on clusters.
• An orchestration and scheduler system for resource allocation, job submission C placements for a multi-user environment on a cluster.
• Seamless support for both on-premise and cloud mode deployment and operations.
• A robust system for monitoring, detecting and handling failures for a variety of resources on the clusters (including High Availability of clusters).
• Broad cluster and job monitoring and visualization capabilities, along with alerting systems.
• User facing tools to monitor the status of jobs and collect metrics.
• Administrator facing tools to manage and operate large clusters.

Skills & Qualifications

• Strong track record of software architecture, system design and development.
• Strong track record of development in distributed cluster.
• Strong understanding of Kubernetes (K8s) software ecosystem, Prometheus and Grafana.
• Strong development skills in GoLang, Python, bash.
• Strong debugging skills with distributed systems.
• Strong skill to develop tests for the new features and regress old features.