Senior Azure Platform & Data Engineer - United States

Help build a secure, observable Azure pipeline that captures GitHub Copilot CLI agent traces across developer machines, scrubs sensitive content centrally, and serves a sanitized, queryable dataset for review. You will own the implementation from endpoint capture through ingestion, privacy controls, storage, and a read-only trace viewer.

What You’ll Do

• Build the OpenTelemetry capture path, including endpoint configuration, OTLP export, and collector receivers, processors, and exporters.

• Implement central Azure ingestion and a privacy-scrubbing layer for secrets and personally identifiable information before data reaches reviewers.

• Wire sanitized storage and a read-only viewer with task-to-session-to-trace correlation.

• Build and operate services using Azure Container Apps or AKS, API Management, ADX/Kusto or Application Insights, ADLS Gen2 or Blob Storage, Key Vault, and Entra ID.

• Develop automation and supporting services in Python or Node.js, with Bash for operational workflows.

• Design role-based access, private networking, and auditable deployment practices.

Requirements

• A bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience.

• 5+ years of software, platform, or data engineering experience shipping production systems.

• 3+ years of Azure experience, or comparable major-cloud experience that transfers directly to Azure PaaS.

• 2+ years of observability or telemetry work with direct OpenTelemetry experience, including OTLP, collectors, spans and traces, and semantic conventions.

• Practical experience scrubbing PII and secrets through techniques such as detection, redaction, or tokenization.

• Strong Python or Node.js skills, plus Bash.

Nice to Have

• Grafana or other telemetry-backend setup, GenAI-agent observability, or cross-cloud identity federation.

Engagement Details

• Remote freelance role for candidates based in the United States.

• Expected duration of approximately three months.

• Minimum commitment of 20 hours per week, at least four hours per day, with four hours of overlap with Pacific Time.

• The selection process includes one 30-minute technical and culture interview after submission.

Compensation

$70 USD per hour.