DataOps Consultant – Lakehouse Support

About the role

We are looking for a DataOps Consultant to provide production support for our lakehouse ecosystem. The role combines deep operational diagnostics, DevOps engineering, and AI‑first tooling to keep data pipelines and applications stable and continuously improving.

Key responsibilities

• Perform end‑to‑end diagnostics on batch and streaming data pipelines and coordinate resolution with platform engineers, Data Engineers and domain teams (Databricks, Snowflake, Palantir).
• Own L2/L3 incident management for .NET/C#, Python applications, APIs, event‑driven systems and data platforms, using ITSM tools such as ServiceNow.
• Maintain CI/CD pipelines in Azure DevOps, infrastructure as code (Terraform, Bicep, ARM) and container orchestration (Docker, Kubernetes/AKS).
• Implement observability with Dynatrace, Azure Monitor and OpenTelemetry, and manage data‑observability tools like Monte Carlo.
• Automate runbooks and triage using AI assistants (Copilot, Cursor) and AIOps for proactive issue detection.

Required profile

• Proven experience in production support and incident management (ITIL best practices) for cloud‑native applications and data platforms.
• Strong DevOps background with Azure services, CI/CD, IaC and container orchestration.
• Hands‑on knowledge of data pipeline technologies (PySpark, Spark, Databricks, Snowflake, Palantir).
• Ability to work remotely, collaborate with global engineering teams and communicate clearly during incidents.

Required skills

• .NET/C#, Python
• Azure DevOps, Terraform, Bicep, ARM templates
• Docker, Kubernetes (AKS)
• Azure services: App Services, Functions, Event Hubs, Storage, Key Vault, Azure SQL, Azure Monitor
• ServiceNow, ITIL incident/problem/change management
• Dynatrace, OpenTelemetry, Monte Carlo (or similar data observability)
• Databricks, Snowflake, Palantir Foundry
• StoneBranch or Airflow for workflow orchestration
• AI tooling: GitHub Copilot, Cursor