Azure data Engineer (Pyspark, Databricks, Delta lake) at Diverse Lynx in bengaluru, Karnataka
- Company: Diverse Lynx
- Location: bengaluru, Karnataka
- Posted: Sep 24, 2026
- Type: Full-time
- Experience: 12+ years
Overview
Job Description 8–10 years of experience, with 4+ years of hands-on experience in Apache Airflow, Python, and AKS (Azure Kubernetes Service). • Strong experience in Apache Airflow for DAG development, workflow orchestration, scheduling, and optimization.
Job description
- Job Description
Requirements
- 8–10 years of experience, with 4+ years of hands-on experience in Apache Airflow, Python, and AKS (Azure Kubernetes Service).
- • Strong experience in Apache Airflow for DAG development, workflow orchestration, scheduling, and optimization.
- • Hands-on expertise in Python development for automation and data engineering solutions.
- • Experience with Azure Cloud Services and cloud-native data platforms.
- • Strong knowledge of AKS/Kubernetes, containerization, deployment, and platform operations.
- • Experience with CI/CD pipelines, DevOps practices, and distributed systems.
- • Strong troubleshooting and problem-solving skills in enterprise production environments.
- 4+
- Python developer,Airflow,AKS
- • Exposure to Data Platform Engineering and Data Mesh concepts.
- • Familiarity with Azure data services and monitoring tools.
- • Experience with Docker, Infrastructure as Code, and automation frameworks.
- • Experience working in global, cross-functional teams.
- • Azure or Kubernetes certifications are a plus.
- Python developer,Airflow,AKS
Skills
Required
- Apache Airflow
- Python
- AKS (Azure Kubernetes Service)
- Azure Cloud Services
- Kubernetes
- Containerization
- CI/CD pipelines
- DevOps practices
- Distributed systems
- Troubleshooting
- Problem-solving
Preferred
- Data Platform Engineering
- Data Mesh concepts
- Azure data services
- Monitoring tools
- Docker
- Infrastructure as Code
- Automation frameworks
- Global cross-functional team experience