Azure data Engineer at Diverse Lynx in bengaluru, Mumbai
- Company: Diverse Lynx
- Location: bengaluru, Mumbai
- Posted: Sep 23, 2026
- Type: Full-time
- Experience: 10+ years
Overview
[!--StartFragment--] Responsibilities: Design, build, and optimize scalable batch and real-time data pipelines on Azure. Develop ETL/ELT workflows using Databricks and Azure Data Factory. Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.
Job description
- [!--StartFragment--]
Responsibilities
- Responsibilities: Design, build, and optimize scalable batch and real-time data pipelines on Azure.
- Develop ETL/ELT workflows using Databricks and Azure Data Factory.
- Implement Lakehouse architectures using Delta Lake and Medallion (Bronze-Silver-Gold) layers.
- Integrate data from multiple enterprise and external sources.
- Ensure data quality, performance, security, and governance standards.
- Collaborate with business and technical stakeholders to deliver analytics solutions and dashboards.
Requirements
- We are looking for a Data Engineer with 8–10 years of experience, including 4+ years of hands-on expertise in Azure Databricks and Azure data services.
- Key Skills: Azure Databricks, PySpark/Scala, Spark SQL, Delta Lake
- Azure Data Factory (ADF), ADLS Gen2
- Azure SQL/Synapse, Event Hubs/Kafka
- Power BI, SQL Optimization
- CI/CD (Azure DevOps/GitLab), Git
- Unity Catalog, Data Governance & Security
Skills
Required
- Azure Databricks
- PySpark/Scala
- Spark SQL
- Delta Lake
- Azure Data Factory (ADF)
- ADLS Gen2
- Azure SQL/Synapse
- Event Hubs/Kafka
- Power BI
- SQL Optimization
- CI/CD (Azure DevOps/GitLab)
- Git