GCP Data Engineer - VOIS at Vodafone Deutschland in Pune, Maharashtra, India

Job description

• We are seeking a GCP Data Engineer with expertise in Python, Google Cloud Platform and data engineering to design, develop and maintain scalable data solutions. You will build reliable ETL and ELT pipelines, create automated workflows, optimise data storage and processing, and help maintain the accuracy and integrity of large datasets.
• The role involves working closely with data scientists, analysts, business stakeholders, internal teams and external partners to translate data requirements into effective technical solutions. You will contribute to the timely delivery of projects while maintaining high standards of quality, performance and scalability. The role is based in Pune and is identified as a permanent position.

Responsibilities

• Design, develop and maintain ETL and ELT pipelines that ingest, transform and load large datasets from multiple sources into GCP data platforms.
• Develop data solutions using BigQuery, Cloud Storage, Cloud Composer, Dataflow, Pub/Sub and Cloud Functions.
• Optimise data pipelines to improve performance, reliability and scalability.
• Develop and manage data models, schemas and storage solutions aligned with GCP good practices.
• Build effective and scalable Python code and data-processing scripts.
• Automate data workflows and scheduled processes using appropriate orchestration tools.Implement data validation, cleansing and quality controls to maintain data accuracy and integrity.
• Monitor data pipelines, identify issues and support the timely delivery of data.Optimise BigQuery performance and manage storage and processing costs.
• Develop and maintain Kafka streaming integrations using the Python SDK.Build and integrate back-end components that improve application responsiveness and performance.
• Collaborate with data scientists, analysts and business stakeholders to define and deliver data requirements.
• Coordinate with internal teams and external partners to support effective project delivery.
• Apply a detail-focused and solution-oriented approach while considering wider business objectives.

Requirements

• You have strong practical experience with Python, including the development and deployment of data-processing scripts.
• You have hands-on expertise in Google Cloud Platform, particularly BigQuery, Cloud Storage, Cloud Functions, Cloud Composer and Pub/Sub.
• You have experience designing, developing and maintaining ETL or ELT data pipelines.You are proficient in SQL for querying, transforming and processing data.
• You understand data modelling, schemas, data storage and data quality principles.
• You are familiar with workflow orchestration tools such as Apache Airflow.
• You have knowledge of version control systems such as Git.
• You have experience with, or knowledge of, Kafka-based streaming solutions and Python SDK integrations.
• Familiarity with Teradata and PowerDesigner would be beneficial.
• You communicate clearly in writing and in conversation, including when working with clients and business stakeholders.
• You collaborate effectively across technical and non-technical teams.
• You can understand current and future business objectives and translate them into effective technology solutions.
• You demonstrate sound judgement, ownership and a collaborative approach to project delivery.

Skills

Required

• Python
• ETL/ELT pipelines
• SQL
• Data modelling
• Apache Airflow
• Git
• Kafka
• Python SDK

Preferred

• Teradata
• PowerDesigner

Benefits

• What’s in it for you
• The opportunity to work with modern GCP data services and cloud-native data architectures.
• Exposure to large-scale data engineering projects with a direct impact on business outcomes.
• Collaboration with data scientists, analysts, business stakeholders and external technology partners.
• Opportunities to solve complex data challenges and improve the performance, reliability and scalability of data platforms.
• Experience working across batch processing, workflow automation and real-time streaming solutions.
• The opportunity to contribute to data quality, platform efficiency and cost optimisation initiatives.