Data Engineer II at Nielsen in Bengaluru, , India

Job description

• You will have the opportunity to join a team focused on research and development surrounding Nielsen hardware, software, and business rules that support delivery of high quality products to our clients. You will learn and become an expert in Nielsen’s Panel data, helping to develop and maintain robust and reliable panel maintenance processes

Responsibilities

• •Build and maintain data pipelines to support scalable analytics and real-time processing, ensuring seamless integration with downstream analytics and production systems.
• • Collaborate with cross-functional teams to integrate new functionalities into existing data pipelines, including lower test environments to help validate and assess impact prior to Production integration, where applicable.
• • Implement data governance and quality processes to ensure the integrity and accuracy of data throughout its lifecycle.
• • Monitor data systems and processes to identify issues and proactively implement improvements to prevent future problems.
• • Participate in code reviews with senior developers prior to pushing the code into production to ensure meeting accuracy and best practice standards.
• • Perform various testing to proactively identify and fix any bugs.
• • Optimize code to meet product SLAs
• • Analyze and recommend possible solutions to problems at hand

Requirements

• •Excellent problem solving skills and attention to detail
• •Intellectually curious; Solves problems by analyzing possible solutions using experience, judgment and precedents.
• •Able to communicate effectively both orally and in writing
• •Comfortable sharing recommendations and receiving feedback
• •Solid understanding of system design, data structures and performance optimization techniques
• •Bachelor’s Degree in Computer Science, Data Engineering, Data Science or related field; relevant certifications or advanced coursework preferred.
• Coding in Python and SQL in both prod and non-prod settings
• Working within cloud-based infrastructures and tools such as AWS, EC2, GitLab, and Airflow
• Working within the Software Development Life Cycle framework and applying software development best practices
• Building monitoring checks and tools to ensure infrastructure and related processes are working as expected

Skills

Required

• Coding in Python and SQL
• Building monitoring checks and tools