Senior Data Engineer at Take Two in Bangalore, Karnataka, India

Job description

• The challenge involves leading the design, architecture, and implementation of complex, highly scalable, and reliable end-to-end data systems. This role requires deep expertise in distributed computing and driving the adoption of best practices to ensure data infrastructure operates without manual intervention.

Responsibilities

• Lead the architectural design and implementation of stable, scalable data pipelines that cleanse, structure, and integrate disparate big data sets into an accessible format for end-user analyses and targeting using stream and batch processing architectures.
• Drive the improvement of the current data architecture, data quality, monitoring, and data availability, collaborating with labels to incorporate new data sources and ensure system reliability.
• Develop and lead the implementation of a comprehensive data quality framework to ensure the delivery of high-quality data and analyses to stakeholders.
• Overall responsibility for maintenance of enterprise wide data dictionary.
• Define, architect, and implement comprehensive monitoring and alerting policies for all mission-critical data solutions.

Requirements

• 5+ years of demonstrated experience with SQL
• Demonstrated experience with Python, particularly PySpark on Databricks
• Demonstrated experience with CI/CD systems
• Experience with large data sets and distributed computing. (Spark/Hive/Hadoop)
• Demonstrated expertise in Databricks for large-scale data processing, platform optimization, and pipeline orchestration.
• Ensure the effective integration of data storage, processing, and retrieval components.
• Design and implement fault-tolerant systems to ensure high availability and reliability of data services.
• Skilled in testing and monitoring data for anomalies, with a strong ability to troubleshoot and resolve issues.
• Significant experience working in a global environment, overseeing engineers, collaborating with cross-functional teams, and effectively reporting to managers in different time zones.
• Experienced in testing and monitoring data for anomalies and rectifying them.
• Knowledge of software coding practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations.
• Proven ability to lead projects, mentor junior team members, and drive best practices in coding standards, code reviews, and source management.
• Developing solutions in Databricks ecosystems
• Experience with CI/CD tools (e.g., Drone, Jenkins, Github Actions)
• Experience with CDPs or DMPs
• Experience with MCPs
• GDPR / CCPA compliance experience
• Familiarity with Marketing Technologies
• Experience working in an agile environment.
• Previous gaming industry experience

Skills

Required

• SQL
• Python
• PySpark
• Databricks
• CI/CD systems
• Spark
• Hive
• Hadoop
• Distributed computing
• Data pipeline architecture
• Data quality frameworks
• Monitoring and alerting

Preferred

• Databricks ecosystems
• CDPs
• DMPs
• MCPs
• GDPR / CCPA compliance
• Marketing Technologies
• Agile environment
• Gaming industry

Benefits

• Great Company Culture. We pride ourselves as being one of the most creative and innovative places to work, creativity, innovation, efficiency, diversity and philanthropy are among the core tenets of our organization and are integral drivers of our continued success.
• Growth: As a global entertainment company, we pride ourselves on creating environments where employees are encouraged to be themselves, inquisitive, collaborative and to grow within and around the company.
• Work Hard, Enjoy Life. Our employees’ bond, blow-off steam, and flex some creative muscles – through corporate boot camp classes, company parties, our Office gaming spaces, game release events, monthly socials, and team challenges.
• Benefits. Benefits include, but are not limited to; Discretionary bonus, Provident fund contributions, 1+5 medical insurance + top up options and access to Practo online Doctor consultation App, Employee assistance program, 3X CTC Life Assurance, 3X CTC Personal accident insurance, childcare services, 20 days holiday + statutory holidays,
• Perks. Gym reimbursement up to INR1150 per month, wellbeing program with the chance to earn up to $93 per annum, charitable giving program, access to learning platforms, employee discount program’s plus free games and events!