Senior Data Engineer at Quantum Metric in London

Job description

• Application
• Our Company
• Our Technology team is growing and we'd love you to grow with us. We're looking for a skilled and experienced Senior Data Engineer to help design and build a robust, scalable, and high-performance real-time data backbone.
• In this role, you'll take a leading hand in the design, development, and implementation of a real-time data backbone. Your focus will be on building and maintaining scalable, high-performance data pipelines that support real-time data processing and analytics. You'll work closely with teams across the business to ensure our infrastructure meets growing data needs, leveraging modern technologies for efficient data ingestion, storage, and analysis.

Responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure that power real-time analytics and reporting.
• Take ownership of our semantic layer using Cube.js, enabling reliable, self-serve analytics across the organisation.
• Integrate and unify data from Salesforce, CDP, and SCV sources, ensuring clean, consistent data flow across marketing and customer data platforms.
• Lead the development of transformation workflows using dbt, with a strong emphasis on testing, documentation, and data quality.
• Architect and manage pipeline orchestration via Apache Airflow, ensuring reliability and observability at every stage.
• Monitor and optimise pipeline performance for low-latency, high-throughput use cases.
• Collaborate closely with Data Architect, marketing analysts, and business stakeholders to ensure data infrastructure directly supports business objectives.
• Mentor and support more junior engineers, helping to raise the bar across the team.

Requirements

• Significant hands-on experience in data engineering, with a proven track record of leading and delivering complex data initiatives end to end.
• Great understanding of semantic layers such as Cube.js you've built and maintained semantic layers and understand pre-aggregations, caching strategies, and multi-tenancy.
• Strong experience integrating Salesforce Marketing Cloud, CDP, and Single Customer View (SCV) data you understand the nuances of customer and marketing data at scale.
• Expert-level SQL and proven experience building robust transformation pipelines with dbt.
• Solid experience orchestrating workflows with Apache Airflow in production environments.
• Comfortable working across cloud platforms (AWS, GCP, or Azure) for data ingestion, storage, and processing.
• Proficiency in Python or a similar language for pipeline development and automation.
• Strong data modelling instincts you think carefully about how data is structured, named, and consumed downstream.
• You're as comfortable whiteboarding architecture with engineers as you are explaining data concepts to non-technical stakeholders.
• Calm and focused in a fast-moving environment you can prioritise well and bring others along with you.
• Excellent written and verbal English communication skills.
• You lead by example, care about the team's success, and leave things better than you found them.

Skills

Required

• Expert-level SQL
• dbt
• Apache Airflow
• Cube.js
• Python or similar language
• Cloud platforms (AWS, GCP, or Azure)
• Salesforce Marketing Cloud
• CDP
• Single Customer View (SCV)

Benefits

• Private Health Care (Bupa)
• Hybrid Working (3 days in office)
• Travel Insurance
• Competitive Base Salary
• Company Bonus Scheme
• Paid for AI Subscription (Claude / ChatGPT / Gemini)
• Market-Leading Training Programme
• Recognition & Reward Scheme
• Annual Company Conference
• Regular Happy Hours & Team Lunches
• Free Coffee, Drinks & Snacks