Senior Backend Engineer, Agent Infrastructure at Airbyte in San Francisco

Job description

• Application
• Airbyte is the data and action layer for AI agents. We give agents fast, accurate, authenticated access to business data across hundreds of sources, so they can discover the entities that matter, reason over real-time context, and take action in the systems they read from, not just observe them.
• We started as the open-source standard for data movement and proved the economics of data integration at scale: hundreds of connectors, thousands of companies, and, since 2020, have raised $181M from leading investors including Benchmark, Accel, Altimeter, Coatue, and Y Combinator. As our CEO Michel Tricot puts it, "the last ten years were all about structured data. The future is all about context." We're now building that context infrastructure for production-grade agents on the same open foundation, as agents become the primary consumers of enterprise data.
• Our mission is unchanged: make data available and actionable to everyone, everywhere. That everyone now includes AI agents.
• Airbyte is building the runtime that powers production-grade AI agents.
• This is not an ML research or prompt engineering role. We’re looking for an experienced backend or platform engineer who has built complex production systems and has also worked hands-on with AI agents, orchestration, retrieval, or LLM-powered applications.
• Our AI Runtime sits between language models and the enterprise systems agents need to understand and act on. It is responsible for assembling the right context, identifying entities across systems, selecting tools and connectors, coordinating execution, validating evidence, enforcing permissions, and handling failures safely.
• “Investigate this customer and tell me what changed.”
• Behind that request, the runtime may need to identify the customer across multiple systems, retrieve fresh data, determine which tools to call, coordinate multiple steps, validate the result, and return an answer with evidence the user can trust.
• That infrastructure is what you’ll help build.
• We’re still early. The architecture is taking shape, but there is significant room to influence how the runtime is designed, how developers interact with it, and how we make agentic systems reliable in production.
• Success is not measured by the sophistication of the prompts. It is measured by whether the runtime becomes more reliable, observable, and trustworthy over time.
• Assemble the right context and choose the correct connectors, tools, and Skills.
• Execute multi-step workflows reliably.
• Recover gracefully when something fails.
• Produce evidence-backed answers with citations and traceability.
• Enforce permissions, freshness guarantees, and action policies.
• Learn from failures through replay, evaluation, and observability.
• Allow users to focus on outcomes rather than coordinating individual tools themselves.
• As the runtime evolves, developers and users should need to think less about the underlying tools and more about what they want to accomplish. The runtime should handle the complexity underneath.
• AI agents work impressively in demos. Making them reliable in production is much harder.
• The difficult problems are often not the model itself. They are retrieving the right context, connecting to real enterprise systems, maintaining permissions, coordinating multiple actions, recovering from failures, and determining whether an answer can actually be trusted.
• Airbyte already connects to hundreds of business systems. We’re building the runtime that allows agents to use that infrastructure intelligently and safely.
• If we succeed, developers will not need to rebuild orchestration, retrieval, permissions, evaluation, and enterprise connectivity every time they build a new agent.

Responsibilities

• Build the AI Runtime
• Design and implement the orchestration layer that turns natural-language intent into reliable, multi-step execution.
• Build systems for routing, state management, retries, failure handling, and long-running agent workflows.
• Develop systems for entity resolution, context assembly, connector orchestration, and evidence retrieval.
• Build reusable Skills that encapsulate business workflows and domain-specific capabilities.
• Coordinate connectors, APIs, tools, deterministic logic, retrieval systems, and multiple language models.
• Build Reliable Agent Infrastructure
• Design systems that retrieve and assemble the right enterprise context at runtime.
• Build evidence-backed reasoning with citations and traceability that users can inspect and verify.
• Implement permission models, freshness validation, and action policies for production environments.
• Build evaluation, replay, observability, and debugging systems that help us understand why agents succeed or fail.
• Improve the reliability of systems where model outputs may be probabilistic, but execution cannot be.
• Own Products End to End
• Take ambiguous product ideas from prototype through production.
• Own features across architecture, implementation, rollout, and iteration.
• Work directly with Product, Design, Sales Engineering, Customer Success, and customers to understand real-world problems.
• Write high-leverage code that creates reusable infrastructure for future product areas.
• Experiment with new agent architectures while maintaining production-grade reliability.

Requirements

• You may be a strong fit if you are fundamentally a backend or platform engineer who has also spent meaningful time building production AI systems.
• 7+ years of software engineering experience building and operating production systems.
• Strong backend engineering fundamentals and experience designing distributed systems.
• Experience building complex systems involving APIs, asynchronous workflows, concurrency, queues, state, retries, or distributed execution.
• Hands-on experience building production applications using LLMs, agents, RAG, tool calling, MCP, or similar technologies.
• Experience with orchestration systems, workflow engines, developer platforms, or infrastructure products.
• Strong system design skills and the ability to reason about reliability, scale, observability, and failure modes.
• Ability to move quickly from prototype to production without sacrificing engineering quality.
• Strong product instincts and comfort operating in ambiguous, 0-to-1 environments.
• Exceptional written communication skills.
• A strong bias toward ownership and shipping.
• Experience building agent infrastructure, agent platforms, or evaluation systems.
• Familiarity with orchestration technologies such as LangGraph, Temporal, MCP, or similar.
• Experience with retrieval systems, vector search, search infrastructure, or knowledge graphs.
• Experience building developer tools or platform infrastructure.
• Experience with data infrastructure such as Kafka, Iceberg, Postgres, Spark, or modern data warehouses.
• Experience working on early-stage products where you helped define architecture and technical direction.

Skills

Required

• Backend engineering
• Distributed systems design
• APIs
• Asynchronous workflows
• Concurrency
• Queues
• State management
• Retries
• Distributed execution
• LLMs
• Agents
• RAG

Preferred

• Agent infrastructure
• Agent platforms
• Evaluation systems
• LangGraph
• Temporal
• MCP
• Retrieval systems
• Vector search

Benefits

• At Airbyte, we believe great work happens when people feel supported, trusted, and empowered to grow. Our market-leading Total Rewards package is designed to help you thrive professionally and personally. Our benefits and perks include:
• Flexible PTO with a culture that encourages at least 25 days off annually
• 16 weeks fully paid parental leave for all parents
• Comprehensive medical, dental, and vision coverage for employees and dependents
• 401(k) retirement plan
• Professional development budget, conference sponsorship, and book reimbursement
• Commuter benefits and monthly internet reimbursement
• Breakfast and lunch in our San Francisco office
• A collaborative, in-person culture focused on learning, growth, and impact
• If you find this role exciting, we encourage you to apply even if you think you don’t meet all of the requirements!
• We are not accepting agency submissions or recruiting firm support for this role. Unsolicited resumes will not be considered.