Senior / Staff Software Engineer, AI Systems at Lighthouse in New York City

Job description

• Application
• We're looking for a senior or staff-level software engineer to build the AI systems that help the world's best and brightest build in the U.S.
• You'll own the agents and infrastructure that power complex legal workflows: drafting documents, reviewing evidence, and moving cases toward filing. This includes workflow orchestration, backend services, and evaluations that measure quality and catch regressions. You'll work directly with our legal team to understand their processes and turn early experiments into reliable production systems.

Responsibilities

• Build agentic systems that automate complex, multi-step legal workflows, with human review and intervention at the right points.
• Redesign our task and workflow orchestration to support long-running work, dependencies, retries, and recovery.
• Build evaluation systems to measure output quality, catch regressions, and guide improvements to agents, prompts, and models.
• Improve the architecture of our backend services, event pipelines, and scheduled job infrastructure.
• Make agent execution observable, so we can understand what happened, debug failures, and manage quality, latency, and cost.
• Connect these systems to our internal tools and applicant-facing portal, including the APIs and interfaces people need to supervise their work.

Requirements

• You have 4+ years shipping production software, with deep experience in backend systems and experience building AI/ML powered applications.
• You've built with LLMs beyond a basic chat interface and thought carefully about tool use, context, evaluation, and handling unreliable outputs.
• You can work with domain experts to turn nuanced processes and quality judgments into software behavior and meaningful evaluations.
• You're comfortable working in Python and TypeScript, or similar languages.
• You've led projects end to end, from ambiguous requirements through deployment and ongoing operation.
• You have a solid understanding of workflow orchestration and asynchronous systems, including queues, events, retries, idempotency, and failure recovery.
• You have high agency: you can independently research unfamiliar problems, test approaches, and drive them to a working solution.
• Experience operating agents in production, building eval infrastructure, or working on complex document workflows is especially relevant. Strong engineering judgment matters more to us than experience with a particular framework.

Skills

Required

• Python
• TypeScript
• Backend systems
• AI/ML powered applications
• LLMs
• Tool use
• Context
• Evaluation
• Handling unreliable outputs
• Workflow orchestration
• Asynchronous systems
• Queues

Preferred

• Operating agents in production
• Building eval infrastructure
• Complex document workflows

Benefits

• We sponsor visas, obviously.
• Competitive base and equity, scaled with experience.
• Competitive medical, dental, and vision benefits.
• 401k with a 3% company match.
• Equipment/office stipend.
• Annual team off-site in cool places.
• In person in San Francisco or New York.