Full-Time Engineer: AI Software Engineer at OpenInfer in Bay Area, CA, US

Job description

• We are looking for a Rust Software Developer to join our team and work on cutting-edge local AI inference. This role is ideal for someone eager to grow their Rust development skills while contributing to our API front-end and core systems. You will be contributing to the customer-facing codebase that is the vehicle for us delivering our improvements to LLM inference. If you’re excited about Rust and AI, we’d love to hear from you!
• Opportunity to work alongside industry experts in AI optimization, high-performance computing, and hardware acceleration.
• Hands-on experience with cutting-edge technologies at the intersection of AI and hardware acceleration.
• Exposure to open-source development and collaboration with a vibrant community.
• Extensive experience building and maintaining a Rust codebase

Responsibilities

• Develop and maintain LLM inference engine written in Rust
• Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
• Maintain GitHub actions to build & release software
• Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
• Debug and troubleshoot issues in our API and related infrastructure
• Collaborate with product and AI teams to integrate new features

Requirements

• Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work).
• Proficiency in async Rust and concurrent programming
• Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems.
• Strong problem-solving skills and attention to detail
• Familiarity with Axum, Actix, or other Rust web frameworks
• Understanding of containerization (Docker) and cloud services
• Familiarity with GitHub Actions and CI/CD
• 3 years experience in C++
• Experience with Android NDK and integrating Rust into mobile applications
• Working with LLMs and local inference engines like llama.cpp or Ollama
• Familiarity with REST design and FFI integration into C, Python, etc

Skills

Required

• Rust
• Async Rust
• Concurrent programming
• Problem-solving
• Attention to detail

Preferred

• Axum
• Actix
• Docker
• Cloud services
• GitHub Actions
• CI/CD
• C++
• Android NDK

Benefits

• Medical, Dental, and Vision benefits
• Flexible Paid Time Off, 10 days
• Parental Leave
• 401(k) Plan with company matching
• Snacks and coffee to keep you energized
• These benefits are further detailed in OpenInfer policies and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans.