Senior Machine Learning Engineer- AIOS at Zafin in Toronto

Job description

• As a Machine Learning Engineer, part of Zafin's AIOS Product team, you will build the machine learning and AI systems that power the AIOS Knowledge Fabric and help agents reason over enterprise knowledge with accuracy, traceability, and control.
• You will work on practical production systems, including retrieval, ranking, embeddings, model integration, evaluation, data pipelines, model serving, observability, and the workflows that make AI outputs reliable for regulated banking environments. This is a hands-on engineering role focused on turning ML and LLM capabilities into dependable product infrastructure.
• This role is critical for high-quality knowledge, strong evaluation, and reliable model behavior. You will help build the foundation that allows customers to use AI agents with confidence, accountability, and measurable business value.

Responsibilities

• Design, build, test, and maintain ML and AI capabilities for AIOS, with a focus on knowledge retrieval, model integration, and production reliability.
• Develop systems for embeddings, vector search, ranking, retrieval-augmented generation, knowledge ingestion, and knowledge quality improvement.
• Build and improve model evaluation workflows, test sets, scoring approaches, quality metrics, and monitoring for AI and LLM-based systems.
• Partner with AI engineers, data engineers, product managers, architects, and domain experts to translate product needs into ML system designs and working software.
• Write production-quality Python or equivalent code, including services, pipelines, automation, tests, and integration points with product systems.
• Improve ML system performance, latency, cost, reliability, and observability in production and pre-production environments.
• Work with structured and unstructured enterprise data, including documents, metadata, knowledge sources, customer data, and operational signals.
• Support responsible AI practices by improving traceability, explainability, governance, auditability, privacy, and human review workflows.
• Create technical documentation, model cards or evaluation notes where useful, implementation guidance, and operational runbooks.
• Stay current with ML, LLM, RAG, evaluation, and MLOps practices and bring practical improvements into the AIOS product.

Requirements

• Must haves
• 5+ years of software engineering, machine learning engineering, data science engineering, or applied ML experience building production systems.
• 2+ years of hands-on experience with production ML, LLM applications, retrieval-augmented generation, NLP, search, recommendation, or AI-powered automation.
• Strong programming skills in Python and experience building maintainable, tested, production-quality code.
• Practical experience with ML frameworks, LLM APIs or open-source models, embeddings, vector databases, retrieval systems, or model-serving patterns.
• Strong understanding of data pipelines, feature or knowledge preparation, model evaluation, experiment tracking, and performance measurement.
• Solid software engineering fundamentals, including APIs, databases, testing, debugging, version control, and system design.
• Ability to analyze model behavior, diagnose quality issues, and improve systems using both quantitative metrics and qualitative reviews.
• Strong communication skills, with the ability to explain ML trade-offs, model behavior, and technical recommendations to product and engineering stakeholders.
• Bachelor's degree in Computer Science, Engineering, Machine Learning, Statistics, Mathematics, or a related technical field, or equivalent practical experience.
• Experience building RAG systems, knowledge graphs, document understanding systems, semantic search, or enterprise knowledge platforms.
• Experience with MLOps practices, model monitoring, model registries, CI/CD for ML, or deployment of ML services in cloud environments.
• Experience with Azure, Kubernetes, Docker, distributed data processing, or scalable data infrastructure. Experience with banking, financial services, compliance, risk, or other regulated industry data.
• Experience with AI evaluation, safety testing, hallucination mitigation, prompt testing, or governance controls for LLM systems.
• Experience collaborating with product teams to turn ambiguous AI capabilities into usable product features.
• Experience with security, privacy, data access controls, audit trails, and responsible AI requirements.
• Published research, open-source contributions, patents, or technical writing related to ML, NLP, search, or AI systems.

Skills

Required

• Python
• ML frameworks
• LLM APIs or open-source models
• embeddings
• vector databases
• retrieval systems
• model-serving patterns
• data pipelines
• feature or knowledge preparation
• model evaluation
• experiment tracking
• performance measurement

Preferred

• RAG systems
• knowledge graphs
• document understanding systems
• semantic search
• enterprise knowledge platforms
• MLOps practices
• model monitoring
• model registries

Benefits

• At Zafin, we invest in our people. Our comprehensive rewards program is designed to support your health, financial well-being, and work-life balance, including:
• Fully company-paid health benefits
• Annual bonus opportunities
• Generous vacation and holidays
• RRSP matching
• Employer-paid insurance coverage
• Wellness resources
• Extensive paramedical benefits, and more
• Joining our team means being part of a culture that values diversity, teamwork, and high-quality work. We offer competitive salaries, annual bonus potential, generous paid time off, paid volunteering days, wellness benefits, and robust opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career with us? Visit our careers site and our openings: zafin.com/careers