Machine Learning Algorithm Engineer - Auto Focus at Apple in Cupertino

Job description

• As a technical leader within the team, you will own the end-to-end architecture, rapid prototyping, and productization of advanced machine learning-based auto-focus algorithms. You will maneuver through ambiguity independently to drive the long-term ML roadmap for AF, spearheading the design of novel learning-based systems integrated on Apple camera platforms which achieve seamless auto-focus user experience in any scene condition in both bright and low light. You will determine methods and procedures on complex projects, frequently acting as the representative for your area while leading cross-functional work to deploy enhanced machine learning based AF features. This includes coordinating the activities of sub-teams to create sophisticated architecture, training and tooling for machine learning based auto-focus development.
• You will partner deeply with the SOC architecture team to influence future silicon designs, the hardware team to evaluate new camera components impacting auto-focus, and the firmware team to optimize system-level flows for machine learning algorithms. The ideal candidate is a visionary problem-solver who thinks originally, resolves highly complex issues in creative ways, and is a proven mentor capable of inspiring innovation among others.

Responsibilities

• You will provide meaningful and significant contributions to the company's objectives by helping set the technical direction for next-generation multi-modal hybrid auto-focus algorithms.
• You will architect solutions that leverage advanced machine learning, the Apple Neural Engine (ANE), Apple-designed Image Signal Processor (ISP) pipelines, TrueDepth Camera, LiDAR Scanner, and other specialized hardware to redefine how camera auto-focus works at a fundamental level.
• You will act as a key technical pillar, creating partnerships across Silicon Design, Camera Hardware/Software, and Quality Assurance towards the creation of novel solutions in the space of real-time, machine learning based auto-focus capture solutions applicable across all of Apple’s products.

Requirements

• MS in Computer Science, Machine Learning, Electrical Engineering, or a related field.
• Experience in defining datasets for machine learning network training on low-level vision tasks as well as dataset curation and data augmentation strategies for robust training.
• Expertise in modern machine learning (ML) frameworks and libraries, specifically PyTorch or TensorFlow/TFLite/LiteRT.
• Strong software engineering and architectural skills, highly skilled at coding in Python and C.
• Experience with machine learning for practical low level computer vision applications including one or more of the following areas: auto-focus, stereo disparity/depth, depth estimation, defocus/blur estimation, optical flow estimation, sensor fusion.
• Experience with defining datasets for training temporal networks.
• Good knowledge of optics (Point Spread Functions, Depth-of-Field, etc.) and image quality metrics impacting critical image sharpness evaluation (Modulation Transfer Function, Spatial Frequency Response, Acutance, Blur/Defocus Estimation etc).
• Track record of pioneering innovation comprising publications in top-tier computer vision conferences (e.g., CVPR, ICCV, ECCV) and/or patents.

Skills

Required

• Programming languages: Python, C
• Defining datasets for ML training
• Software engineering and architecture

Preferred

• Defining datasets for temporal networks

Benefits

• At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location.
• Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
• Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.