Summary
Are you passionate about creating ground-breaking technology for next generation of voice assistant technology (Siri) that will usher the next revolution of human-computer interaction. Join the team that plays a key part in shipping groundbreaking technology for large scale systems in natural language, and artificial intelligence pertaining to Siri that impacts day to day life of billions globally.
Join ML Systems Evaluation Engineering (MLSEE) team at Apple and contribute to a highly accomplished team that evaluates AIML products, that will delight and inspire billions of people!
We are looking for Software Development Engineer in Test with a strong background and experience in Machine-Learning,
Conversational AI and Generative AI. We are seeking an engineer to improve the quality of AIML products and collaborate with the most innovative product development teams in the world. This team crafts and builds evaluation tools, automation frameworks and methodologies that enable product teams across Apple to develop machine-learning solutions that power amazingly intelligent user experiences. You will engage with innovative new-product teams around Apple, bringing your expertise and passion for innovation to solving technical problems for our next-generation products.
Key Qualifications
* 10 years as Software Development Engineer.
* 4 years of Designing and Architecting tools and frameworks.
* Expertise in dealing with datasets and performing analysis for product quality insights
* Demonstrated depth of knowledge and application of statistics-based evaluation methodologies or user success metrics
* Deep Understanding of ML-based concepts including awareness of how data is used to support ML, experimentation and analytics
* Experience with analyzing user behavior, deriving patterns and designing test strategies, automation frameworks
* Deep understanding of Prompt Engineering and Build Prompt fine-tuning
* Understanding of generative AI and experience in using Gen AI for various applications
Description
This role as Software Development Engineer in Test will own the qualification of Siri on AIML future technologies and customer facing product features by developing evaluation, automation and test methodologies. You will be leveraging innovative AI models to build applications and testing solutions on top of Apple's most advanced technologies. As a Software Engineer focused on product quality of ML models and features, you will be responsible for designing and implementing testing solutions, automations and build AI models for quality insights and testing frameworks. You will work closely with other cross-functional teams to align research, messaging, contribute to roadmaps and development of world class products. You will prototype and test new ideas and bring your research to life. You will be playing a pivotal role in testing, maintaining and shipping artifacts/features to make Siri and other AIML related products experience enjoyable by customers.
The primary responsibilities associated with this position range from data insights, design and implementation of product quality measures, ability to convert research findings into product quality improvement or frameworks, and work closely with product teams before and after feature launch. You will write clean, maintainable and production code with appropriate documentation and tests. You will contribute to architecture decisions, design reviews and peer code reviews.
We provide the right balance between research and product quality to deliver Apple quality state-of-the-art experiences on various Apple products.
Education & Experience
BS or MS or PhD in Computer Science or Electrical Engineering with Strong coding and Machine Learning skills and 10 years of Industry experience
Additional Requirements

• * Experience with conversational AI technologies and frameworks
• * Familiarity with Apple's research and products