AI/ML Quality Assurance Engineer (Plano, TX)

Our Customer is a Silicon Valley- based company that is engaged in researching emerging technologies.

We are seeking a contract AI/ML Quality Assurance Engineer to support our Customer's business needs. This role is on-site in Plano, TX.

Responsibilities

• Expand this tool utilization to ASR / Bixby so that we can scale/expand MQL TC data sets.
• Promote engineering on some of the internal platforms
• Support / drive NMT improvements (Main member that drives Spanish translation).
• Ensure the successful execution of multiple projects simultaneously.
• Continuously improve test coverage, efficiency, and effectiveness by identifying areas for automation and optimization.
• Exceptional problem-solving abilities, debugging, and log analysis skills.
• Evaluate defects/issues based on market impact and product specification (Technical).
• Communicate high-priority risk defects/events to middle and upper management.
• Prioritize and manage multiple projects in a fast-paced environment, communicating quickly with key project stakeholders.
• Maintain up-to-date competitive knowledge on voice quality market trends.
• Gather and analyze data from multiple sources, prepare spreadsheets, charts, graphs, and tables of information, and plan and prioritize multiple work assignments.
• Communicate with internal/external teams in a professional manner to build and maintain excellent rapport.
• Determine course of action for the completion of objectives and tasks with limited instruction.
• Works on problems of limited scope. Follows standard practices and procedures.
• Conduct usability testing across platforms to identify friction points and accessibility issues.
• Design, run, and evaluate prompt-based test scenarios to ensure consistent and high-quality language model outputs.
• Collaborate with UX designers and product managers to validate design assumptions through user-centered QA practices.
• Create and maintain prompt evaluation frameworks, including edge cases and expected output quality.
• Report usability bugs and inconsistencies in AI-driven features with user impact assessments.
• Define metrics and standards for prompt performance (e.g., coherence, relevance, tone).
• Work closely with ML/NLP engineers to give feedback on model behavior from a QA and UX standpoint.
• Automate prompt validation where possible, using tools generated internally (Gemini Prompt Tool).
• Support continuous improvement of UX and AI feature integration through data-driven QA practices.
• Document test cases, user flows, and prompt strategies for internal reference and training.
• Evaluate model output quality across diverse scenarios and edge cases.
• Strong command of language, creativity, and logical reasoning.
• Strong problem-solving and analytical skills, communication (verbal and written) skills, and organizational and documentation skills
• Demonstrate ability to solve problems involving highly diverse conditions requiring creativity to search for solutions among learned concepts
• Goal-oriented, possess a sense of urgency, and are capable of working under pressure, and also work independently with limited supervision
  
  

Skills And Qualifications

• 1-3 years of software development experience required.
• B.S. in Computer Science/Engineering or a related field is required.
• M.S. in Computer Science/Engineering or a related field is preferred.
• Ability to speak English fluently and record the audio to improve the quality of products
• Ability to write code and scripts to execute test data on ASR/Bixby speech and translation models
• Android experience (intermediate level) is required for developing small apps that can help in testing and building proof-of-concepts
• Experience in software QA is desirable.
• Experience in ML/AI systems is desirable.
• Experience in the Mobile/Telecom industry is desirable.
• English (business proficiency) and Spanish (business proficiency) speaking/reading/writing ability preferred.
• Proven experience working with QA test plans, manual/automated test executing, and managing defects/issues.
• In-depth knowledge of product quality management and development, and QA lifecycles.
• Familiarity with LLMs and prompt engineering tools.
• Familiarity with ML concepts, NLP, and evaluation techniques (ie. BLEU, TER, COMET).
• Passion for learning and upkeep of evolving technologies.
• Having an in-depth understanding of how technology influences the development of culture and society.
• Excellent communication skills required.
• An ideal candidate would be the self-starting, motivated type.
• An ideal candidate should be proactive and be able to engage with multiple teams in multiple locations.
• An ideal candidate should have a can-do attitude and will need to do whatever it takes to complete the job.
• An ideal candidate will require excellent multitasking skills.
• An ideal candidate is one who likes to take responsibility for their tasks and complete and drive their projects to completion.
  
  

We offer a competitive salary range for this position. Most candidates who join our team are hired at the median of this range, ensuring fair and equitable compensation based on experience and qualifications.

Contractor benefits are available through our 3rd Party Employer of Record (Available upon completion of waiting period for eligible engagements)

Benefits include: Medical, Dental, Vision, 401k.

An Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against on the basis of disability.