What are the responsibilities and job description for the QA Engineer position at Orion Innovation?
Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.
Responsible for:
Key accountabilities:
% of time | Accountability
10% Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.
10% Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors. Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.
50% Conduct red team exercises simulating real-world deployment scenarios and edge cases. Systematically probe for bias, toxicity, misinformation generation, and other harmful outputs across diverse contexts and demographics. Improve firm’s security posture against emerging AI threats. Concentration is on executing standardized security tests.
10% Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.
10% Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations to drive the mitigation of identified risks.
10% Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks as required to support the AI Red Team's function.
Required Skills:
Candidate Privacy Policy
Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains
Responsible for:
- Developing and implementing global security strategies
- Overseeing security architecture and enablement
- Delivering regional security services
- Supporting secure digital transformation initiatives
- Collaborating with member firms to ensure consistent security standards
Key accountabilities:
% of time | Accountability
10% Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.
10% Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors. Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.
50% Conduct red team exercises simulating real-world deployment scenarios and edge cases. Systematically probe for bias, toxicity, misinformation generation, and other harmful outputs across diverse contexts and demographics. Improve firm’s security posture against emerging AI threats. Concentration is on executing standardized security tests.
10% Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.
10% Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations to drive the mitigation of identified risks.
10% Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks as required to support the AI Red Team's function.
Required Skills:
- Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.
- Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) from an accredited college or university or equivalent work experience.
- Background in AI red teaming, red teaming, or offensive cyber operations.
- Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking. Excellent communication and stakeholder management skills.
- Ability to work effectively across geographies.
Candidate Privacy Policy
Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains
- What information we collect during our application and recruitment process and why we collect it;
- How we handle that information; and
- How to access and update that information.