1 TTA- Protection Officer, Signpostai Job in New York, NY

SORT BY

SET JOB ALERT

OFF

Details...

TTA- Protection Officer, Signpostai

International Rescue Committee

New York, NY | Full Time

$94k-117k (estimate)

2 Weeks Ago

TTA- Protection Officer, Signpostai

$94k-117k (estimate)

Full Time | Social & Legal Services 2 Weeks Ago

Save

International Rescue Committee is Hiring a TTA- Protection Officer, Signpostai Near New York, NY

Before you start, please review the Temporary Transfer Assignment Guidelines on RescueNet to make sure you qualify to apply

Title: TTA- Protection Officer, Signpostai

Sector: Protection and rule of law

Location: Remote

Start Date: As Soon As Possible

Duration: 3 Months
Scope of work & objectives:

Please email your CV to Karina.Salce@rescue.org. You must subject your email "TTA- Protection Officer, signpostai”. This Opportunity is Intended for IRC Current Staff.

Role overview/ summary

Protection Officer, signpostai (TTA) will work in conjunction with the Signpost technology and program teams to test applications for generative AI chat within a controlled testing environment. S/he role will create simulated client conversations to find flaws in the AI’s design before it is deployed to programs.

The TTA will attempt to exploit flaws in the generative AI bots developed under signpostai, document these flaws, and offer possible fixes so that the technology development team can identify the weakness of the tool and patch issues. S/he will also review, score, and provide feedback to outputs of the generative AI tools to inform possible programmatic applications and to ensure its safety.

Reporting: MIP: Senior Advisor for Responsive Information and Project Manager, AI

Responsibilities

Create chat scenarios and mock client messages.
Review and grade the quality of AI-generated responses (an approximate average of 100 a week) using a rubric based on established best practices for quality responses.
Contribute substantive feedback on AI-generated responses that can be used to further train the AI.
Keep step by step documentation of process, trends, and other notes relevant for dissemination.
Analyze and document trends in bot responses and work with development team to suggest new prompts, training material, or rules for chatbot.
Provide perspective on the readiness of chatbot for program-facing use.
Document all details relating to test environment.

Requirements:

Demonstrated knowledge of how to craft high-quality responses to questions posed by people affected by crisis or displacement, including knowledge of psychological first aid (PFA), service and safety planning, and client-centered and trauma-informed communication.
An ability to leverage this knowledge to assess AI generated responses.
Interest in Artificial Intelligence (prior experience not required but preferred)
Demonstrated success working and communicating effectively in a multicultural environment.
Ability to work autonomously.
High level of attention to detail.
Strong computer proficiency and ability to quickly pick up new technology tools.
English required. Strong preference for one of the following: Arabic, French, or Spanish.