Senior Prompt Engineer, NYC

Are you ready to make an impact?

West Monroe is seeking an innovative and detail-oriented Senior Prompt Engineer to support use case development for an Agentic AI platform on Google Cloud Platform (GCP). This role will focus on preparing and structuring input data and context, designing and refining prompts and schemas, and tuning extraction and reasoning behavior to ensure the AI agent produces accurate, consistent, and auditable outputs.

Key Responsibilities

Input Data Preparation & Context Structuring

• Collect, curate, and structure input data and contextual information required for the AI agent to perform effectively.
• Develop strategies to optimize the quality and relevance of input data, ensuring it aligns with specific use case requirements.
• Collaborate with data engineers and domain experts to ensure data sources are clean, consistent, and appropriately formatted for use in AI prompts.
  
  

Prompt & Schema Design

• Design, test, and refine prompts and schemas to guide the AI agent's behavior and outputs.
• Create modular and reusable prompt templates that can be adapted across different use cases.
• Work closely with solution architects and stakeholders to align prompts with business goals and desired outcomes.
• Experiment with various prompt structures, wording, and configurations to achieve optimal agent performance.
  
  

Tuning Extraction & Reasoning Behavior

• Fine-tune the AI agent's extraction and reasoning capabilities to ensure outputs are accurate, consistent, and aligned with expectations.
• Develop strategies for improving the agent's ability to handle ambiguity, incomplete data, and complex reasoning tasks.
• Use feedback loops and iterative testing to continuously improve the agent's performance and reliability.
• Ensure outputs are auditable, providing clear traceability of how the agent arrived at its conclusions.
  
  

Testing & Validation

• Conduct rigorous testing of prompts and agent behavior to identify and resolve issues such as bias, inconsistencies, or inaccuracies.
• Develop automated testing frameworks to validate the agent's outputs across various scenarios and edge cases.
• Document findings and provide actionable recommendations to improve the agent's performance.
  
  

Collaboration & Stakeholder Engagement

• Collaborate with cross-functional teams, including data scientists, engineers, and business stakeholders, to align on use case requirements and objectives.
• Act as a subject matter expert on prompt engineering and provide guidance on best practices for leveraging AI agents.
• Communicate results, challenges, and improvements to technical and non-technical audiences.
  
  

Required Skills & Qualifications

Technical Expertise

• Prompt Engineering: Strong experience designing, refining & optimizing prompts & system instructions for large language models (e.g., GPT, PaLM, or similar) to drive reliable reasoning and task performance.
• Context Design & Patterns: Expertise in structuring & managing context using patterns such as RAG, prompt chaining, memory windows & schema-driven context alignment.
• AI/ML & NLP Foundations: Strong understanding of NLP, reasoning models & LLM behavior to inform prompt strategy and failure mitigation.
• Data Structuring & Preprocessing: Expertise in preparing and transforming input data, including text preprocessing, schema design, and grounding strategies
• Google Cloud Platform (GCP): Experience with GCP services such as Vertex AI, BigQuery, and related GCP AI/ML services to deploy and evaluate prompt-driven systems.
• Programming & Automation Skills: Proficiency in Python or similar programming languages for prototyping, testing, evaluation harnesses and prompt automation.
  
  

Requirement to be onsite in New York City hybrid.

Problem-Solving & Testing

• Strong analytical and problem-solving skills to fine-tune agent behavior and resolve inconsistencies.
• Experience with testing frameworks and methodologies to validate AI outputs across diverse scenarios.
• Ability to identify and mitigate issues related to bias, ambiguity, or incomplete reasoning in AI agents.
  
  

Collaboration & Communication

• Excellent communication skills to explain technical concepts and results to both technical and non-technical stakeholders.
• Proven ability to work collaboratively in cross-functional teams, including data scientists, engineers, and business users.
• Strong documentation skills to ensure transparency and reproducibility of prompt engineering processes.
  
  

Preferred Qualifications

• Experience working with large language models (LLMs) such as OpenAI's GPT, Google’s PaLM, or similar.
• Familiarity with MLOps practices and tools for managing the AI lifecycle.
• Knowledge of ethical AI principles and techniques for ensuring fairness, transparency, and accountability.
• Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Data Engineer).
  
  

Based on pay transparency guidelines, the salary range for this role can vary based on your proximity to one of our West Monroe offices (see table below). Information on our competitive total rewards package, including our bonus structure and benefits is here. Individual salaries are determined by evaluating a variety of factors including geography, experience, skills, education, and internal equity.

Employees (and their families) are covered by medical, dental, vision, and basic life insurance. Employees are able to enroll in our company’s 401k plan, purchase shares from our employee stock ownership program and be eligible to receive annual bonuses. Employees will also receive unlimited flexible time off and ten paid holidays throughout the calendar year. Eligibility for ten weeks of paid parental leave will also be available upon hire date.

Seattle or Washington, D.C.

$125,500—$147,600 USD

Los Angeles

$131,500—$154,700 USD

New York City or San Francisco

$137,400—$161,700 USD

A location not listed above

$119,500—$140,600 USD

Other consultancies talk at you.

At West Monroe, we work with you.

We’re a global business and technology consulting firm passionate about creating measurable value for our clients, delivering real-world solutions.

The combination of business and technology is not new, but how we bring them together is unique. We’re fluent in both. We know that technology alone is not the answer, but how we apply it is. We rely on data to constantly adapt and solve new challenges. Actions that work today with outcomes that generate value for years to come.

At West Monroe, we zero in on the heart of the opportunity, getting to results faster and preparing people for what’s next.

You’ll feel the difference in how we work. We show up personally. We’re right there in the room with you, co-creating through the challenges. With West Monroe, collaboration isn’t a lofty promise, but a daily action. We work together with you to turn vision into clear action with lasting impact.

West Monroe is an Equal Employment Opportunity Employer 

We believe in treating each employee and applicant for employment fairly and with dignity. We base our employment decisions on merit, experience, and potential, without regard to race, color, national origin, sex, sexual orientation, gender identity, marital status, age, religion, disability, veteran status, or any other characteristic prohibited by federal, state or local law. To learn more about diversity, equity and inclusion at West Monroe, visit www.westmonroe.com/inclusion. If you require a reasonable accommodation to participate in our recruiting process, please inquire by sending an email to recruiting@westmonroe.com.

Please review our current policy regarding use of generative artificial intelligence during the application process.

If you are based in California, we encourage you to read West Monroe’s Notice at Collection for California residents, provided pursuant to the California Consumer Privacy Act (CCPA) and linked here.