What are the responsibilities and job description for the AI Business Data Consultant position at TEKsystems?
Description
This role will help ensure AI-powered customer experiences are accurate, reliable, measurable, and continuously improving. The analyst will monitor production LLM application performance, evaluate response quality, build dashboards, identify risks and opportunities, and synthesize insights that inform product roadmap decisions, feature requirements, backlog prioritization, and operational improvements.
Supports our AI products by analyzing performance, defining KPIs, and driving continuous improvement for generative and conversational AI applications. Monitors LLM outputs, evaluates response quality, and builds dashboards/scorecards to track product health, user behavior, and business impact. Identifies risks (hallucinations, drift, retrieval issues) and translates insights into actionable product recommendations, backlog priorities, and experiments.
The ideal candidate combines strong analytical skills, product sense, technical curiosity, and practical understanding of generative AI applications, including conversational AI, RAG, prompt-based systems, AI evaluation metrics, and LLM-as-a-judge methodologies.
This is a Contract position based out of Torrance, CA.
Pay And Benefits
The pay range for this position is $50.00 - $54.00/hr.
Requirements
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
This is a hybrid position in Torrance,CA.
Application Deadline
This position is anticipated to close on Jun 23, 2026.
About TEKsystems
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
About TEKsystems And TEKsystems Global Services
We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.
The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.
Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.
This role will help ensure AI-powered customer experiences are accurate, reliable, measurable, and continuously improving. The analyst will monitor production LLM application performance, evaluate response quality, build dashboards, identify risks and opportunities, and synthesize insights that inform product roadmap decisions, feature requirements, backlog prioritization, and operational improvements.
Supports our AI products by analyzing performance, defining KPIs, and driving continuous improvement for generative and conversational AI applications. Monitors LLM outputs, evaluates response quality, and builds dashboards/scorecards to track product health, user behavior, and business impact. Identifies risks (hallucinations, drift, retrieval issues) and translates insights into actionable product recommendations, backlog priorities, and experiments.
The ideal candidate combines strong analytical skills, product sense, technical curiosity, and practical understanding of generative AI applications, including conversational AI, RAG, prompt-based systems, AI evaluation metrics, and LLM-as-a-judge methodologies.
- Define and track KPIs for AI product performance, CX outcomes, and business impact
- Analyze conversation logs, user behavior, and performance data to identify trends and issues
- Evaluate AI output quality using rubrics, test sets, and LLM evaluation methods
- Build dashboards, scorecards, and reporting to monitor product health
- Identify risks (hallucination, drift, retrieval errors) and recommend improvements
- Support product discovery, experimentation, and A/B testing
- Translate insights into product requirements, backlog items, and acceptance criteria
- Partner with product, engineering, and CX teams on releases, UAT, and optimization
- 3 years in data analytics, product analytics, or business analysis roles
- Experience supporting digital or AI-driven products (chatbots, conversational AI, etc.)
- Strong SQL and dashboarding/visualization skills (Power BI, Tableau, etc.)
- Experience defining KPIs and analyzing user behavior and product performance data
- Working knowledge of generative AI, LLMs, prompting, and RAG concepts
- Strong analytical, communication, and cross-functional collaboration skills
This is a Contract position based out of Torrance, CA.
Pay And Benefits
The pay range for this position is $50.00 - $54.00/hr.
Requirements
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to specific elections, plan, or program terms. If eligible, the benefits available for this temporary role may include the following:
- Medical, dental & vision
- Critical Illness, Accident, and Hospital
- 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
- Life Insurance (Voluntary Life & AD&D for the employee and dependents)
- Short and long-term disability
- Health Spending Account (HSA)
- Transportation benefits
- Employee Assistance Program
- Time Off/Leave (PTO, Vacation or Sick Leave)
This is a hybrid position in Torrance,CA.
Application Deadline
This position is anticipated to close on Jun 23, 2026.
About TEKsystems
We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.
The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
About TEKsystems And TEKsystems Global Services
We’re a leading provider of business and technology services. We accelerate business transformation for our customers. Our expertise in strategy, design, execution and operations unlocks business value through a range of solutions. We’re a team of 80,000 strong, working with over 6,000 customers, including 80% of the Fortune 500 across North America, Europe and Asia, who partner with us for our scale, full-stack capabilities and speed. We’re strategic thinkers, hands-on collaborators, helping customers capitalize on change and master the momentum of technology. We’re building tomorrow by delivering business outcomes and making positive impacts in our global communities. TEKsystems and TEKsystems Global Services are Allegis Group companies. Learn more at TEKsystems.com.
The company is an equal opportunity employer and will consider all applications without regard to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
San Francisco Fair Chance Ordinance: Pursuant to the San Francisco Fair Chance Ordinance, for all positions located in the city and county of San Francisco, we will consider for employment qualified applicants with arrest and conviction records.
Massachusetts Lie Detector: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI) to support parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications, but final decisions are made by our hiring team. By applying, you acknowledge and agree that your application may be reviewed using AI tools.
Salary : $50 - $54