What are the responsibilities and job description for the AI Analyst II position at McCarthy Holdings, Inc?
AI Analyst II
Information Technology — St. Louis, MO
McCarthy Holdings, Inc. (McCarthy), is the holding entity for McCarthy Building Companies, Inc., the oldest privately-held national construction company in America, and Castle Contracting. McCarthy provides the crucial business infrastructure for these entities and connects the day-to-day operations to ensure seamless operations across the business. Repeatedly honored as a great place to work and healthiest employer, McCarthy is a 100 percent employee-owned company.
At McCarthy, we are committed to sustaining a culture that delivers great experiences for everyone. This begins with developing high-performing individuals and teams through our award-winning learning and development programs, best-in-class Total Rewards benefits, and our inclusive culture aligned with our core values: GeGenuine. We, Not I. All In.
How do McCarthy partners define our culture?
We Live Our Core Values: We do whatever it takes to deliver on our promises with honesty and integrity.
We are Employee Owned: We are personally invested in building the things people need in our communities.
We Feel Like a Family: We value genuine connections and help each other succeed in an inclusive environment.
We are Builders: We respect the work we do and everyone who helps make it happen safely.
POSITION SUMMARY
As an AI Analyst, you will play a foundational role in McCarthyʼs AI journey. Working closely with our AI Architect and AI Engineers, you will support the development, testing, and governance of AI systems that power our construction business. This role is hands-on with data and AI workflows, but also emphasizes documentation, validation, and translation of technical results into business insights.
This is a unique opportunity for an early-career professional to learn the inner workings of enterprise AI while contributing directly to responsible, value-driven outcomes.
RESPONSIBILITIES
Take ownership of assigned projects or components, moving ideas from concept to execution while tracking progress, stakeholders, and changes under guidance from senior team members.
Participate in mapping out and documenting processes for the deployment, scaling, and ongoing improvement of AI platforms used across business units
Prepare and share meeting notes, research summaries, process documentation, and action items with teams in a timely and accessible manner
Contribute to a collaborative, feedback-driven work culture that encourages continuous improvement and learning
Assist in maintaining and validating data models and shared definitions that help align analytics, AI outputs, and business concepts across teams.
Supports data preparation, documentation, and testing activities.
Run exploratory analyses to identify trends, anomalies, and insights in construction and project data.
Assist in testing and evaluating AI/ML model outputs and generative AI prompts for accuracy, relevance, and compliance.
Track key metrics for AI solutions (accuracy, bias, adoption, governance checkpoints).
Support the development of dashboards, reports, and visualizations to communicate AI outcomes to business stakeholders.
Contribute to prompt lifecycle management by organizing, testing, and versioning prompts.
Document workflows, test results, and decision points to ensure auditability and transparency.
Collaborate with engineers, architects, and business teams to align analytical tasks with real-world project needs.
QUALIFICATIONS
Bachelor’s degree in Data Science, Computer Science, Statistics, Business Analytics, Engineering, or a related field (or equivalent project experience).
3 – 5 years of professional experience or strong academic/project experience in data/AI, analytics, data science, or business intelligence.
Execute well-defined analytical tasks with guidance and assist in model monitoring, data quality checks, and prompt testing.
Strong analytical skills with comfort in SQL, Excel, and Python (pandas, matplotlib, scikit-learn basics).
Familiarity with cloud data environments AWS, Azure, GCP and willingness to learn MLOps/PromptOps tools.
Strong understanding of AI/ML concepts and interest in generative AI systems.
Strong attention to detail and a passion for data quality and governance.
Excellent communication skills—able to summarize technical results for nontechnical audiences.
Growth mindset: eager to learn AI governance, prompt engineering, and agentic AI concepts on the job.
McCarthy is proud to be an equal opportunity employer, including disability and protected veteran status.