What are the responsibilities and job description for the Data Scientist A/B testing position at Talent Groups?
Job Description: A/B Test Data Scientist (Website Experimentation)
Role Overview
As an A/B Test Data Scientist, you will be the statistical engine behind our website’s optimization strategy. You will design, execute, and analyze controlled experiments to improve user experience, conversion rates, and business growth. You will work at the intersection of product, engineering, and marketing to ensure every website change is backed by rigorous data.
Key Responsibilities
Develop clear experimentation hypotheses and define primary and secondary success metrics.
Determine appropriate sample sizes, statistical power, and experiment duration for reliable test outcomes.
Manage experiment execution, including user segmentation and randomization processes.
Collaborate with engineering teams to ensure accurate event tracking and data integrity.
Analyze experiment results using statistical methods such as p-values and confidence intervals to measure significance.
Conduct post-experiment analyses to uncover segment-level insights and business impact.
Translate complex analytical findings into actionable recommendations for stakeholders and leadership teams.
Maintain and manage an experimentation roadmap while documenting and archiving key learnings and outcomes.
Required Skills & Qualifications
Statistical Expertise: Mastery of hypothesis testing, experimental design, and probability. Knowledge of Bayesian vs. Frequentist approaches is a plus.
Programming: Proficiency in SQL for data extraction and Python or R for advanced statistical analysis.
Tools: Experience with experimentation platforms (e.g., Optimizely, VWO, or LaunchDarkly) and web analytics (e.g., Google Analytics 4).
Visualization: Ability to build dashboards in Tableau, Power BI, or Looker to monitor live tests.
Soft Skills: Strong critical thinking and the ability to explain "why" a result occurred to non-technical partners.
Experience & Education
Education: Bachelor’s degree in a quantitative field (Statistics, Math, CS, Economics); master’s or PhD preferred.
Experience: 2–5 years in a data science or product analytics role, specifically focused on digital experimentation
Salary : $120,000 - $125,000