Senior Data Labeling Specialist (Atlanta)

Senior Data Labeling Jobs in Atlanta (Remote, Full-Time)

Rex.zone is hiring a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive training data quality through annotation guidelines compliance, RLHF-style preference ranking, prompt evaluation, and rigorous QA evaluation across NLP, computer vision, and content safety domains.

What You Will Work On

• NLP labeling (classification, named entity recognition/NER, entity linking)
• LLM evaluation with calibrated rubrics (prompt evaluation, response ranking, preference data for RLHF workflows)
• Computer vision annotation (bounding boxes, polygons, segmentation) and image/video labeling
• Policy-driven content safety labeling using taxonomy-based guidelines
  
  

Core Responsibilities

• Execute complex annotation tasks with consistent, guideline-driven decisions
• Own training data quality and evaluation rigor through QA evaluation (spot checks, audits, sampling, inter-annotator agreement)
• Document edge cases and rationales; resolve disagreements and improve consistency
• Write, refine, and enforce annotation guidelines and error taxonomies
• Support calibration sessions and contribute to rubric design for large language model evaluation
  
  

Required Qualifications

• Mid-Senior experience in data labeling/data annotation/AI evaluation with strong accuracy and throughput
• Demonstrated discipline in QA evaluation, guideline adherence, and measurable quality targets
• Familiarity with NLP and/or computer vision annotation; comfort in remote, metrics-driven environments
  
  

Why This Role

Your work supports AI labs, tech startups, BPOs, and annotation vendors by delivering reliable labeled data and evaluation signals that improve model performance.

Apply with examples of guideline-driven work and data quality ownership.