Senior Data Labeling Specialist (Miami)

Senior Data Labeling Jobs in Miami (Remote)

Rex.zone is hiring a Senior Data Labeling Specialist to lead high-accuracy training data creation and evaluation for AI/ML systems. In this remote, full-time role, you will drive training data quality, annotation guidelines compliance, and large language model evaluation outcomes across NLP, computer vision, and content safety workstreams.

What You Will Do

• Perform advanced data labeling/data annotation across NLP, CV, and safety domains
• Execute RLHF tasks (preference ranking, rubric-based scoring, and justification writing)
• Run QA evaluation via sampling, audits, defect categorization, adjudication, and inter-annotator agreement
• Conduct error analysis and root-cause investigations on label noise and guideline gaps
• Improve annotation guidelines with examples, decision trees, and edge-case handling
• Collaborate with engineering/research stakeholders to align labels with downstream training objectives and evaluation metrics
  
  

Domains You May Work On

• NLP labeling (named entity recognition, intent, sentiment, taxonomy mapping)
• LLM evaluation (prompt evaluation, response grading, hallucination detection)
• RLHF preference datasets and safety alignment
• Computer vision annotation (bounding boxes, polygons, keypoints, segmentation, OCR)
• Content safety labeling (policy compliance, harmful content detection)
  
  

Required Qualifications

• Experience in data labeling/data annotation with QA evaluation ownership
• Strong written English and ability to apply consistent rubrics for LLM/prompt evaluation
• Ability to resolve ambiguous cases with clear reasoning and documented decisions
• Familiarity with annotation tools, audit workflows, and training data quality processes
• Comfort working remotely in a metric-driven production environment
  
  

Remote Work

Work is performed remotely while supporting teams and projects aligned to Miami and broader US operations.