What are the responsibilities and job description for the Annotation Project Specialist position at Creospan Inc.?
Creospan is a growing tech collective of makers, shakers, and problem solvers, offering solutions today that will propel businesses into a better tomorrow. “Tomorrow’s ideas, built today!” In addition to being able to work alongside equally brilliant and motivated developers, our consultants appreciate the opportunity to learn and apply new skills and methodologies to different clients and industries.
******NO C2C/3RD PARTY, LOOKING FOR W2 CANDIDATES ONLY, must be able to work in the US without sponsorship now or in the future***
The location for this role is Burlingame, CA/Redmond, WA
Key Responsibilities
- Vendor Management & Delivery
- Oversee annotation vendor performance, ensuring timely and high-quality data deliveries.
- Track and report on vendor success metrics.
- Coordinate onboarding & certification of new raters.
- Guideline Implementation & Development
- Ensure correct implementation of annotation guidelines.
- Partner with researchers to develop, refine, and update annotation guidelines.
- Quality Assurance & Data Quality
- Uphold the researcher quality bar and high data quality standards.
- Oversee DQA (Double Quality Assurance) processes and success.
- Develop, review, and improve quality assurance processes.
- Manage DQA resources and reporting.
- Training & Coordination
- Organize and deliver annotator training sessions.
- Coordinate with annotation vendors for ongoing training and calibration.
- Reporting & Communication
- Report on annotation metrics and quality trends.
- Provide monthly written updates.
- Communicate expectations, progress, and changes with research and vendor stakeholders.
Skills:
Must Haves:
- 3 years' experience in annotation project management roles.
- Proven ability to write clear annotation guidelines and define KPIs for quality measurement.
- Experience training raters or annotators on guidelines and quality standards.
- Strong technical aptitude to navigate annotation UIs and communicate effectively with software engineers about pipeline issues.
- Excellent written and verbal communication skills, including the ability to document processes and report metrics clearly.
- Experience coordinating with vendors and cross-functional teams to ensure project success.
- Ability to work independently in a fast-paced, ambiguous environment.
Nice to Haves:
- Background or familiarity with software engineering concepts and troubleshooting.
