Linguist III

Summary: We are looking for a skilled Linguistic Engineer to join our team to build, maintain, and analyze datasets powering LLM powered features. In this role, you will be instrumental in building and assessing the quality of data processed by our LLM production systems. Using new and existing data quality workflows and pipelines, you will collaborate closely with a cross functional team of engineers, research scientists, project managers, and data scientists to build datasets for, report on, and generally guide improvements on our LLM powered features, ensuring their accuracy and reliability in smart glasses applications.

Job Responsibilities:
• Aggregate cross-functional requests and translate requests into actionable, high quality, datasets via synthetic data collections and on live user traffic.
Deliver analytics, statistics, and model performance results on datasets.
• Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
• Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
• Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
• Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
• Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.

Skills:
• Basic Python, basic SQL with strong desire to grow required for this position. Intermediate level preferred.
• Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
• Ability to analyze numerical rating results and draw conclusions based on data.
• Basic stats / math for data analysis.
• Written and oral communication skills necessary for communicating on project milestones and for reporting findings .

Education/Experience:
• Bachelor’s degree in Linguistics, Computational Linguistics, Speech Science, or related field OR graduate degree in linguistics OR industry similar experience required.
• Master’s degree or beyond preferred OR equivalent industry experience.
• Additional learning via Coursera, Udemy, or other online resources is great too.


This posting is for a contract assignment with Tundra Technical Solutions to provide services to Meta.

The pay range that Tundra in good faith reasonably expects to pay for this position is $42.94/hour - $53.68/hour.

Tundra’s benefits offering includes optional medical, dental, vision, retirement benefits, up to 15 Days PTO per annum and a New Child Benefit.

Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.

The Meta CWX Program is enabled by a cutting-edge software platform called TalentNet that leads the contingent labor world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.

At Meta, we are constantly iterating, solving problems, and working together to connect people all over the world. That’s why it’s important that our workforce reflects the diversity of the people we serve. Hiring people with different backgrounds and points of view helps us make better decisions, build better products, and create better experiences for everyone.

We give people the power to build community and bring the world closer together. Our products empower more than 3 billion people around the world to share ideas, offer support, and make a difference.

This posting is for a contract assignment with Tundra Technical Solutions to provide services to Meta. Please note that this is not a full-time employment opportunity. Candidates selected for this role will be engaged as contractors for the specified duration of the project. For any inquiries regarding the terms of the contract or engagement, please contact Tundra Technical Solutions directly.

Salary : $43 - $54