What are the responsibilities and job description for the LLM Evaluation Engineer position at Cynet Systems?
We are looking for LLM Evaluation Engineer for our client in Los Angeles, CA
Job Title: LLM Evaluation Engineer
Job Location: Los Angeles, CA
Job Type: Contract
Job Overview:
Pay Range $65hr - $70hr
Requirement/Must Have:
- Senior-level engineering or software development experience.
- Demonstrated, hands-on experience with Claude (Anthropic) tooling and APIs.
- Strong background in API integration, developer tooling, and CLI-based workflows.
- Experience evaluating AI/LLM platforms in an enterprise environment.
Responsibilities:
- Evaluate Claude for Desktop capabilities, including Cowork, Code, CLI, and APIs.
- Conduct hands-on testing, prototyping, and technical validation.
- Assess integration patterns, security considerations, and scalability.
- Provide clear findings, recommendations, and technical feedback.
Nice to Have:
- Experience with AI developer platforms, copilots, or agent frameworks.
- Familiarity with desktop application integrations and enterprise controls.
Salary : $65 - $70