What are the responsibilities and job description for the Staff Applied Scientist position at Harnham?
Staff Applied Scientist – LLM Suite | Investment Banking | Onsite in Palo Alto, CA
~$450-550k TC including base salary, bonus, and equity grant
Our client, a top-tier global investment bank, is expanding its enterprise AI platform and is looking for a Staff Applied Scientist to join their LLM Suite team. This is a production-focused role where the candidate will be building AI systems actively used by 200,000 employees worldwide.
This person will own the development of text-to-code pipelines, agentic workflows, database interaction layers, and intelligent chatbots across one of the most complex financial institutions in the world.
Responsibilities
- Designing and deploying LLM-powered features including text-to-code, workflow automation, and AI agent frameworks
- Building and integrating multimodal LLM systems via API-based architectures
- Developing scalable, distributed, and multi-threaded applications using frameworks like Ray, Horovod, and DeepSpeed
- Owning full end-to-end software development cycles from prototyping through production deployment
- Architecting and managing containerized infrastructure using Kubernetes and AWS Fargate
- Building database interaction layers and backend services that support enterprise-scale AI products
- Collaborating cross-functionally with engineering, product, and business teams to translate complex requirements into working systems
Requirements
- PhD in Computer Science, Machine Learning, Applied Mathematics, or a related technical field (required)
- Deep hands-on experience with LLM integrations, both API-based and fine-tuning workflows
- Proven experience with multimodal LLMs and cutting-edge foundation models
- Strong background in distributed systems and scalable application design using Ray, Horovod, DeepSpeed, or equivalent
- Production experience with AWS, Kubernetes, and Fargate
- End-to-end software engineering experience, including design, development, testing, and deployment
- Experience building chatbots, agentic systems, or AI-assisted developer tooling is a strong plus
Salary : $275,000 - $325,000