Data Engineer III (Large Language Models)

About Catalytic Data Science (CDS):

Catalytic Data Science is a groundbreaking cloud R&D platform designed to integrate volumes of scientific resources, data, and analytic tools while providing the ability to network with colleagues in one secure and scalable environment. By enabling R&D teams to work more collaboratively and improving productivity company-wide, the Catalytic platform helps teams achieve key R&D milestones faster and with greater accuracy. Our customers are passionate about making the world a better place, and we are inspired by the opportunity to help them.

The Role

You are a Data Engineer with experience in processing terabytes of data and working with large language models (LLMs). You have experience in creating and automating scalable, fault-tolerant, and reproducible data pipelines for natural language processing (NLP) using Amazon AWS technologies. You will design and implement data ingestion, processing, and storage solutions that can handle massive amounts of text data from various sources. You are interested in helping to create a platform completely built on top of AWS. You are eager to join a team of Life Scientists and Software Engineers that believe the brightest minds in research should have the best tools to drive innovation.

What You’ll Do

• Build, test, and operate automated Extract, Transform, and Load (ETL) pipelines that process terabytes of text data nightly
• Develop service frontends around our various backend data stores (AWS Aurora, MySQL, Elasticsearch, S3)
• Rapidly protype, test, and deploy data pipelines for LLMs using AWS.
• Collaborate with data scientists and NLP engineers to understand the data requirements and specifications for LLMs and related tasks such as text summarization, translation, and question answering.
• Optimize the performance, reliability, and scalability of the data pipelines and LLMs by applying best practices and techniques such as data partitioning, caching, compression, and monitoring.
• Ensure the quality, integrity, and security of the data by implementing data validation, cleaning, and governance policies and procedures.
• Research and evaluate new technologies and methods for data engineering and LLMs and stay updated with the latest trends and developments in the field.
• Participate in data architecture and engineering decisions, bringing your strong experience and knowledge to bear.

Qualifications

• Bachelor's degree or higher in computer science, engineering, or a related field.
• 3 years of experience in data engineering, preferably with large-scale text data and LLMs and 6 years of any software engineering experience (including data engineering).
• Proficient in Python 3 or Java, preferably both.
• Experience with data modeling, ETL, and data warehouse design and implementation.
• Expertise with ETL schedulers such as Airflow, Prefect or similar frameworks.
• Familiar with LLMs and NLP concepts and frameworks such as Transformers, BERT, GPT, PaLM, and LLaMA.
• Day-to-day experience using AWS technologies such as Lambda, ECS Fargate, SQS, & SNS
• Experience extracting, processing, storing, and querying of petabyte-scale datasets
• Familiarity with building and using containers
• Familiarity with event-based microservices
• Strong communication, collaboration, and problem-solving skills.

Core Skills:

1. ETL Processes
2. Data Modeling and Database Design
3. Proficiency in Large Language Models
4. Data Pipeline Optimization
5. Cross-functional Collaboration
6. Problem-solving and Analytical Skills

Nice-to-Haves

• Prior experience with Elasticsearch (custom development and/or administration) is a huge plus
• Knowledge of Graph databases

What Do We Love in Team Members?

Your specialization is less important than your ability to learn fast and adapt to shifting technologies. We’re especially fond of people who:

• Focus on customer’s needs and our company’s goals, not just writing code
• Iterate until customers love what you’ve built
• Self-start and initiate
• Self-organize
• Strive to grow personally and professionally, beyond just expanding technical abilities
• Love to experiment with new technology and share knowledge with the team

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.