What are the responsibilities and job description for the AWS Data Engineer with Airflow (no C2C) position at Theoris?
Job Title: AWS Data Engineer (No c2c)
Location: Remote
Industry: Pharmaceutical
JOB DESCRIPTION: We are seeking a skilled AWS Data Engineer with AIRFLOW experience to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining robust and scalable data pipelines that ingest, process, and deliver data from various sources into our data lake and subsequent data warehouse. This role is crucial for enabling our analytics, data science, and operational teams to leverage high-quality data. A background in the biological or life sciences domain is preferred, as you will work with complex scientific datasets.
RESPONSIBILITIES:
- Data Pipeline Development: Design, build, and maintain data pipelines for ETL (Extract, Transform, Load) and ELT processes using Python and Apache Airflow for orchestration.
- Cloud Infrastructure: Utilize a range of AWS services to manage and optimize data infrastructure, including Amazon S3 for the data lake, and other services for processing and storage.
- Data Modeling and Warehousing: Design and implement data models for our data warehouse, ensuring data is organized, accessible, and optimized for analytical queries.
- Database Management: Work with PostgreSQL and other relational or non-relational databases to manage data storage and retrieval efficiently.
- SQL Expertise: Write and optimize complex SQL queries for data extraction, transformation, and analysis.
- Data Quality and Governance: Implement and maintain data quality checks and validation processes within pipelines to ensure the accuracy and integrity of our data assets.
- Collaboration: Work closely with data scientists, analysts, and domain experts to understand data requirements and deliver tailored solutions.
- Automation: Automate manual data processes to improve efficiency and reduce potential errors.
- Biological Domain Focus (preferred): Ingest and process large, complex datasets typical in biological or life sciences, such as genomic data, experimental results, and research findings.
REQUIREMENTS:
- Bachelor's degree in Computer Science, Engineering, Bioinformatics, or a related technical field.
- Proven experience as a Data Engineer, with a strong portfolio of building and maintaining production data pipelines.
- Proficiency in Python and extensive experience with SQL.
- Demonstrated experience with AWS, including services like S3, RDS, and optionally, Glue or other processing tools.
- Hands-on experience orchestrating workflows with Apache Airflow.
- Expertise in data modeling techniques for both data lakes and relational databases (PostgreSQL).
- Experience with version control systems like Git.
- Excellent problem-solving skills and a proactive, detail-oriented approach.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
Best-In-Class-Benefits
We are in the people business; treating people right is our ONLY priority. Theoris Services consultants are full-time employees with full benefits, including:
- Robust Health Insurance
- 401(k) plan
- PTO accrual
- Paid holidays
- Excellent cash-based referral program
About Theoris: Our goal is to Fuel Your Career! As a Theoris team member, you join a culture based on people-centered values and an environment that fosters both personal and professional growth. We build long-term relationships with our clients and our consultants. With over 30 years of building strong relationships in the industry, we’re uniquely positioned to make the right connections. This knowledge is used to find the right job placement. Our recruiting teams are experts dedicated to the information technology and engineering staffing space and are highly respected by our client base.