Data Engineer

BridgeView is currently seeking a Data Engineer for one of our clients. If you love building and supporting technology solutions that make businesses successful, then read on for more details.

TITLE: Data Engineer

LOCATION: Remote

BENEFITS & PERKS: Medical, Dental & Vision on your first day, 4% match on 401(k), Life Insurance, Short & Long-Term Disability, employee perks, and more (detailed below).

OVERVIEW

Seeking a skilled Data Engineer to join a dynamic team responsible for building and maintaining a Data Lake. The team leverages AWS Redshift to consume and store data from various sources, making it available for both internal and external stakeholders. The core of the work revolves around establishing seamless system-to-system connections via ETL processes and transforming data files for integration into the Data Lake. The primary database is Redshift, supported by DynamoDB for configuration management and EMR as the processing framework. Additionally, Postgres is utilized as the database type, and Python scripts along with Lambda functions are key tools for data ingestion and transformation. The team operates in an Agile environment, following Scrum methodology with 2-week sprints. This role requires a comprehensive understanding of the full stack of technologies used, as team members are expected to contribute across all areas of the data management ecosystem.

HOW YOU WILL MAKE AN IMPACT

• Develop and maintain ETL processes to load data into the Data Lake using Python, Lambda functions, and other AWS services
• Design and implement data ingestion pipelines that handle various file types and formats, ensuring they are parsed and prepared for consumption
• Work with AWS Redshift to manage data storage and retrieval, ensuring optimal performance and data integrity
• Utilize EMR for data processing tasks and DynamoDB for configuration management
• Collaborate with team members in a full-stack environment, contributing to all aspects of data engineering from ingestion to storage
• Participate in Agile ceremonies, contributing to sprint planning, daily stand-ups, and retrospective meetings

EXPERIENCE REQUIRED

• 4 years of experience in data engineering
• 2 years of experience working with AWS Redshift and EMR
• Strong experience with AWS Lambda and Python for building data pipelines
• Experience with Postgres databases
• Knowledge of DynamoDB for configuration management
• Strong understanding of ETL processes and data lake architecture
• Familiarity with Agile/Scrum methodologies, particularly in a JIRA-managed environment.

BENEFITS

BridgeView makes it easy to say “yes” to joining our team, with national Medical, Dental, Vision, and Life Insurance coverage effective on your very first day. Our 401(k) is 4% matched and fully vested, and we offer voluntary benefits such as TelaDoc, Short & Long-Term Disability, Critical Illness, Accident, AD&D, Legal Shield, etc. We help you take care of your mind with a paid subscription to the Calm app, and your wallet with cashback available through thousands of vendors (Ace Hardware, Verizon, Overstock.com, and more).

ABOUT BRIDGEVIEW

BridgeView is a talent and technology consulting company that helps business leaders build exceptional technology teams and deliver complex projects with confidence.

Since 2005, BridgeView's tenured recruiting team has built a vast network of niche technologists and executive leadership candidates to help our clients solve their most complex talent challenges. Paired with strategic consulting services, BridgeView further delivers project collaboration in the areas of people, process, and technology.

This blended approach allows clients to adjust in real-time to align with their budgets while receiving Big 5 expertise to meet their objectives.

BridgeView. Within Sight.

We are an equal opportunity employer and value diversity. All employment decisions are made due to qualifications, merit, and business need. The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location.