What are the responsibilities and job description for the Lead Data Enigneer position at Bridgetown Consulting Group Inc?
Role: Data Engineer- Lead
Location: Malvern, PA (HYBRID)
Responsibilities
- Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics
Qualifications:
12 years of experience
· Python, SQL, AWS Services
· Strong, hands-on Data Engineers
· Comfortable working end-to-end (ingestion, transformation, delivery)
· Hands-on experience with AWS cloud services, including EMR, S3, EC2, Lambda, SNS, Step Functions, Glue, and ECS, for building, orchestrating, and operating scalable data pipelines and data platforms.
· Strong programming expertise in Python and SQL, with hands-on experience in Big Data technologies such as Apache Spark, Spark SQL, and PySpark to efficiently process and transform large-scale, complex datasets in distributed environments.
· Experience working in an Agile, CI/CD-driven environment, leveraging tools such as Git, Bitbucket, Bamboo, and JIRA for version control, automated builds, deployments, and sprint execution.
· Minimum of five years data analytics, programming, database administration, or data management experience.
· Undergraduate degree or equivalent combination of training and experience.
Salary : $60 - $65