What are the responsibilities and job description for the Sr Data Engineer position at BizTek People, Inc. | APA International Placement Consultants?
Job Description
In this role, you will build and delivering scalable data and
analytics solutions in Supply Chain- Global Operations and Logistics and
Commercial space.
Job Duties
- Perform
analysis, design, development, and configuration functions as well as
define technical requirements for intermediate to complex data pipelines.
- Participate
with a team to perform analysis, assessment and resolution for defects and
incidents.
- Work
within guidelines set by the team to independently tackle well-scoped
problems.
- participate
in architecture and design discussions to deliver on business commitments
while delivering operational and engineering excellence.
- Participates
in quality assurance, testing, Observability, and dev ops practices.
- Seek
opportunities to expand technical knowledge and capabilities.
Requirements
Requirements
- 5 years of Software/Data engineering experience
- 4 years of building and maintaining Data Pipelines
- Strong demonstrable skills in two of the
following programming languages– Python, Scala or Java.
- Strong Experience in processing Big Data and
analyzing the data using Python, Spark, Databricks, Hadoop, Apache
Airflow, Hive & AWS.
- Strong Experience with AWS services like EMR,
S3, DynamoDb
- Should have experience in micro services.
- Experienced in unit, functional and automated testing.
- Experienced in CI/CD process – GIT Jenkins
- Well-versed with Agile methodology.
- Excellent verbal and written communication and
collaboration skills to effectively communicate with both business and
technical teams.
- Comfortable working in a fast-paced, results-oriented
environment