What are the responsibilities and job description for the Data Engineer position at BizTek People, Inc. | APA International Placement Consultants?
Overview
As a Data Engineer within North America Supply
Chain, you will be a key member of a growing and passionate group focused on
collaborating across business and technology resources to drive forward key
programs and projects building enterprise data & analytics capabilities
across the enterprise.
Primary Responsibilities
• Good understanding and application of modern
data processing technology stacks. For example, AWS, Snowflake, SQL, Airflow,
SQOOP, DMS, Spark, and building out performant data consumption layers.
• Design and build product features in
collaboration with business and IT.
• Design reusable components, frameworks,
libraries like User Defined Functions.
• Build continuous integration and test-driven
development environment.
• Performance/scalability tuning, algorithms and
computational complexity.
• Manage large data sets that are updated multiple
times per day.
• Participate in an Agile / Scrum methodology to
deliver high - quality software releases every 2 weeks through Sprints.
• Troubleshoot production support issues post -
deployment and come up with solutions as required.
Preferred Experience
• A Bachelor's degree in Business, Information
Technology or related field.
• 2 years’ experience in a professional
organization collaborating across multiple functions.
• Familiarity with Agile project delivery methods.
• Experience with AWS components and services
(E.G. EC2, EMR, S3, and Lambda).
• Experience with Jenkins, Bitbucket/GitHub and
scheduling tools like Airflow.
• Strong programming, Python, shell scripting and
SQL.
• Good understanding of file formats including
JSON, Parquet, Avro, and others.
• Experience with data warehouses/RDBMS like Oracle,
Teradata, Snowflake.
• Experience with data warehousing, dimensional
modeling and ETL development.
• Demonstrable ability to quickly learn new tools
and technologies.
• Exceptional interpersonal and communication
skills (written and verbal).