What are the responsibilities and job description for the Data Engineer position at Programmers.io?
One of our leading client is looking for Data Engineer in Harford CT
Technical/Functional Skills:
Strong skills in Python Programming
· Strong Experience in SQL
· Experience with data pipeline and workflow management tool: GCP Data Proc, Composser and GCS
· Strong experience in handling window function in SQL
· BigQuery Experience (may not be expert) · To work on data engineering solutions to leverage best practices and industry-leading tools and technologies to profile data, develop efficient ingestion, and build semantic data layers
Roles & Responsibilities:
· Support analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
· Support and monitor the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, and GCP ‘big data’ technologies. · Work with data and analytics experts to strive for greater functionality in our data systems.
· Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
· Developing, supporting and monitoring data pipelines.
· Work closely with client to discover needs, collect appropriate data, and deliver valuable data products. · Provide valuable insights from data sets quickly.
· Communicate complex findings and ideas in plain language and visualizations that is friendly to business and operational audiences.