What are the responsibilities and job description for the Data Engineer position at Stellar IT Solutions?
Data Engineer
Richfield, MN 55423 (Local - Hybrid 2 Days/Week)
12 Months Contract
Project Description:
You will be part of the Myads reporting team responsible for building the measurement, reporting, and insights platform that powers Ads and the broader Retail Media Network. In this role, you will design, develop, and maintain scalable, reliable, and high-performance data solutions that enable advertisers, merchants, and internal teams to measure campaign performance and business impact.
As a Developer, you will build and enhance data pipelines, APIs, and cloud-based services on Google Cloud Platform (Google Cloud Platform) while contributing to the architecture and implementation of measurement platforms. You will collaborate closely with Product Management, Ads Engineering, Analytics, Data Science, and other cross-functional teams to deliver high-quality solutions that meet business needs and support growth objectives. You will participate in the full software development lifecycle, including design, implementation, testing, deployment, and ongoing optimization of data and measurement systems. This role is hybrid, which means you will work some days on site at the client's location and some days virtually from home.
Position Summary/Job Description:
Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.
Skills Overview:
SQL (5 years)
Apache Airflow (Cloud Composer) (3 years)
Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3 years)
Python (5 years)
Big Data (warehousing/processing concepts, performance)(5 years)
Postgres (3 )
Experience
Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
Build ELT/ETL on Google Cloud Platform services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
Integrate Postgres sources/targets
Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.
What are some preferred/nice to have skills the manager is looking for?
Who has worked in ads domain.
Should be able to talk to stakeholders and understand the problem and solve it efficiently
Preventing data quality issues before they impact users.
Prioritizing projects and handling multiple requests.
Salary : $50 - $55