What are the responsibilities and job description for the Data Engineer position at Shimento, Inc.?
Title: Data Engineer
Location: Carlsbad, CA / Tempe, AZ (Hybrid – 3 days onsite)
Duration: Full-Time
Job Summary
Our client is seeking a Data Engineer to design, build, and support modern cloud-based data platforms. The ideal candidate will have experience developing ELT/ETL pipelines, working with Google Cloud Platform or Azure, and supporting enterprise data solutions. This role will also contribute to cloud migration initiatives and next-generation AI-enabled data platforms.
Key Responsibilities
- Develop and maintain ELT/ETL pipelines using Airbyte, DBT, Google Cloud Platform/BigQuery.
- Build and orchestrate workflows using Prefect.
- Manage and optimize BigQuery datasets, performance, and access controls.
- Support migration of legacy Azure data pipelines to Google Cloud Platform.
- Monitor and troubleshoot data pipelines using cloud observability tools.
- Contribute to Infrastructure as Code using Terraform, Git, and CI/CD workflows.
- Collaborate with global teams to ensure reliable data delivery and maintain operational documentation.
Required Skills
- Strong experience with SQL and Python.
- Hands-on experience with ELT/ETL pipeline development.
- Experience with Google Cloud Platform or Azure cloud platforms.
- Proficiency with Git, code reviews, and version control.
- Ability to troubleshoot data issues and work independently in a distributed environment.
Preferred Skills
- Experience with DBT, Airbyte, Prefect, BigQuery, and Looker.
- Knowledge of Terraform and Infrastructure as Code.
- Exposure to Grafana, Azure Monitor, or Google Cloud Platform monitoring tools.
- Experience with BI tools such as Looker, Power BI, SAP Analytics Cloud (SAC), or OBIEE.
- Familiarity with SRE concepts, automation, and AI-assisted data workflows.