What are the responsibilities and job description for the Data Engineer position at Optomi?
This position will partner with analytics teams, Data Architects, business stakeholders, and IT teams to design, build, and maintain scalable data solutions. The role focuses heavily on developing data pipelines, preparing complex datasets, improving data quality, and supporting enterprise data warehouse and analytics initiatives.
What the Candidate Will Be Working On:
- Design, develop, and maintain scalable data and ETL pipelines
- Assemble, cleanse, and transform large datasets from multiple sources
- Develop and maintain data warehouse solutions and data models
- Work with stakeholders to gather and translate data requirements
- Build analytical and reporting solutions
- Automate manual data preparation and transformation processes
- Improve data quality, reliability, scalability, and system performance
- Develop testing strategies and validation processes
- Create technical documentation and project artifacts
- Support deployments, production applications, and incident resolution
- Work with senior engineers and architects on solution design and implementation
What we are looking for:
A hands-on Data Engineer with solid pipeline, ETL, SQL, data modeling, and data quality fundamentals. The strongest candidates will have experience in the Databricks Lakehouse ecosystem, particularly Delta Lake, DLT, Unity Catalog, Workflows, Medallion Architecture, and CI/CD.