What are the responsibilities and job description for the Data Engineer position at Oscar Technology?
About the Role
We are seeking an experienced Data Engineer to design, build, and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data.
The ideal candidate will have strong hands-on experience with SQL and Python, modern cloud data platforms, and Lakehouse/Medallion architectures. This is a hands-on engineering role focused on building reliable data pipelines, processing large datasets, and developing scalable data solutions.
Key Responsibilities
- Design, develop, and maintain scalable cloud data pipelines for high-volume data.
- Build batch and real-time data processing solutions using Spark/PySpark, Kafka, and Airflow.
- Develop data ingestion, transformation, and integration workflows using SQL and Python.
- Design and implement Lakehouse and Medallion architecture solutions.
- Work with cloud data platforms including Databricks, Snowflake, AWS, and/or Azure.
- Build and optimize ETL/ELT pipelines for performance, scalability, and reliability.
- Process and integrate large volumes of manufacturing, operational, and IoT data.
- Troubleshoot data pipeline issues and improve data quality and performance.
- Collaborate with engineering, analytics, and business teams to develop production-ready data solutions.
Qualifications
- 5 years of professional Data Engineering experience; additional experience is welcome for the right candidate.
- Strong proficiency in SQL and Python.
- Hands-on experience building scalable data pipelines.
- Experience with Lakehouse and/or Medallion architectures.
- Experience with Databricks, Snowflake, AWS, and/or Azure.
- Strong experience with Apache Spark and/or PySpark.
- Experience with Apache Kafka and/or other streaming technologies.
- Experience with Apache Airflow or other data orchestration tools.
- Experience working with Delta Lake or similar data lake technologies.
- Strong understanding of ETL/ELT, data integration, and data transformation.
Benefits
Full-time employees receive a benefits package, including:
- Medical, dental, and vision coverage
- 100% company contribution toward employee medical coverage
- 80% company contribution toward medical coverage for immediate dependents
- 15 days of PTO
- 10 paid holidays, including 8 fixed holidays and 2 floating holidays
- 401(k) enrollment with employee contributions
- Relocation assistance
Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.
Salary : $137,000 - $138,000