What are the responsibilities and job description for the Data Engineer (Databricks on AWS) position at Optime Tech?
Data Engineer (Databricks on AWS)
Location: Chicago, IL (Local Candidates Only)
Work Arrangement: Mostly Remote (Must be available for an onsite interview and occasional meetings in Downtown Chicago)
Duration: 6-Month Contract-to-Hire
Employment Type: W2 Opportunity Only (No C2C / No 1099)
Work Authorization: Applicants must be legally authorized to work in the United States. Visa sponsorship is not available for this position.
Job Summary
We are seeking an experienced Data Engineer with strong expertise in Databricks on AWS to design, build, and optimize enterprise-scale data engineering solutions. The ideal candidate will have extensive experience developing scalable data pipelines, implementing modern cloud-based data architectures, and working with large-scale distributed data processing technologies.
Candidates must already be local to the Chicago, IL area, as the role requires availability for an onsite interview and occasional meetings in Downtown Chicago.
Required Qualifications
- 10 years of IT experience with a strong Data Engineering background.
- 4–6 years of recent hands-on experience designing, building, and scaling enterprise data pipelines.
- Strong hands-on experience with Databricks, including:
- Apache Spark
- Delta Lake
- Unity Catalog
- Strong experience with AWS services, including:
- Amazon S3
- IAM
- AWS Networking
- Strong proficiency in:
- SQL
- Python
- Data Modeling
- Distributed Processing
- Experience building modern cloud-based Data Engineering solutions.
- Strong experience developing ETL pipelines and enterprise data integration solutions.
- Experience working in Agile development environments.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Delta Live Tables (DLT)
- Databricks SQL
- Workflow Orchestration
- Apache Airflow
- CI/CD
- DevOps
- Terraform
- Lakehouse Architecture
- Medallion Architecture (Bronze, Silver, Gold)
Additional Information
- Local candidates to the Chicago, IL area only.
- Must be available for an onsite interview in Downtown Chicago.
- This is a W2 Contract-to-Hire opportunity
Salary : $70 - $75