What are the responsibilities and job description for the Senior Databricks Data Engineer position at Numentica LLC?
Senior Data Engineer (AI & Databricks)
Location: Las Vegas, NV / Calabasas, CA
Work Model: Onsite (4 days/week)
Employment Type: Full-Time
Work Authorization: U.S. Citizens (USC) & Green Card Holders (GC) only
Required Skills
- Databricks
- AI/ML
- Python
- Azure API Development
- ETL Pipeline Development
- DevOps & CI/CD
- Apache Spark
- SQL
- Azure Data Services
Key Responsibilities
- Design and develop scalable batch and real-time data pipelines.
- Build robust data ingestion, transformation, and analytics workflows.
- Develop intelligent APIs and data products to support AI and business applications.
- Ensure high data quality, reliability, and performance.
- Collaborate with cross-functional teams to deliver scalable data solutions.
- Support Azure-based data platforms for BI and AI/ML initiatives.
- Participate in code reviews and implement CI/CD best practices.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related technical field.
- 10 years of experience in Data Engineering.
- Strong expertise in Databricks, Apache Spark, and cloud-based data platforms.
- Proficiency in Python and SQL.
- Hands-on experience with Azure data services and REST API development.
- Experience with DevOps, CI/CD pipelines, and Agile methodologies.