What are the responsibilities and job description for the Sr. Data Engineering -Databricks (Onsite) position at SumasEdge Corporation?
Databricks Lakehouse Engineering
- Design and implement Databricks Lakehouse architecture (Bronze / Silver / Gold)
- Build scalable batch and streaming pipelines using PySpark, Spark SQL
- Leverage Delta Lake for reliability, versioning, and performance
- Optimize compute usage and cost in line with enterprise cloud efficiency goals