What are the responsibilities and job description for the Databricks SME W2 Contract position at Nasscomm, Inc.?
Job Details
Job Title:- Databricks SME
Location:- Washington DC(3 day onsite in a week)
Duration:- 12 months
Required Skills: -
At least one Databricks Professional Certificate
Hands on development experience (i.e., need to be hands on keyboard)
Good customer presence and ability to answer a variety of Databricks questions
GitHub and CI/CD experience is a plus
Day-to-day Responsibilities:-
Design, develop, and maintain data engineering pipelines in Databricks using PySpark or SQL
Experience developing streaming pipelines using Databricks Autoloader or Structured Streaming
Data Modelling experience designing Delta Lake tables and the Bronze-Silver-Gold Medallion Architecture
Understanding of Spark for performance optimizations including Delta Lake optimizations
Experience with cloud service provider (AWS/Azure/Google Cloud Platform) services used in Databricks implementations (e.g., AWS S3, Azure ALDS, IAM , etc., AWS EC2, Azure VM)
Triaging ad hoc questions across the Databricks product suite
Certifications(if any):-
Databricks Certified Data Engineer Associate
Databricks Certified Machine Learning Associate
Databricks Certified Data Engineer Professional
Databricks Certified Machine Learning Professional
