What are the responsibilities and job description for the Databricks Lead position at Alpha Silicon?
Job Details
Job Description:
Primary Skills: Databricks, Pyspark
- Proficiency in PySpark and Databricks (Delta Lake, clusters, jobs).
- Experience is architecting designs for integrating DBX with
- different application like Sales Force & MDM etc
- Different tool like Collibra etc
- Hands-on with Apache Airflow (DAG design, monitoring).
- Strong in AWS services: S3, EC2, Lambda, IAM.
- Strong SQL and Python for transformations and orchestration.
- Knowledge of Lakehouse architecture (Delta Lake) and data modeling.
- Experience in ETL/ELT and data warehousing best practices.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.