What are the responsibilities and job description for the Databricks & Azure position at Jobs via Dice?
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Apex 2000, is seeking the following. Apply via Dice today!
Key Responsibilities
Key Responsibilities
- Design, build, and maintain data pipelines using Azure Databricks
- Perform data ingestion, transformation, and processing for enterprise data platforms
- Work closely with onsite client teams and stakeholders to understand data requirements
- Support data engineering workloads aligned to DNA (Data & Analytics) programs
- Collaborate with offshore teams, as applicable, to ensure endtoend delivery
- Databricks strong handson experience (mandatory)
- Azure Data Engineering stack
- Azure Databricks
- Azure data services
- Strong foundation in Data Engineering concepts
- Ability to work independently in an onsite client environment
- Willingness to relocate or work onsite in Ann Arbor, MI
- Ability to join quickly due to urgent client demand
- Strong communication skills for onsite coordination
- Databricks certification
- Hands on exp with 2-3 projects with Databricks
- Scenarios based questions that checks candidates analytical ability and skills to demonstrate the expertise
- Mid advance level of Databricks Dev skills along with Issue debugging skills
- explain project
- how do u handle historic data and incremental data?
- production support exp and scenario of resolving job failure?
- how do u ingest large volume of data from source?
- what tools and connectors are used?
- role and contribution in your project?
- real time streaming exp?
- exp in DLT/ lake flow?
- design pipeline for ingesting csv files from third party into bronze and silver layer
- managing multiple tasks in project?