What are the responsibilities and job description for the Databricks & Azure position at Apex 2000?
Key Responsibilities
- Design, build, and maintain data pipelines using Azure Databricks
- Perform data ingestion, transformation, and processing for enterprise data platforms
- Work closely with onsite client teams and stakeholders to understand data requirements
- Support data engineering workloads aligned to DNA (Data & Analytics) programs
- Collaborate with offshore teams, as applicable, to ensure endtoend delivery
Required Technical Skills
- Databricks strong handson experience (mandatory)
- Azure Data Engineering stack
- Azure Databricks
- Azure data services
- Strong foundation in Data Engineering concepts
- Ability to work independently in an onsite client environment
MUST to have
- Willingness to relocate or work onsite in Ann Arbor, MI
- Ability to join quickly due to urgent client demand
- Strong communication skills for onsite coordination
Client is primarily looking for below aspects.
- Databricks certification
- Hands on exp with 2-3 projects with Databricks
- Scenarios based questions that checks candidates analytical ability and skills to demonstrate the expertise
- Mid advance level of Databricks Dev skills along with Issue debugging skills
Sample questions:
- explain project
- how do u handle historic data and incremental data?
- production support exp and scenario of resolving job failure?
- how do u ingest large volume of data from source?
- what tools and connectors are used?
- role and contribution in your project?
- real time streaming exp?
- exp in DLT/ lake flow?
- design pipeline for ingesting csv files from third party into bronze and silver layer
- managing multiple tasks in project?
Salary : $48 - $50