JOB DESCRIPTION:

Role: Cloud Data Lead

Skills: ADF, ADB, Python, PySpark, Sql

Azure Data Factory

Azure Databricks

Job Description:

• Will be responsible for the design, development, and administration of data management solutions that align with the business needs of the organization.
• Design relational databases to support business enterprise applications and physical data modeling according to project requirements for data acquisition and security as well as customer-defined deliverables.
• Has at least 4-5 years of experience in Data Engineering, especially ADF, Python, PySpark, SparkSql, Sql and Databricks programming and cloud data ingestion, data pipelines handling structured and semi-structured data formats like JSON, XML.
• Must have experience in building ETL/ELT Data warehouses/lakes for Real time, event driven scenarios.
• Create, build and lead the implementation of strategies and roadmaps for enterprise and department level data projects.
• Collaborate with internal and external personnel, including senior management, system architects, software developers, database administrators, design analysts and information modeling experts to determine project requirements and capabilities, and strategize development and implementation timelines.
• Work alongside data engineers to develop comprehensive automated ELT/ELT workflows that align with database design.
• Manage source data access security, configure authentication and authorization, manage and enforce data policies and standards.
• Document and organize findings including data retrieval, stand up libraries.
• Good to have Insurance Domain language understanding.

Qualification Requirements:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Good to have below certifications:

• Microsoft Certified Azure Data Fundamentals (DP 900)
• Azure Solution Architect (AZ 305)"