Role: Lead Data Engineer

Location: Cincinnati, Ohio

Duration: Long term

Required Skills

Azure, DataBricks, ADF, Unity Catalogue

Additional Skills

Job Description

• [Lead] Data Engineer
• Tooling & Platforms include, but not limited to: Azure Databricks, Databricks Workflows, Databricks Delta Live Tables, Databricks Unity Catalog, Delta Lake, Azure Data Factory (ingestion & orchestration), ADLS Gen 2, Azure SQL Database, Azure CosmosDB, Neo4j, Apache Spark, PySpark, Spark SQL, SQL, PL/SQPl, Oracle Database Technologies (19c), Kafka, REST APIs, Alation, Terraform
• [Lead] Spearheads planning, design, development, execution, and monitoring of complex data integrations to support project delivery.
• [Lead] Mentors less experienced analysts on proper standards/techniques to improve their accuracy and efficiency.
• [Lead] Knowledge of CI/CD practices for Azure Data Factory & Azure Databricks to implement and streamline CI/CD processes with engineering teams.
• [Lead] Nice to have: Databricks Certified Data Engineer Professional
• Nice to have: Databricks Certified Data Engineer Associate
• Familiarity with ETL/ELT in Databricks and with Medallion architecture
• Implement & perform unit testing, system integration testing, regression testing and assist with user acceptance testing.
• Adhere to established standards and best practices and provide input for improvement of those processes.
• Self-motivated team player who can work with minimal supervision and can adapt to a quickly changing environment.
• Ability to work on multiple tasks simultaneously, ability to switch between tasks and work in conflicting priorities.
• Must have strong knowledge of Software Development Life Cycle including requirement analysis, design, development, testing, and implementation. Hands on experience in performance tuning of sources, targets, mappings, and sessions.

Thanks,

Sudhanshu Srivastava

Email -