Roles and Responsibilities:

• You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
• You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
• You have an experience working collaboratively in cross-functional teams and manage multiple projects simultaneously.

Critical Skills to Possess:

• Advanced working knowledge and experience with relational and non-relational databases.
• Solid understanding of relational and NoSQL databases, data modeling, and database management systems (DBMS)
• Experience building and optimizing Big Data pipelines, architectures, and datasets.
• Strong analytic skills related to working with structured and unstructured datasets.
• Experience in Python, Kubernetes, Azure, Snowflake, CI/CD
• Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
• Strong experience in Azure Data Factory, Databricks, Event Hub, Azure Synapse.
• Azure DevOps experience to deploy the data pipelines through CI/CD.