Company DescriptionDerex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.Job Description Skills & Experience Should have 10 years of experience with last 4 years in implementing Cloud native end-to-end Data Solutions from ingestion to consumption to support variety of needs such as Modern Data warehouse, BI, Insights and AnalyticsShould have experience in architecture and implementing End to End Modern Data Solutions using Azure and advance data processing frameworks like Databricks etc.Strong hands on in Pyspark and Apache Spark.Build Orchestration Layer in Databricks Workflows.Build CICD for Databricks in Azure Devops.Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems.. etc into pysparkStrong knowledge of cloud native data platform architectures, data engineering and data managementGood knowledge of popular database and data warehouse technologies from Snowflake Microsoft Azure SQL Data WarehouseDemonstrated knowledge of data warehouse concepts. Strong understanding of Cloud native databases, columnar database architecturesAbility to work with Data Engineering teams, Data Management Team, BI and Analytics in a complex development IT environment.Good appreciation and at least one implementation experience on processing substrates in Data Engineering - such as ETL Tools, Kafka, ELT techniquesData Mesh and Data Products designing, and implementation knowledge will be an added advantage. QualificationsTop Skills: Azure Data Bricks, ADF Finance domain is must. Additional InformationAll your information will be kept confidential according to EEO guidelines.