What are the responsibilities and job description for the Cloud Data Engineer position at Hudson Manpower?
Job Summary
We are looking for an experienced Cloud Data Engineer to design, build, and maintain scalable data infrastructure. The ideal candidate will have strong expertise in modern data platforms, cloud technologies, and data pipeline development.
Key Responsibilities
Design, develop, and maintain robust data pipelines
Build and optimize data infrastructure on cloud platforms
Work with Databricks for data processing and analytics
Implement and manage ML workflows using MLflow
Integrate data solutions with Snowflake
Ensure data quality, reliability, and performance
Collaborate with cross-functional teams for data-driven solutions
Required Skills & Qualifications
Strong experience in data engineering and pipeline development
Hands-on experience with Databricks
Experience with Azure cloud services
Proficiency in MLflow for ML lifecycle management
Experience with Snowflake data warehouse
Strong SQL and data modeling skills
Preferred Qualifications
Experience with big data technologies (Spark, Delta Lake)
Knowledge of CI/CD for data pipelines
Understanding of data governance and security