What are the responsibilities and job description for the Cloud Data Engineer position at CG Infinity?
Job title: Cloud Data Engineer
Years of experience: 3 yrs.
Full-time opportunity
About the role:
CG Infinity is looking for a highly skilled Cloud Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, implementing, and managing cloud-based data solutions. You will be responsible for developing and maintaining scalable data pipelines, optimizing data storage, and ensuring data security and compliance. Your role will involve collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Responsibilities:
• Design and implement cloud-based data solutions.
• Develop and maintain scalable data pipelines.
• Optimize data storage and retrieval processes.
• Ensure data security and compliance with industry standards.
• Collaborate with data scientists and analysts to understand data requirements.
• Monitor and troubleshoot data pipeline issues.
• Implement data quality and validation processes.
• Automate data workflows and processes.
• Manage cloud resources and optimize costs.
• Develop and maintain ETL processes.
• Implement data governance policies.
• Ensure high availability and disaster recovery of data solutions.
• Perform data migration and integration tasks.
• Collaborate with cross-functional teams to deliver data solutions.
• Conduct performance tuning and optimization of data solutions.
• Provide training and support to end-users.
Desired Skills and Experience:
• Bachelor’s degree in computer science, Information Technology, or related field.
• 3 years of experience in cloud data engineering – Azure SQL, CI/CD, Azure Data factory, Cloud infrastructure, Data architecture, Database design, Azure ARM Templates, Terraform.
• Hands on in writing complex queries, triggers, functions, packages, and procedures.
• Proficiency in cloud platforms such as AWS, Azure, or Google Cloud.
• Strong programming skills in Python, Java, or Scala.
• Knowledge of SQL and NoSQL databases.
• Familiarity with data warehousing concepts and technologies.
• Experience with ETL tools and processes.
• Strong understanding of data security and compliance.
• Knowledge of data governance and data quality best practices.
• Experience with version control systems like Git.
• Ability to write clean, maintainable, and efficient code.
• Experience with monitoring and logging tools.
• Familiarity with machine learning and AI concepts is a plus.
Years of experience: 3 yrs.
Full-time opportunity
About the role:
CG Infinity is looking for a highly skilled Cloud Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing, implementing, and managing cloud-based data solutions. You will be responsible for developing and maintaining scalable data pipelines, optimizing data storage, and ensuring data security and compliance. Your role will involve collaborating with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
Responsibilities:
• Design and implement cloud-based data solutions.
• Develop and maintain scalable data pipelines.
• Optimize data storage and retrieval processes.
• Ensure data security and compliance with industry standards.
• Collaborate with data scientists and analysts to understand data requirements.
• Monitor and troubleshoot data pipeline issues.
• Implement data quality and validation processes.
• Automate data workflows and processes.
• Manage cloud resources and optimize costs.
• Develop and maintain ETL processes.
• Implement data governance policies.
• Ensure high availability and disaster recovery of data solutions.
• Perform data migration and integration tasks.
• Collaborate with cross-functional teams to deliver data solutions.
• Conduct performance tuning and optimization of data solutions.
• Provide training and support to end-users.
Desired Skills and Experience:
• Bachelor’s degree in computer science, Information Technology, or related field.
• 3 years of experience in cloud data engineering – Azure SQL, CI/CD, Azure Data factory, Cloud infrastructure, Data architecture, Database design, Azure ARM Templates, Terraform.
• Hands on in writing complex queries, triggers, functions, packages, and procedures.
• Proficiency in cloud platforms such as AWS, Azure, or Google Cloud.
• Strong programming skills in Python, Java, or Scala.
• Knowledge of SQL and NoSQL databases.
• Familiarity with data warehousing concepts and technologies.
• Experience with ETL tools and processes.
• Strong understanding of data security and compliance.
• Knowledge of data governance and data quality best practices.
• Experience with version control systems like Git.
• Ability to write clean, maintainable, and efficient code.
• Experience with monitoring and logging tools.
• Familiarity with machine learning and AI concepts is a plus.
