What are the responsibilities and job description for the Data Engineer position at TechDoQuest?
Responsibilities:
- Design, develop, and implement data pipelines using Informatica Cloud to facilitate data integration and transformation.
- Collaborate with cross functional teams to gather requirements and translate them into technical specifications.
- Utilize AWS services to build scalable and secure data solutions.
- Implement and manage Snowflake data warehousing solutions to optimize data storage and retrieval.
- Monitor and troubleshoot data pipeline performance, ensuring data quality and reliability.
- Document data processes, architectures, and workflows for future reference and compliance.
- Stay updated with industry trends and best practices in data engineering and cloud technologies.
Mandatory Skills:
- Strong expertise in Informatica Cloud is a deal breaker.
- Proficient in AWS services such as S3, EC2, Lambda.
- Experience with Snowflake data warehousing solutions.
- Solid understanding of ETL processes and data modeling.
- Familiarity with SQL and database management systems.
Preferred Skills:
- Experience with data visualization tools such as Tableau or Power BI.
- Knowledge of programming languages such as Python or Java.
- Familiarity with Agile methodologies and project management tools.
- Experience in working with large datasets and big data technologies.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 2 5 years of experience in data engineering or a related role.
- Strong analytical and problem solving skills.
- Excellent communication and teamwork abilities.