What are the responsibilities and job description for the ETL Developer position at Info Origin, Inc.?
Job Overview:
We are seeking a skilled ETL Developer to join our dynamic team. The ideal candidate will have a strong background in data integration and transformation, with expertise in managing large datasets. As an ETL Developer, you will be responsible for designing, developing, and maintaining ETL processes that facilitate the efficient movement of data from various sources into our data warehouse and other storage solutions. Your role will be pivotal in ensuring data quality and accessibility for analytical purposes.
Duties:
- Design and implement ETL processes to extract, transform, and load data from multiple sources into the data warehouse.
- Utilize tools such as SQL, Python, and Apache Hive to analyze and manipulate large datasets.
- Collaborate with data architects and analysts to understand data requirements and ensure alignment with business needs.
- Monitor ETL processes to ensure they run efficiently and troubleshoot any issues that arise.
- Work with cloud technologies such as AWS and Azure Data Lake to optimize data storage solutions.
- Maintain documentation of ETL processes, data flows, and system configurations.
- Implement best practices for data governance and security while working with linked data.
Qualifications:
- Proficiency in Python for scripting and automation of ETL tasks.
- Strong knowledge of SQL for querying databases and performing data analysis.
- Experience with big data technologies such as Apache Hive is preferred.
- Familiarity with cloud platforms like AWS or Azure Data Lake is a plus.
- Understanding of data warehousing concepts and best practices.
- Ability to analyze complex datasets effectively and provide actionable insights.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills to collaborate effectively with cross-functional teams.
If you are passionate about working with data and have the skills necessary to excel as an ETL Developer, we encourage you to apply. Join us in transforming how we manage and utilize our data!
Job Type: Full-time
Schedule:
- 8 hour shift
Work Location: In person
