What are the responsibilities and job description for the ETL Informatica/Hadoop Developer position at K&K Global Talent Solutions INC.?
K&K Global Talent Solutions Inc. is an international recruiting agency that has been providing technical resources in the Canada and the USA region since 1993.
This position is with one of our clients in USA, who is actively hiring candidates to expand their teams.
Role:- ETL Informatica/Hadoop Developer
Location:- Jersey City, NJ/Charlotte, NC
Fulltime
Job Description
Primary Skill: ETL Informatica Developer
Secondary: Oracle, SQL
Experience: Minimum 10 years
Roles & Responsibilities
ETL Process Development: Design, develop, and maintain ETL processes using Informatica PowerCenter or other relevant Informatica tools.
• Deep understanding of HDFS, YARN, MapReduce, Hive, Pig, HBase, Flume, Sqoop, Zookeeper, Oozie.
• Experience with Spark, Kafka, NoSQL databases.
• Experience in Agile Methodology
• Experience with code versioning tools like Bit-Bucket
• SQL Proficiency: Utilize SQL/PLSQL to extract, transform, and load data.
• Exposure to advanced transformations like data transformations, Parsing JSON/XML messages
• Experience in Job scheduling tools Like Autosys
• Data Integration: Integrate data from various sources, ensuring data consistency and quality.
• Data Warehouse Design: Design and maintain data warehouses to support business intelligence activities.
• Performance Optimization: Optimize SQL script/queries for speed and efficiency.
• Troubleshooting: Identify and resolve issues in ETL processes.
• Documentation: Create and maintain technical documentation for ETL processes.
• Testing: Perform unit, integration, and system testing on ETL processes.
• Collaboration: Collaborate with cross-functional teams to ensure successful implementation of ETL processes.
• Data Quality: Ensure data quality by implementing data cleansing and transformation processes.
• Data Modeling: Develop and maintain relational and dimensional data models.