What are the responsibilities and job description for the Hadoop Platform Support Engineer position at InfiCare?
Job Title: Hadoop Platform Support Engineer
Location: Charlotte, NC
Job Type: 12 Month Contract
Job Overview
Our client is seeking a skilled Data Engineer with a strong focus on Hadoop Distributed File System (HDFS) to join their team in Charlotte, NC. The ideal candidate will be responsible for the support and maintenance of the Hadoop platform, ensuring optimal performance and reliability. This is an L3 platform support role — candidates from a platform operations/support background are strongly preferred over development or build profiles.
Key Responsibilities
- Provide L3 support for the Hadoop platform, troubleshooting and resolving issues to ensure high availability and performance
- Manage and maintain HDFS, ensuring data integrity and security
- Collaborate with data scientists and analysts to understand data requirements and optimize data pipelines
- Implement and monitor data ingestion processes for efficient data flow into the Hadoop ecosystem
- Integrate Google Cloud Platform cloud-based solutions with on-premises Hadoop infrastructure
- Develop and maintain documentation for data engineering processes, data models, workflows, and system configurations
- Participate in capacity planning and performance tuning of the Hadoop environment
Required Skills
- Strong knowledge of Hadoop Distributed File System (HDFS) and its architecture
- Hands-on experience with L3 support and maintenance of Hadoop platforms
- Proficiency in managing and optimizing data workflows within the Hadoop ecosystem
- Familiarity with Google Cloud Platform (Google Cloud Platform) and its data services
- Experience with data ingestion tools and techniques