Hadoop Production Support Engineer

Insight Global is seeking a highly skilled Production Support Engineer to join our team and provide critical support for a Hadoop-based data environment. This role is ideal for a proactive problem-solver who thrives in fast-paced environments and enjoys working across multiple teams to ensure system stability and data integrity.

Key Responsibilities:

• Release Coordination: Manage and execute production releases, ensuring smooth deployments with minimal downtime.
• System Upgrades & Maintenance: Plan and implement upgrades for Hadoop clusters and related systems to maintain optimal performance.
• Operational Support: Monitor system health, troubleshoot issues, and ensure high availability of production environments.
• Data Quality & Integrity: Investigate and resolve data discrepancies, ensuring accuracy and reliability across platforms.
• Root Cause Analysis: Perform in-depth analysis of incidents to identify underlying issues and implement long-term solutions.
• Collaboration & Communication: Work closely with development, QA, and business teams to address technical challenges and communicate risks before they escalate.
• Leadership: Lead small-scale initiatives and drive process improvements within the support function.

Must-Have Experience & Qualifications:

• 5 years in Production/Application Support or Data Engineering roles.
• Hands-on experience in Hadoop ecosystems and/or DevOps support environments.
• Strong proficiency in Unix/Linux, Bash scripting, and SQL for troubleshooting and automation.
• Exposure to Apache Spark development, optimization, and performance tuning.
• Familiarity with Big Data tools (Hive, HDFS, Oozie, etc.).
• Proven ability to analyze complex data and code issues, including troubleshooting data quality and integrity problems.
• Excellent communication skills; comfortable interacting with stakeholders at all levels of management.
• Ability to identify and escalate risks proactively.
• Experience leading small projects or initiatives.