Hadoop Engineer

Trusted by many of the largest companies globally, Accertify is the leading digital platform assessing risk across the entire customer journey, from Account Monitoring and Payment Risk to Refund Fraud and Dispute Management. Accertify helps maximize revenues and user experience while minimizing loss and customer friction. We offer ultra-fast decision-making and precise control, ensuring our customers are always confidently in the driver’s seat and ready to move at the speed of right.

Be in the driver’s seat of your career as a Hadoop Engineer with the industry leader.

We are looking for a Hadoop and Big Data Engineer to administer the multi-petabyte HPE Ezmeral Data Fabric Clusters. Senior Hadoop Engineers are instrumental for the smooth functioning and upkeep of the large volumes of data and analytical services, enabling the users to derive business insights and develop new products. This position will challenge the technical skills of the individual in ensuring the Usability and High Availability of the Big Data and ML Ops infrastructure to enable Analytics, Product Development, and Production Operations. 

Essential Duties & Responsibilities:

• Upkeep of the HPE EDF cluster, ensuring the data is accessible to users
• Support user workloads by appropriately designing the queues for appropriate cluster usage
• Ensure cluster is healthy and the Analytics Enablement services – Spark, Drill, etc. – are maintained with high availability
• Monitor cluster usage and uptime, and resolve any issues
• Participate in pager duty, as needed, to support the cluster operations
• Maintain and manage edge nodes through which users will access the cluster
• Interact with users and debug, and access related or other issues that they may be facing
• Build monitoring tools and other scripts, as needed, to have strong diagnostics and carry a proactive mindset to preemptively solve issues as identified

Skills & Qualifications:

• 4 years experience with HPE Ezmeral Datafabric (EDF) or similar eco systems 
• Deep understanding of Hadoop and big data object storage. 
• At least 3 years of experience in administering the cluster
• 4 years of experience working with Linux OS and an expert in shell scripting
• 3 years of experience in Java, Python, and PySpark
• 4 years of experience in writing SQL queries across various platforms – RDBMS, Drill etc.
• 2 years of experience in writing Spark queries and optimization, including resource allocation
• Strong understanding of columnar data storage and must have dealt with storage formats such as - Parquet, and json
• Foundational understanding of the Networking concepts
• Data structures, manipulation, and optimization
• Working knowledge of monitoring skills like Grafana, Splunk, Zabbix, Check MK

Additional Details:

• Salary Range: $120,000-145,000. The range displayed on each job posting reflects the minimum and maximum target salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
• This role is eligible for remote US-based (work-from-home) locations. Chicago-based candidates would work in a hybrid capacity from the Accertify HQ in Itasca, IL. 
• Visa Sponsorship: Applicants must be authorized to work in the U.S.; Accertify does not provide visa sponsorship for this position.

Why Join Accertify?

At Accertify, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of yourself and your family!

• Comprehensive Health Coverage: Enjoy peace of mind with medical, dental, and vision insurance options tailored to your needs.
• Generous Time Off: Recharge with paid time off, holidays, and personal days to maintain a work-life balance.
• Financial Wellness: Plan for the future with competitive pay, a 401(k) retirement plan with company match, and financial planning resources.
• Professional Growth: Advance your career with access to training, development programs, and opportunities to grow within the company.
• Wellness Support: Stay healthy with wellness programs, mental health resources, and fitness perks.
• Perks and Extras: Enjoy additional benefits like commuter assistance, employee discounts, and company-sponsored events.

At Accertify, we’re committed to supporting your success at work and in life!