What are the responsibilities and job description for the Need Sr. Hadoop Developer with AB Initio, Spark, Python & Health Insurance experience:: Jacksonville, FL (Hybrid) position at Synergy Technologies, LLC?
Job Title: Sr. Hadoop Developer
Location: Jacksonville, FL (Hybrid/Onsite)
Experience: 10 years preferred
Job Description:
We are seeking an experienced Senior Hadoop Developer with strong expertise in AB Initio, Hadoop, Spark, Python, SQL, and Stored Procedures. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing solutions, building ETL/ELT pipelines, and managing complex data integration workflows. Experience with Snowflake is a plus.
Roles & Responsibilities:
- Design, develop, and maintain scalable data processing solutions using Hadoop and Apache Spark.
- Develop and enhance ETL workflows using AB Initio for data integration and transformation.
- Write efficient Python scripts for data processing, automation, and application integration.
- Develop, optimize, and maintain complex SQL queries, Stored Procedures, and database operations.
- Build and support large-scale data pipelines for batch processing and data transformation.
- Perform data validation, reconciliation, troubleshooting, and performance tuning.
- Optimize Spark jobs and Hadoop workloads to improve processing efficiency and scalability.
- Collaborate with data engineers, architects, business analysts, and other technical teams to deliver data solutions.
- Ensure data quality, consistency, reliability, and adherence to established development standards.
- Preferred: Work with Snowflake for cloud data warehousing, data loading, and query optimization.
Required Skills:
- Strong hands-on experience with AB Initio.
- Proficiency in Hadoop ecosystem and distributed data processing.
- Strong experience with Apache Spark.
- Programming expertise in Python.
- Advanced SQL and Stored Procedures development and optimization.
- Experience developing and maintaining ETL/ELT data pipelines.
- Strong analytical, debugging, and performance-tuning skills.
Preferred Skills:
- Hands-on experience with Snowflake.
- Experience with cloud-based data platforms and data warehousing.
- Knowledge of data migration, data quality, and large-scale data integration.