What are the responsibilities and job description for the Ab Initio Data Engineer position at Pyramid Consulting, Inc.?
Immediate need for a talented Ab Initio Data Engineer. This is a 06 Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite). Please review the job description below and contact me ASAP if you are interested.
Job ID:26-23682
Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities:
- Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment)
- Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
- Optimize graph performance parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing
- Lead development using Ab Initio components: Co>Operating System, EME (Enterprise Meta>Environment), Conduct>It, Data Profiler, Continuous Flows
- Own metadata management and data lineage within EME
- Design and implement CDC (Change Data Capture) and near-real-time data pipelines
- Troubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtime
- Define coding standards, review peer-developed graphs, and enforce best practices
- Mentor junior/mid-level Ab Initio developers
- Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design
Key Requirements and Technology Experience:
- Must have skills: - Ab Initio, GDE and Unix/Linux
- Bachelor s degree in Computer Science, Engineering, or related field
- 7 years of ETL development experience, with 5 years specifically in Ab Initio
- Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
- Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
- Strong SQL skills and experience with major RDBMS (DB2)
- Experience with Unix/Linux shell scripting
- Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
- Experience with Kafka
- Strong debugging and performance-tuning skills for large-volume data processing
- Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
- Exposure to Kubernetes, openshift
- Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
- Knowledge of API-based or streaming integration (Kafka)
- Prior experience as a technical lead or in a client-facing architecture role
- Strong analytical and problem-solving skills for complex data issues
- Ability to lead design discussions and drive technical consensus
- Effective mentorship and knowledge-sharing across the team
- Clear communication with both technical and business stakeholders
- Good Communication skills
- 5 days Work from Office at Berkley Heights, NJ
- Team Player
- Ability to work in a changing environment
- Strong problem solving and analytical skills
- Ability to work independently or within a team
- Manage day-to-day challenges and communicate developmental risks with the technical team
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .
Salary : $45 - $53