Ab Initio Data Engineer

Pyramid Consulting, Inc; Berkeley Heights (NJ); On-site; USD 62,000 - 73,000; Part time

Benefits offered by this job

Health insurance

401(k)

Paid sick leave

Job summary

Pyramid Consulting, Inc. has an immediate opening for an Ab Initio Data Engineer on a 6+ months contract in Berkeley Heights, NJ onsite.

The role focuses on designing and maintaining complex ETL graphs using Ab Initio GDE, with responsibilities spanning performance optimization, metadata management, and data pipelines. The ideal candidate has 7+ years ETL experience, strong Ab Initio expertise, and a Bachelor's degree in CS or related field; willingness to work onsite and collaborate with

Qualifications

• Ab Initio, GDE and Unix/Linux proficiency and 5+ years in Ab Initio.
• Bachelor’s degree in Computer Science, Engineering, or related field.
• 7+ years ETL development experience with 5+ years in Ab Initio.
• Strong SQL skills with DB2 experience.
• Experience with Unix/Linux shell scripting.
• Knowledge of data warehousing concepts and SCDs.

Responsibilities

• Design, develop, and maintain complex ETL graphs using Ab Initio GDE.
• Optimize graph performance through parallelism and partitioning.
• Own metadata management and data lineage within EME.
• Design and implement CDC and near-real-time data pipelines.
• Troubleshoot production job failures and perform root-cause analysis.
• Define coding standards and review peer-developed graphs.
• Collaborate with data architects, DBAs, and business analysts to translate requirements into design.

Skills

Ab Initio

GDE

Unix/Linux

ETL development

SQL

Hadoop/Spark

Kubernetes/OpenShift

Education

Bachelor’s degree in CS/Engineering

Job description

Immediate need for a talented Ab Initio Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite).

Job ID:26-23682

Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment)
• Optimize graph performance — parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing
• Own metadata management and data lineage within EME
• Design and implement CDC (Change Data Capture) and near-real-time data pipelines
• Troubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtime
• Define coding standards, review peer-developed graphs, and enforce best practices
• Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design

Key Requirements and Technology Experience:

• Must have skills: - Ab Initio, GDE and Unix/Linux
• Bachelor’s degree in Computer Science, Engineering, or related field
• 7+ years of ETL development experience, with 5+ years specifically in Ab Initio
• Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
• Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
• Strong SQL skills and experience with major RDBMS (DB2)
• Experience with Unix/Linux shell scripting
• Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
• Experience with Kafka
• Strong debugging and performance-tuning skills for large-volume data processing
• Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
• Exposure to Kubernetes, openshift
• Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
• Knowledge of API-based or streaming integration (Kafka)
• Prior experience as a technical lead or in a client-facing architecture role
• Strong analytical and problem-solving skills for complex data issues
• Ability to lead design discussions and drive technical consensus
• Effective mentorship and knowledge-sharing across the team
• Clear communication with both technical and business stakeholders
• 5 days Work from Office at Berkley Heights, NJ
• Team Player
• Ability to work in a changing environment
• Strong problem solving and analytical skills
• Ability to work independently or within a team
• Manage day-to-day challenges and communicate developmental risks with the technical team

Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.