Ab Initio Data Engineer

Creative Solutions Services, LLC; Berkeley Heights (NJ); On-site; USD 62,000 - 73,000; Part time

Benefits offered by this job

Health insurance

401(k) plan

Paid sick leave

Job summary

Creative Solutions Services, LLC seeks an Ab Initio Data Engineer for a 06+ months contract in Berkeley Heights, NJ (onsite). You will design, develop, and maintain complex ETL graphs using Ab Initio GDE and lead end-to-end data integration projects across multiple systems.

Requirements include 7+ years ETL, 5+ years Ab Initio, strong SQL with DB2, Unix/Linux scripting, and experience with Kafka/Hadoop/Spark; prior technical leadership is a plus.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 7+ years ETL development experience, with 5+ years in Ab Initio.
• Strong hands-on Ab Initio GDE, Co>Op, EME, and Conduct>It.
• Deep understanding of parallel processing and Ab Initio partitioning.
• Strong SQL skills and experience with DB2.
• Unix/Linux shell scripting experience.
• Knowledge of data warehousing concepts (SCDs, star/snowflake).
• Experience with Kafka and Hadoop/Spark ecosystems.
• Familiarity with mainframe data integration (COBOL, VSAM).
• Exposure to Kubernetes and OpenShift.

Responsibilities

• Design, develop, and maintain ETL graphs using Ab Initio GDE.
• Architect end-to-end data integration across multiple sources/targets.
• Optimize graph performance via partitioning and tuning.
• Lead development with Ab Initio components and tools.
• Own metadata management and data lineage in EME.
• Design and implement CDC and near-real-time pipelines.
• Troubleshoot production job failures and root-cause analysis.
• Mentor junior Ab Initio developers and enforce best practices.
• Collaborate with data architects, DBAs, and analysts to translate requirements.

Skills

Ab Initio

GDE

Unix/Linux

SQL

DB2

Kafka

Hadoop

Spark

Kubernetes

OpenShift

Mainframe

COBOL

Data warehousing

ETL

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Co>Operating System

EME

Conduct>It

Job description

Immediate need for a talented Ab Initio Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:26-23682

Pay Range: $45 - $53/hour.

Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

• health insurance (medical, dental, vision)
• 401(k) plan
• paid sick leave (depending on work location)

Key Responsibilities

• Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment)
• Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
• Optimize graph performance — parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing
• Lead development using Ab Initio components: Co>Operating System, EME (Enterprise Meta>Environment), Conduct>It, Data Profiler, Continuous Flows
• Own metadata management and data lineage within EME
• Design and implement CDC (Change Data Capture) and near-real-time data pipelines
• Troubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtime
• Define coding standards, review peer-developed graphs, and enforce best practices
• Mentor junior/mid-level Ab Initio developers
• Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design

Key Requirements and Technology Experience

• Must have skills: - Ab Initio, GDE and Unix/Linux
• Bachelor’s degree in Computer Science, Engineering, or related field
• 7+ years of ETL development experience, with 5+ years specifically in Ab Initio
• Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
• Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
• Strong SQL skills and experience with major RDBMS (DB2)
• Experience with Unix/Linux shell scripting
• Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
• Experience with Kafka
• Strong debugging and performance-tuning skills for large-volume data processing
• Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
• Exposure to Kubernetes, openshift
• Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
• Knowledge of API-based or streaming integration (Kafka)
• Prior experience as a technical lead or in a client-facing architecture role
• Strong analytical and problem-solving skills for complex data issues
• Ability to lead design discussions and drive technical consensus
• Effective mentorship and knowledge-sharing across the team
• Clear communication with both technical and business stakeholders
• Good Communication skills
• 5 days Work from Office at Berkley Heights, NJ
• Team Player
• Ability to work in a changing environment
• Strong problem solving and analytical skills
• Ability to work independently or within a team
• Manage day-to-day challenges and communicate developmental risks with the technical team

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.