Ab Initio Engineer

PAAR Systems

Sydney

Hybrid

AUD 140,000 - 180,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PAAR Systems seeks an experienced Senior/Lead Ab Initio Data Engineer to design and optimize high-volume ETL/ELT data pipelines in a hybrid Sydney environment. You will translate complex business requirements into scalable data solutions leveraging Ab Initio, AWS, and Python.

You will partner with architects, analysts, and stakeholders to deliver governed data models (3NF/Star/Snowflake/Data Vault) and ensure reliable, secure cloud integrations while mentoring junior engineers and contributing

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or related quantitative discipline.
  • 5+ years hands-on experience with Ab Initio components (GDE, Co>Operating System, EME, Conduct>It, Express>It, and Continuous Flows).
  • Data Modeling proficiency in dimensional and relational data modeling, SCD Type 1/2/3, and enterprise data warehouse architecture.
  • Strong working knowledge of AWS data services (S3, Redshift, Glue, Lambda, Athena, EC2) and IAM policies.
  • Proficiency in Python (Pandas, Boto3, PySpark, SQLAlchemy) and Unix/Linux shell scripting.
  • Advanced SQL skills across relational and cloud databases (Redshift, Snowflake, Oracle, Teradata, PostgreSQL).
  • Scheduling/DevOps experience with Control-M, Autosys, or Airflow and CI/CD tools (Git, Jenkins).

Responsibilities

  • Ab Initio ETL Development: Design, develop, test, and deploy scalable data graphs, plans, and workflows.
  • Enterprise Data Modeling: Design and maintain conceptual, logical, and physical data models (3NF, Star, Snowflake, Data Vault).
  • AWS Cloud Integration: Architect and integrate data pipelines with AWS services (S3, Redshift, Glue, Lambda, EMR, IAM, Step Functions).
  • Python Automation & Scripting: Develop modular Python scripts for ingestion, API integration, validation, metadata, and transformations.
  • Performance Tuning & Optimization: TUNE Ab Initio graphs and cloud queries with parallelism, partitioning, indexing.
  • Data Governance & Quality: Implement automated data quality checks and end-to-end data lineage in EME.
  • Production Support & Collaboration: L3 production support, code reviews, docs, and mentoring junior engineers.

Skills

Ab Initio
AWS
Python
SQL
Data Modeling
Scheduling
DevOps
CI/CD
Big Data
Spark
Kafka

Education

Bachelor’s or Master’s degree in Computer Science or related

Tools

ERwin
ER/Studio
IBM InfoSphere Data Architect
Apache Spark
Kafka

Job description

Job Description: Ab Initio Data Engineer (AWS, Python & Data Modeling)

Job Title: Senior / Lead Ab Initio Data Engineer

Experience Level: 5 – 10 Years

Location / Mode: Sydney / Hybrid

Employment Type: Full-Time

Primary Tech Stack: Ab Initio (GDE, EME, Conduct>It), AWS, Python, SQL, Data Modeling

Role Summary

We are seeking an experienced Ab Initio Data Engineer with strong expertise in Enterprise Data Modeling, AWS cloud services, and Python development. In this role, you will design, build, and optimize high-volume ETL/ELT data pipelines while supporting cloud modernization initiatives. You will partner with enterprise architects, data analysts, and business stakeholders to translate complex business requirements into scalable, reliable, and well-governed data solutions.

Key Responsibilities

  • Ab Initio ETL Development: Design, develop, test, and deploy scalable, high-performance data processing graphs, plans, and workflows using Ab Initio GDE, Co>Operating System, EME, and Conduct>It.
  • Enterprise Data Modeling: Design and maintain conceptual, logical, and physical data models (3NF, Star Schema, Snowflake Schema, and Data Vault) tailored for operational data stores and analytical data warehouses.
  • AWS Cloud Integration: Architect and integrate data pipelines with AWS ecosystem services including Amazon S3, Redshift, Glue, Lambda, EMR, IAM, and Step Functions to support hybrid and cloud-native workloads.
  • Python Automation & Scripting: Develop modular Python scripts for data ingestion, API integration, file validation, metadata automation, and custom data transformations alongside Unix/Linux shell scripting.
  • Performance Tuning & Optimization: Analyze and resolve bottlenecks in Ab Initio graphs, SQL queries, and cloud data warehouses using parallelism, partitioning, and indexing best practices.
  • Data Governance & Quality: Implement automated data quality checks, reconciliation frameworks, error-handling routines, and end-to-end data lineage tracking within EME.
  • Production Support & Collaboration: Provide Level-3 production troubleshooting, participate in code reviews, maintain technical documentation, and mentor junior data engineers.

Required Qualifications & Technical Skills

  • Education: Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related quantitative discipline.
  • Ab Initio Expertise: 5+ years of hands-on experience with Ab Initio components (GDE, Co>Operating System, EME, Conduct>It, Express>It, and Continuous Flows).
  • Data Modeling Proficiency: Proven track record in dimensional and relational data modeling, slowly changing dimensions (SCD Type 1/2/3), and enterprise data warehouse architecture.
  • AWS Cloud Experience: Strong working knowledge of AWS data services (S3, Redshift, Glue, Lambda, Athena, EC2) and cloud security/IAM policies.
  • Python & Scripting: Proficiency in Python (Pandas, Boto3, PySpark, SQLAlchemy) and Unix/Linux shell scripting for workflow orchestration and automation.
  • Database & SQL Mastery: Advanced SQL skills with experience across relational and cloud databases such as Amazon Redshift, Snowflake, Oracle, Teradata, or PostgreSQL.
  • Scheduling & DevOps: Hands-on experience with enterprise job schedulers (Control-M, Autosys, or Airflow) and CI/CD version control tools (Git, Jenkins).

Preferred Qualifications (Good to Have)

  • Cloud Modernization: Experience migrating legacy on-premise Ab Initio ETL workloads to AWS cloud architectures.
  • Data Modeling Tools: Familiarity with industry data modeling tools such as ERwin, ER/Studio, or IBM InfoSphere Data Architect.
  • Big Data & Streaming: Exposure to Apache Spark, Kafka, or Ab Initio Continuous Flows for real-time data processing.
  • Certifications: AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect – Associate.

Core Competencies

  • Analytical Problem-Solving: Ability to dissect complex data anomalies and design resilient, fault-tolerant solutions.
  • Stakeholder Communication: Clear verbal and written communication skills to collaborate effectively across technical and business teams.
  • Agile Delivery: Familiarity with Agile/Scrum methodologies, sprint planning, and iterative delivery.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Ab Initio Data Engineer – AWS & Data Modeling
Senior Ab Initio Data Engineer – AWS & Data Modeling

PAAR Systems • Sydney

Hybrid
AUD 140,000 - 180,000
Ab Initio Senior Technical Lead
Ab Initio Senior Technical Lead

HCL Technologies Limited • Australia

On-site
AUD 150,000 - 190,000
Ab initio Data Engineer
Ab initio Data Engineer

Tech Aalto • Sydney

On-site
AUD 140,000 - 190,000
Ab Initio Data Engineer
Ab Initio Data Engineer

Tech Aalto • New South Wales

On-site
AUD 120,000 - 150,000
Senior Ab Initio Data Engineer - ETL & Cloud (AWS)
Senior Ab Initio Data Engineer - ETL & Cloud (AWS)

Tech Aalto • New South Wales

On-site
AUD 120,000 - 150,000
Senior Ab Initio & Data Integration Engineer (ETL/Cloud)
Senior Ab Initio & Data Integration Engineer (ETL/Cloud)

Synechron • Sydney

On-site
AUD 120,000 - 150,000
Senior Data Engineer: Ab Initio & ETL Expert
Senior Data Engineer: Ab Initio & ETL Expert

Tech Aalto • Sydney

On-site
AUD 140,000 - 190,000
Sr. Data Engineer
Sr. Data Engineer

ALOIS UK • Perth

On-site
AUD 130,000 - 170,000
Senior Data Engineer
Senior Data Engineer

Elysium Digital • Sydney

On-site
AUD 130,000 - 180,000
Senior Data Engineer
Senior Data Engineer

PayTech Nexus Ltd • Sydney

On-site
AUD 120,000 - 160,000
Top locations