Senior Automation Engineer - Data Pipelines

Imperial Brady; Jersey City (NJ); On-site; USD 120,000 - 140,000; Full time

Benefits offered by this job

401(k) program with company match

Life insurance

Generous paid time off package

Educational reimbursement

Paid family leave

Adoption assistance

Job summary

Imperial Brady is seeking a Senior Quality Engineer to build a dedicated testing practice for its data platform. You will write and run automated tests inside the development cycle, focusing on pipelines, transformations, and deployment quality.

This role is central to ensuring numbers are correct before UAT and business handoffs. The position emphasizes building a test framework, automating checks, and mentoring others as the team grows, with a compensation range and a Jersey City market

Qualifications

• Five or more years in test automation, software engineering in test, or data engineering with a heavy testing component.
• Strong Python, including building and maintaining real test suites with a framework such as pytest.
• Strong SQL, writing queries that prove a transformation produced what the spec called for.
• Demonstrated experience testing ETL/ELT pipelines and dimensional models.
• Practical Git and CI/CD experience: branching, pull requests, and automated checks in pipelines.
• Experience defining and enforcing technical acceptance criteria in an Agile sprint process.

Responsibilities

• Build automated tests that exercise Fabric pipelines, notebooks, and transformation logic to verify end-to-end operation.
• Build automated checks that validate changes to MLVs, lakehouse tables, and semantic models: columns, data types, keys, dependencies, and refresh behavior.
• Test incremental load behavior: watermarking, idempotency, restart safety, late arriving records, and full vs delta paths.
• Automate environment parity verification across Dev, UAT, and Prod and report drift.
• Act as the technical authority on testing and mentor developers on writing tests.
• Help stand up testing and deployment practices against the Fabric Well-Architected Framework.
• Report on engineering quality with numbers: coverage, pass rate, build fail rate, defect escape.

Skills

Python

pytest

PySpark

SQL

Git

CI/CD

Automation

Test framework

Tools

Jenkins

Jupyter notebooks

Job description

Imperial Brady is seeking a Senior Quality Engineer to build a dedicated testing practice for its data platform. You will write and run automated tests inside the development cycle, focusing on pipelines, transformations, and deployment quality.

This role is central to ensuring numbers are correct before UAT and business handoffs. The position emphasizes building a test framework, automating checks, and mentoring others as the team grows, with a compensation range and a Jersey City market