Hybrid Data Engineer - Data Pipelines & Analytics

NSW Department of Communities and Justice; Sydney; Hybrid; AUD 117,000 - 129,000; Full time

Benefits offered by this job

Hybrid work arrangements

CBD location (transport nearby)

Salary packaging options

Generous leave entitlements

Job summary

NSW Education Standards Authority (NESA) in Sydney is seeking a Data Engineer to ensure the accuracy and reliability of examination and credentialing data across NSW. You will work at the intersection of technology, data and operations to support high-profile HSC programs and assessments.

Responsibilities include writing complex queries (SQL, Access, iSeries/AS400), reviewing R and Python scripts, maintaining data integrity, and collaborating with IT to build scalable data pipelines and automate

Qualifications

• Experience in developing and administering programs, procedures and systems that support the delivery of major operational programs.
• Proven ability to analyse complex examination systems, identify data and functional anomalies, escalate issues promptly, and contribute to effective resolution strategies.
• Strong capability to monitor and evaluate the progress of multiple HSC programs against established milestones and deadlines, adjusting priorities and timelines to address emerging issues.
• Demonstrated ability to effectively manage competing and, at times, conflicting priorities, delivering high-quality outcomes within agreed timeframes.

Responsibilities

• Writing complex queries and producing tables using database systems and query tools, including Microsoft Access, Structured Query Language (SQL), and iSeries/AS400.
• Reviewing, running and developing R and Python scripts for data analysis and processing purposes.
• Ensuring accuracy, integrity, confidentiality and security of data loaded onto the examination system.
• Maintaining the examination system, including: setting system parameters through correct interpretation of NESA rules and procedures, entering large volumes of data into the system, and system testing to troubleshoot bugs.
• Collaborating with corporate IT teams to create, implement and maintain optimal data pipelines from a wide variety of internal and external sources.
• Revising, designing, and implementing best-fit internal process improvements including automating manual processes, streamlining data delivery and re-designing infrastructure for greater scalability and elegance.
• Providing accurate information from the examination system in a timely fashion in response to internal and external requests for data.
• Reviewing and evaluating processes and documentation, and recommending improvements.

Skills

SQL

R

Python

Java

C

C++

Visual Basic

Tools

Microsoft Access

iSeries/AS400

MySQL

Job description

NSW Education Standards Authority (NESA) in Sydney is seeking a Data Engineer to ensure the accuracy and reliability of examination and credentialing data across NSW. You will work at the intersection of technology, data and operations to support high-profile HSC programs and assessments.

Responsibilities include writing complex queries (SQL, Access, iSeries/AS400), reviewing R and Python scripts, maintaining data integrity, and collaborating with IT to build scalable data pipelines and automate