AWS Engineer

Billigence; Sydney; On-site; AUD 90,000 - 121,317; Full time

Job summary

A leading company in Business Intelligence seeks a contract AWS Data Engineer in Sydney. This role focuses on developing cutting-edge data solutions involving data ingestion and transformation pipelines using AWS. Ideal candidates are mid-level or senior engineers skilled in AWS, data architecture, and programming languages like Python or Java.

Qualifications

• Mid-Senior level Data Engineer role, with experience in AWS technologies.
• Familiarity with Data Architecture and ETL frameworks is essential.
• Experience in programming (Python, Java, Scala) and CI/CD tools preferred.

Responsibilities

• Develop and maintain data ingestion and transformation pipelines.
• Utilize AWS technology stack for creating innovative data solutions.
• Support ETL framework development and optimize data processing performance.

Skills

AWS Data Services

Data Architecture

Python

Java

Scala

GIT

CI/CD tools

Spark SQL

ETL frameworks

Big Data technologies

Tools

Docker

EKS

Job description

3 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Billigence Pty Ltd is a specialist in the delivery of market-leading Business Intelligence and CRM solutions. Headquartered in Sydney, Australia and with offices in Prague, London, Frankfurt and Singapore our passion is data and our focus is the delivery of end-to-end solutions via a talented team of skilled professionals.

We are partners with leading edge software platforms including Tableau, Alteryx, Collibra, Snowflake, GCP and Salesforce.

We have an open role for an AWS Data Engineer that we’re looking to fill for a 6 month contract.

We’re looking for a mid-level or senior engineer based in Sydney.

What role will you play?

As a Data Engineer, you'll become part of our vibrant Engineering team, creating innovative data product solutions. Your responsibilities will involve developing and maintaining applications such as data ingestion and transformation pipelines, cloud infrastructure, APIs, query engines, and orchestration platforms, all utilizing the AWS technology stack.

• Experience in one or more of the following Amazon Data Services (Redshift, Glue, RDS, EMR).
• Data Architecture experience including different data modelling techniques.
• Commercial experience in at least one programming language, such as Python, Java, or Scala.
• Practical experience using GIT and at least one CI/CD tool (Bamboo, CloudBees, or TeamCity, Gitlab etc) for development or Infrastructure as Code.

Valuable Additional skills

• Proficient in Spark SQL, with proven ability in tuning and optimisation.
• Proven hands-on experience in developing and supporting ETL frameworks and tooling.
• Experience with Big Data technologies, focusing on Spark, DBT, Presto (or other query engines), big data storage formats such as Parquet, ORC, Avro, and data pipeline orchestration tools like Airflow.
• Experience using of EKS and Docker.

If this sounds like something you are interested in, please apply with your most up-to-date CV and we will be in touch!

Please note: Only successful applicants will be contacted.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Billigence by 2x

Get notified about new Data Engineer jobs in Sydney, New South Wales, Australia.

Sydney, New South Wales, Australia 3 weeks ago

Macquarie Park, New South Wales, Australia 5 months ago

Sydney, New South Wales, Australia 4 days ago

Sydney, New South Wales, Australia 3 weeks ago

Sydney, New South Wales, Australia 2 days ago

Minchinbury, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 2 days ago

Macquarie Park, New South Wales, Australia 4 days ago

Sydney, New South Wales, Australia 4 hours ago

Sydney, New South Wales, Australia 4 days ago

Sydney, New South Wales, Australia 3 weeks ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 1 month ago

Homebush, New South Wales, Australia 2 days ago

Sydney, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia A$102,899.00-A$121,317.00 5 days ago

Sydney, New South Wales, Australia A$90,000.00-A$110,000.00 3 weeks ago

Kensington, New South Wales, Australia 1 month ago

Sydney, New South Wales, Australia 4 days ago

Sydney, New South Wales, Australia 3 days ago

Sydney, New South Wales, Australia 2 months ago

Sydney, New South Wales, Australia 2 weeks ago

Sydney, New South Wales, Australia 3 days ago

Software Engineer (Python) - Data Platform, remote across ANZ

Sydney, New South Wales, Australia 1 day ago

Sydney, New South Wales, Australia 4 days ago

Sydney, New South Wales, Australia 2 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.