Senior Data Engineer

Shift Financial Pty

Sydney

Hybrid

AUD 150,000 - 190,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Hybrid working
Parental leave
Strategy Week
Flat structure
Wellbeing

Job summary

Shift is seeking a senior data engineer to own the Azure Databricks platform, set standards, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two other engineers to shape how data works at Shift.

Join a collaborative culture with hybrid working, mentor teammates, design robust ELT pipelines, and partner with analysts, product managers and Engineering to deliver trusted, self-serve data.

Qualifications

  • 7+ years in data engineering with hands-on Azure Databricks
  • Strong Python and SQL with experience in pipelines-as-code
  • Experience with CI/CD and deploying pipelines
  • Proven ability to raise data-platform standards
  • Solid dimensional modelling experience

Responsibilities

  • Own the data platform roadmap and engineering standards
  • Design and lead robust ELT pipelines on Azure Databricks
  • Lead data workstream for core system migration
  • Develop a scalable, self-serve data model
  • Improve data quality, freshness and alerting
  • Mentor engineers and drive technical decisions
  • Collaborate with analysts, data scientists, PMs and Eng

Tools

Azure DevOps
GitHub
Databricks Asset Bundles

Job description

Who is Shift?

Shift provides business finance to small, established and corporate sized businesses in Australia, including Business Overdraft, Equipment Line, Asset Finance, Term Loan and Trade Account. Founded in 2014, Shift has funded more than 30,000 Australian businesses.

At Shift, our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 300 people who are always looking to deliver better outcomes for Australian businesses.

About the role:

Want to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two other engineers to develop and plenty of room to shape how data works at Shift.

What you’ll do:
  • Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog

  • Design and lead the build of robust, scalable ELT pipelines on Azure Databricks

  • Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering

  • Build and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data

  • Lift data quality, freshness and alerting so issues are caught before the business notices them

  • Keep the platform cost-efficient through cluster optimisation, job orchestration and smart use of compute

  • Mentor and develop other data engineers through code review, pairing and clear standards

  • Partner with analysts, data scientists, product managers and Engineering to turn business needs into data products people trust

What you’ll bring:
  • 7+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog)

  • Strong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles)

  • A track record of lifting standards on an existing platform, not just building something new on a clean slate

  • Solid dimensional modelling experience (star schemas, conformed dimensions, medallion architecture)

  • Experience mentoring engineers and leading technical decisions through design and code review

  • The ability to explain technical direction clearly to non-technical stakeholders, and an instinct to work across teams rather than in a silo

  • Experience leading the data side of a core system migration is a strong plus

Key benefits:
  • Hybrid working: we’re headquartered in North Sydney with state-based workplaces and offer a hybrid work policy. Our offices have spaces for collaboration, socialising and focused work.

  • Parental leave: up to 26 weeks paid.

  • Strategy Week: twice a year the whole team comes together to hear the business strategy and product and technology roadmap first‑hand, with fortnightly all‑company business updates in between.

  • Flat structure: everyone can learn from each other and senior leaders across the business.

  • Wellbeing: benefits supporting your physical, psychological and financial wellbeing, from a day off on your birthday to end of trip facilities.

Additional information:

If you don’t meet all the qualifications or skills but think you’d be a great fit, please apply anyway.

Learn more about working at Shift at shift.com.au/careers.

#LI-Hybrid

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Shift Financial • Sydney

Hybrid
AUD 140,000 - 190,000
Parental leave
Hybrid working
Strategy Week
+2
Senior Data Engineer
Senior Data Engineer

Shift • Sydney

Hybrid
AUD 150,000 - 190,000
Hybrid work policy
Parental leave up to 26 weeks
Strategy Week
+2
Senior Data Scientist
Senior Data Scientist

Shift Financial Pty • Sydney

Hybrid
AUD 150,000 - 210,000
Hybrid working policy
Parental leave
Wellbeing benefits
Senior Data Scientist
Senior Data Scientist

Shift • North Sydney

Hybrid
AUD 120,000 - 180,000
Hybrid working
Parental leave
Strategy Week
+2
Data Analyst (Reporting, Analytics & Automation)
Data Analyst (Reporting, Analytics & Automation)

Shift Financial Pty • North Sydney

Hybrid
AUD 90,000 - 120,000
Hybrid working
Parental leave (26 weeks)
Strategy Week
+2
Senior Data Scientist
Senior Data Scientist

Shift • Sydney

Hybrid
AUD 140,000 - 190,000
Hybrid working
Parental leave 26 weeks
Wellbeing benefits
+1
Senior Data Scientist
Senior Data Scientist

Shift Financial • Sydney

Hybrid
AUD 140,000 - 190,000
Parental leave 26 weeks
Strategy Week
Flat structure
+2
Senior Software Engineer - .Net
Senior Software Engineer - .Net

Shift Financial Pty • Sydney

Hybrid
AUD 140,000 - 190,000
Flat structure
Roadmap sessions
Flexible work policy
+3
Senior Software Engineer - .Net
Senior Software Engineer - .Net

Shift • North Sydney

Hybrid
AUD 140,000 - 180,000
Flat structure for learning
100 days roadmap updates
Flexible work policy
+2
Senior DevOps Engineer
Senior DevOps Engineer

Shift Financial Pty • Sydney

Hybrid
AUD 140,000 - 200,000
Flat structure
Roadmap reviews
Flexible work policy
+2
Top locations