Contract Architect - Databricks

Datacom; Christchurch; On-site; NZD 100,000 - 140,000; Full time

Job summary

An innovative technology firm in New Zealand is searching for Databricks Architects to expand their analytics team. The role focuses on designing data architectures and developing scalable solutions for various customer projects. Candidates should have extensive experience with Databricks, programming skills, and a strong ability to address business needs with data-driven solutions.

Benefits

Social events

Flexi-hours

Professional development courses

Qualifications

• Minimum 3+ years' experience in Databricks development.
• Experience developing and deploying data pipelines into live environments.
• Ability to connect to customer's specific business problems and Databricks solutions.

Responsibilities

• Design data platforms, distributed systems, data lakes & data stores.
• Create and operationalise reliable data pipelines & ETL patterns.
• Build analytics tools to provide actionable insights and solve business problems.

Skills

Databricks architecture

Python

Java

Data ingestion tools

Cloud platforms

Distributed processing technologies

Analytic skills

Education

Degree in Computer Science, Data Science, Statistics

Tools

Apache Kafka

AWS Glue

Azure event hubs

Fivetran

SQL Server

Apache Spark

Job description

Our Why

Datacom works with organisations and communities across Australia and New Zealand to make a difference in people's lives and help organisations use the power of tech to innovate and grow.

Our team

The Data and Analytics team is a progressive group of diverse and creative individuals with a deep love for all things data-related. They build platforms and solutions that are leading edge and at the forefront of the technology curve. A close-knit and fun team embedded within our rapidly growing Professional Services division, and part of the wider Datacom ecosystem. This role can be based anywhere, so you choose your lifestyle and we have the role for you.

About The Role (your Why)

We're looking for Databricks Architects to join our growing analytics team and work on a broad range of customer projects with one common denominator - data. You'll be working closely with our software developers, data scientists, DW engineers and data storytellers and will be responsible for creating and maintaining data architectures that enables data driven insights and innovation for our customers. The successful candidate will demonstrate a passion for Databricks architecture, deep understanding of the Databricks platform and excel at translating business requirements into scalable data solutions.

What You'll Do

• Design data platforms, distributed systems, data lakes & data stores
• Creating software solutions for data ingest & integration
• Developing and operationalising reliable data pipelines & ETL patterns
• Building analytics tools to provide actionable insights and solve business problems
• Infrastructure development
• Wrangling and integrating data from multiple sources
• Identifying ways to improve data reliability, efficiency and quality
  
  
  

Technical Skills

• Extensive knowledge of Databricks architecture and features
• Experience in the design, development and implementation of data solutions using Databricks
• Experience in data ingestion tools such as Apache Kafka, Informatica, AWS Glue, Azure event hubs and Fivetran.
• Strong programming skills, especially Python, Java, Scala, C++, C# etc
• Cloud platforms such as Azure, AWS & GCP
• Relational database management systems such as SQL Server, Redshift etc
• Distributed processing technologies such as Apache Spark
• Working knowledge of message queuing, stream processing, and highly scalable data stores
• Experience building CI/CD Pipelines such as GITHUB, Azure DevOps, etc
  
  
  

Required Skills And Qualification

• Degree in Computer Science, Data Science, Statistics or related field
• Ability to connect to customer's specific business problems and Databricks solutions
• Minimum 3+ years' experience in Databricks development
• Experience developing and deploying data pipelines into live environments
• A passion for lean, clean and maintainable code
• Strong analytic skills related to working with datasets, both structured and unstructured
• Curious and enthusiastic mindset
• The desire to grow and to share insights with others
  
  
  

Helpful Knowledge

• The desire to grow and to share insights with others
• Machine Learning frameworks and theory
• Analytic platforms & tools such as Databricks, Alteryx, SAS, KNIME or Datarobot
• Data vault / Kimball modelling methodology
• DevOps / DataOps
  
  
  

Why join us here at Datacom?

Datacom is one of Australia and New Zealand's largest suppliers of Information Technology professional services. We have managed to maintain a dynamic, agile, small business feel that is often diluted in larger organisations of our size. It's our people that give Datacom its unique culture and energy that you can feel from the moment you meet with us.

We care about our people and provide a range of perks such as social events, chill-out spaces, remote working, flexi-hours and professional development courses to name a few. You'll have the opportunity to learn, develop your career, connect and bring your true self to work. You will be recognised and valued for your contributions and be able to do your work in a collegial, flat-structured environment.

We operate at the forefront of technology to help Australia and New Zealand's largest enterprise organisations explore possibilities and solve their greatest challenges, so you will never run out of interesting new challenges and opportunities.

We want Datacom to be an inclusive and welcoming workplace for everyone and take pride in the steps we have taken and continue to take to make our environment fun and friendly, and our people feel supported.