Data Engineer

Royal Automobile Club of WA Inc.; Perth; Hybrid; AUD 80,000 - 100,000; Full time

Job summary

A member-focused organization in Perth is seeking a Data Engineer to develop and maintain data pipelines, ensure data quality, and collaborate with business units for optimized data solutions. Candidates should possess strong SQL and Python skills, ideally with experience in Databricks and Azure services. Flexible work options and staff benefits available.

Benefits

Free Roadside Assistance

25% discount on Insurances

Access to Fitness Passport

Personal development time with training programs

Qualifications

• Strong foundation in SQL, Python, and PySpark.
• Experience with Azure services, including Data Lake and Blob Storage.
• Proactive and collaborative mindset with strong problem-solving skills.

Responsibilities

• Design and maintain scalable data pipelines using Databricks.
• Implement data quality and compliance measures in the data lake.
• Work closely with business units to meet diverse data needs.

Skills

SQL

Python

PySpark

Data Quality

Data Governance

Education

Certification in Databricks

Tools

Databricks

Power BI

Azure

GitHub

Job description

Data Engineer page is loaded## Data Engineerlocations: West Perthtime type: Full timeposted on: Posted Todayjob requisition id: JR105424As a data engineer you will be enabling the business by providing data, reporting and analytics solutions, through developing and supporting Data Ingestion and transformation in the Azure Enterprise Data & Analytics Platform (EDAP).* Designing, developing, and maintaining scalable data pipelines using Databricks, ensuring robust data processing workflows for cleaning, transforming, and aggregating data.* Implementing stringent measures to ensure data quality, governance, and compliance within the data lake, leveraging Databricks lifecycle management to maintain predictive models.* Deploying and managing data solutions using Azure cloud platforms, optimising data and platform performance for maximum efficiency.* Working closely with various business units, data analysts, and scientists to understand and meet diverse data needs, facilitating the integration and deployment of AI and ML models.* Demonstrating the ability to anticipate and balance the needs of multiple stakeholders, building partnerships and working collaboratively to achieve shared objectives.* Developing new and innovative strategies to enhance organisational success, handle complex and sometimes contradictory information to effectively solve problems, and focus on building member relationships while delivering customer-centric solutions.* Exposure to modern data engineering tool set, preferably databricks with an interest in developing your expertise in building and maintaining data pipelines, operational processes, and predictive models. A solid grounding in data architecture, data modelling, and data lake concepts with a certification in Databricks will be highly regarded.* Understanding and usage of Unity Catalog and Delta Tables, particularly in managing secure data access and optimising performance within Databricks environments.* Familiarity with modern data and AI technologies, Synapse, MLOps, LLM frameworks or Generative AI. Willingness to learn new tools and work effectively in cross functional team is essential.* Strong foundation in SQL, Python, and PySpark, with experience in apply concept to BAU and Project activities.* Familiarity with various cloud platforms, such as GCP, Azure, and AWS, is preferred. Experience with Azure services, including Data Lake, Blob Storage, and SQL-based solutions, is also desirable.* Experience using GitHub or similar for version control, with some exposure to CI/CD pipelines, ETL processes, or real-time data integration.* Understanding of Data Quality and Data Governance practices and willingness to expand capability in these area.* Experience with business intelligence and reporting tools, preferably Power BI, as well as exposure to APIs and tools such as Postman for testing and integration.* A proactive and collaborative mindset, with strong problem-solving skills and a keen eye for detail.* Working in an environment that is embracing a continuous improvement culture using experimentation to support learning.* Time dedicated to your personal development time with access to training, development, and certification programs to ensure you can upskill.* Being part of empowered, cross-functional agile delivery teams that works with the business to build systems that solve problems.* Complete flexibility to choose between working from the home or office with flexible hours for a better work life balance.* Building digital systems that will shape the future for the RAC and a better WA.* Gain RAC Staff Benefits including free Roadside Assistance and 25% discount on your Insurances, Social Club and access Fitness Passport for cheaper gym memberships.**About RAC** As an Equal Opportunity Employer, RAC values inclusivity and promotes a workplace that actively seeks to welcome contributions from all people. If you need assistance or adjustments to fully participate in the application process, please contact [e-mail]#BetterJourneysRAC #LI-JC1[](blob:https://racwa.wd3.myworkdayjobs.com/1b5d170b-cf46-490a-b374-c9c8bf60d374)0:00 / 2:00RAC is a purpose-led member organisation.Established in 1905, RAC has evolved into one of the most trusted organisations in the state, with more than 1.3 million members. At RAC we don’t have shareholders. That means we reinvest our profits for the better of our members and our State.Our Purpose is to be the driving force for a better WA.Our Vision to 2030 is to create a safer, sustainable and connected future for Western Australians.Our Mission is delivering great member services and experiences, whilst inspiring positive community change that makes life better in WA.RAC is an equal opportunity employer. We continue to build an inclusive workplace where we respect and celebrate differences. We encourage applications from diverse groups including Indigenous and Torres Strait Islander people, physical ability, all ages, LGBTQI+ identities, all languages and diverse cultures and backgrounds.For any assistance please contact [e-mail]