Senior Full-Stack Engineer

Work Initiatives; Brisbane; Hybrid; AUD 100,000 - 145,000; Part time

Job summary

Work Initiatives is seeking a Full-Stack Data Engineer to build cloud-native apps using Databricks, Python, and Next.js. You will design, implement, and operate data processing workflows and backend services with modern APIs across data platforms.

The role requires 3–5 years of software development experience and hands-on expertise in Python, Databricks, and Next.js/React, with remote or hybrid work from Brisbane.

Qualifications

• 3–5 years of software development experience.
• Hands-on Python, Databricks, and Next.js/React expertise.
• Experience with data engineering, ETL pipelines, and cloud-native architectures.
• Ability to develop data APIs and backend services.
• Familiarity with authentication (OAuth2, JWT) and secure API design.

Responsibilities

• Develop and maintain data processing workloads using Databricks and PySpark notebooks.
• Integrate applications with Databricks Jobs, Workflows, SQL Warehouses, and REST APIs.
• Backend development with Python (FastAPI, Flask, or Django) and RESTful microservices.
• Implement authentication (OAuth2, JWT, SSO) and secure API communication.
• Build frontend dashboards with Next.js/React and reusable UI components.
• Develop and deploy with CI/CD pipelines using Azure DevOps or GitHub Actions.
• Write tested, maintainable code with logging and error handling.
• Ensure security, performance, and cost efficiency for cloud-native apps.

Skills

Python

Databricks

Next.js

React

PySpark

FastAPI

REST API

JWT/OAuth2

CI/CD

Azure DevOps

Git

Agile

Unit Testing

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Next.js

React

GitHub Actions

Azure DevOps

Job description

Full-Stack Data Engineer (Databricks, FastAPI & Next.js)

Location: REMOTE or Hybrid from Brisbane QLD 4000Duration: 6 months++ Experience: 3–5 years of software development experience, with hands‑on expertise in Python, Databricks, and Next.js/React.

Job Summary

We are seeking a highly motivated Full Stack Developer to build modern, scalable, cloud-native applications that leverage Databricks for data processing, Python for backend services and APIs, and Next.js for responsive web applications. The ideal candidate will have experience developing enterprise‑grade applications that integrate with analytics platforms, data pipelines, AI/ML services, and cloud‑native technologies.

Key Responsibilities

Databricks & ComputeDevelop and maintain data processing workloads using Databricks. Build PySpark notebooks and workflows for data transformation and analytics.

Integrate applications with Databricks Jobs, Workflows, SQL Warehouses, and REST APIs. Optimize Spark jobs for performance, scalability, and cost efficiency. Work with Delta Lake, Unity Catalog, and Medallion Architecture.

Develop data APIs and services that consume Databricks datasets. Backend Development (Python)Design and develop scalable backend services using Python (FastAPI, Flask, or Django). Build RESTful APIs and microservices.

Develop authentication and authorization mechanisms (OAuth2, JWT, SSO). Integrate backend services with Databricks, Azure services, and third‑party APIs. Implement asynchronous processing and background jobs.

Write reusable, well‑tested, and maintainable code. Build logging, monitoring, and error‑handling capabilities.

Frontend Development (Next.js)Develop responsive web applications using

Next.js and React. Create reusable UI components and modern dashboards. Integrate frontend applications with backend APIs.

Implement authentication and role‑based access control. Optimize application performance and user experience. Ensure responsive design across desktop and mobile devices.

Integration & CloudIntegrate applications with Azure cloud services. Consume APIs from enterprise applications and external systems. Implement secure API communication and data exchange.

Participate in cloud deployment and infrastructure discussions. DevOps & CI/CDUse Git for source control and collaborative development. Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions.

Support automated testing and deployment processes. Participate in code reviews and enforce coding standards.

Quality & SecurityDevelop unit and integration tests.

Ensure applications meet enterprise security and compliance requirements. Implement secure coding practices and vulnerability remediation. Troubleshoot production issues and support release activities.

Must Have

Must Have:Data Engineering core conceptsDatabricksETL Pipelines, Medallion Architecture, PySparkDatabricks Automation BundlesPython BackendFastAPI (Must) REST API DevelopmentAuthN Basics (JWT, OAuth2)Databricks App builder exp including deploymentGeneral EngineeringAgile Unit TestingCI/CDAzure DevOps Good to

Good to

Have:Front end design/development Next.js or similar Html/css frameworkAI EngineeringML EngineeringMLOps