Senior Databricks & Power BI Data Engineer

SG Consulting Limited; Wellington; Vor Ort; NZD 110.000 - 150.000; Vollzeit

Zusammenfassung

SG Consulting Limited seeks a skilled Data Engineer to design and maintain scalable data pipelines using Databricks, while transforming data for analytics and BI. You will support Power BI reporting and collaborate with analysts to meet data needs.

Ideal candidates combine solid data engineering fundamentals with practical Power BI knowledge, delivering analytics-ready datasets and reliable data products across the business.

Qualifikationen

• Hands-on Databricks data engineering experience.
• Strong SQL and query optimization.
• Proficiency with Python and PySpark.
• Experience with ETL/ELT pipelines and data warehousing.
• Power BI report development and data modelling.
• Knowledge of Power Query and DAX.
• Experience with data quality checks and pipeline optimisation.
• Excellent analytical and communication skills.

Aufgaben

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build ingestion, transformation, and integration workflows.
• Develop and optimise SQL queries for processing and reporting.
• Work with Python and PySpark to transform large datasets.
• Implement ETL/ELT processes and ensure data quality.
• Develop and maintain data models for analytics and reporting.
• Work with Power BI to create and support reports and dashboards.
• Optimise Power BI data models and report performance.
• Collaborate with Data Scientists and stakeholders to define data needs.
• Implement data validation, monitoring, and documentation.

Kenntnisse

Databricks

SQL

Python

PySpark

ETL/ELT

Data warehousing

Data modelling

Power BI

Data quality

Troubleshooting

Communication

Tools

Azure Data Factory

Azure Data Lake Storage

Delta Lake

Spark

Power BI Service

Git

CI/CD

Power Query

DAX

Jobbeschreibung

SG Consulting Limited seeks a skilled Data Engineer to design and maintain scalable data pipelines using Databricks, while transforming data for analytics and BI. You will support Power BI reporting and collaborate with analysts to meet data needs.

Ideal candidates combine solid data engineering fundamentals with practical Power BI knowledge, delivering analytics-ready datasets and reliable data products across the business.