Senior Data Engineer — ETL Pipelines, Python/C#, PowerBI

Programmers.Io; Redmond; Vor Ort; AUD 120.000 - 180.000; Vollzeit

Zusammenfassung

Programmers.Io is seeking a skilled Data Engineer to join our team in Western Australia. The ideal candidate brings 5+ years of Python or C# experience and strong data engineering skills to build robust pipelines and analytics.

You will integrate data from APIs and data lakes, ensure data quality, and create real-time dashboards with PowerBI. Strong problem-solving and analytical abilities are essential for driving data-driven decisions.

Qualifikationen

• Bachelor's degree in computer science or engineering.
• 5+ years of Python or C# experience.
• 5+ years of experience with database systems (SQL, Cosmos).
• 2+ years of experience with ETL and log analysis systems (Python, Azure Data Foundry or similar; SQL, Kusto, Application Insights, Grafana, etc.).
• 3+ years' experience creating and maintaining PowerBI dashboards.
• Strong analytical skills and ability to synthesize large datasets to drive decisions.

Aufgaben

• Integrate data from various internal and external sources such as APIs, data lakes, and third-party applications.
• Ensure the quality and consistency of data through validation checks and automated testing.
• Identify and troubleshoot data-related issues, proposing improvements.
• Implement data pipelines that provide clean, accessible, and real-time data for analytical purposes.

Kenntnisse

Python

C#

SQL

Cosmos

ETL

PowerBI

Data analysis

APIs

Logging

Ausbildung

Bachelor's degree in computer science/engineering

Tools

PowerBI

Kusto

Grafana

Application Insights

Azure Data Foundry

SQL

Cosmos DB

Jobbeschreibung

Programmers.Io is seeking a skilled Data Engineer to join our team in Western Australia. The ideal candidate brings 5+ years of Python or C# experience and strong data engineering skills to build robust pipelines and analytics.

You will integrate data from APIs and data lakes, ensure data quality, and create real-time dashboards with PowerBI. Strong problem-solving and analytical abilities are essential for driving data-driven decisions.