Data Engineer: Real-Time Pipelines & Dashboards

Programmers.io; Redmond; Presencial; AUD 140 000 - 180 000; Tempo integral

Resumo da oferta

Programmers.io is seeking a data-focused engineer to integrate data from diverse sources, ensure quality and consistency, and troubleshoot data-related issues. You will design and maintain ETL pipelines, enabling real-time access to analytics data across systems.

The role emphasizes Python/C# development, SQL/Cosmos database experience, and building PowerBI dashboards to support data-driven decisions.

Qualificações

• Bachelor's degree in computer science or related engineering field.
• 5+ years of Python or C# experience.
• 5+ years of experience with database systems (SQL, Cosmos).
• 2+ years of experience with ETL and log analysis systems (SQL, Kusto, Application Insights, Grafana).
• 3+ years’ experience creating and maintaining PowerBI dashboards.

Responsabilidades

• Integrate data from APIs, data lakes, and third-party apps.
• Ensure data quality through validation checks and automated testing.
• Identify and troubleshoot data-related issues and propose improvements.
• Implement data pipelines that provide clean, real-time data for analytics.

Conhecimentos

Python

C#

Analytical skills

Formação académica

Bachelor's degree in computer science or engineering

Ferramentas

SQL

Cosmos DB

Kusto

Application Insights

Grafana

PowerBI

Azure Data Factory

ETL pipelines

Descrição da oferta de emprego

Programmers.io is seeking a data-focused engineer to integrate data from diverse sources, ensure quality and consistency, and troubleshoot data-related issues. You will design and maintain ETL pipelines, enabling real-time access to analytics data across systems.

The role emphasizes Python/C# development, SQL/Cosmos database experience, and building PowerBI dashboards to support data-driven decisions.