Data Engineer - Real-Time Pipelines & Power BI (C#/Python)

Programmers.io; Redmond; On-site; AUD 159,000 - 246,000; Full time

Job summary

Programmers.io in Redmond, WA is seeking a Data Engineer with C#.NET experience to design and maintain scalable data pipelines, integrate data from APIs, data lakes, and third-party apps, and deliver reliable analytics-ready data onsite.

You will work with Python or C#, SQL/Cosmos DB, ETL processes, Azure Data Factory, and Power BI dashboards, applying strong analytical skills and collaboration with cross-functional teams.

Qualifications

• Bachelor's degree in computer science or other engineering disciplines.
• 5+ years of Python or C# experience.
• 5+ years of experience with database systems (SQL, Cosmos).
• 2+ years of experience with ETL (python, Azure Data foundry or similar) and log analysis systems (SQL, Kusto, Application Insights, Grafana, etc.).
• 3+ years’ experience creating and maintaining PowerBI dashboards.
• Strong analytical skills - able to synthesize complex information and large datasets to drive decisions.

Responsibilities

• Integrate data from various internal and external sources such as APIs, data lakes, and third-party applications.
• Ensure the quality and consistency of data through the implementation of validation checks and automated testing.
• Identify and troubleshoot data-related issues, proposing solutions for improvements.
• Implement data pipelines that provide clean, accessible, and real-time data for analytical purposes.

Skills

Analytical thinking

Data integration

Education

Bachelor's degree in computer science or engineering

Tools

Python

C#

SQL

Cosmos DB

ETL

Azure Data Factory

Power BI

Azure DevOps

KQL

APIs

Workflow integration

Job description

Programmers.io in Redmond, WA is seeking a Data Engineer with C#.NET experience to design and maintain scalable data pipelines, integrate data from APIs, data lakes, and third-party apps, and deliver reliable analytics-ready data onsite.

You will work with Python or C#, SQL/Cosmos DB, ETL processes, Azure Data Factory, and Power BI dashboards, applying strong analytical skills and collaboration with cross-functional teams.