Data Engineer

SoftPathTechnologies; Redmond (WA); On-site; USD 120,000 - 160,000; Full time

Job summary

SoftPathTechnologies in Redmond, WA is seeking a Data Engineer with 5+ years of experience in Python or C#, and strong database and ETL skills. You will build scalable data pipelines, integrate APIs and data sources, and deliver analytics-ready data via dashboards.

The role emphasizes data quality, log analysis, and working with SQL, Cosmos DB, and Azure Data Factory to support technical and business decisions.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or another engineering discipline.
• 5+ years of experience with Python or C#
• 5+ years of experience with database systems
• Strong experience with SQL and/or Cosmos DB
• 2+ years of experience with ETL technologies and data pipeline development
• Experience with Azure Data Factory or similar ETL/data integration platforms
• Experience with log analysis using SQL, Kusto, Application Insights, Grafana, or similar tools
• 3+ years of experience creating and maintaining Power BI dashboards
• Experience working with APIs and workflow integrations
• Strong analytical and problem-solving skills
• Ability to synthesize complex information and large datasets to support technical and business decisions

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Integrate data from internal and external sources, including APIs, data lakes, and third-party applications.
• Develop ETL workflows using Python, Azure Data Factory, or similar technologies.
• Work with SQL, Kusto Query Language (KQL), and Cosmos DB.
• Implement data validation, reconciliation, and automated testing.
• Analyze application and system logs to identify data and operational issues.
• Troubleshoot data-related problems and implement long-term solutions.
• Develop and maintain Power BI dashboards and reports.
• Integrate APIs and workflow-based services.
• Ensure data is clean, consistent, accessible, and suitable for analytical use.
• Collaborate with engineering, analytics, and application teams.
• Support data pipeline monitoring and production troubleshooting.

Skills

Python

C#

SQL

Cosmos DB

KQL

ETL

Azure Data Factory

Power BI

APIs

Data analysis

Grafana

Education

Bachelor's degree in Computer Science/Engineering

Tools

Azure Data Factory

Cosmos DB

Grafana

Application Insights

Job description

Data Engineer C#/.NET Experience

Position: Full-Time
Location: Redmond, WA
Experience: 5+ years

Job Summary

We are looking for a Data Engineer with strong experience in Python or C#, database technologies, ETL, data pipelines, log analysis, and cloud-based data services.

The ideal candidate will be responsible for integrating data from multiple sources, developing reliable data pipelines, maintaining data quality, troubleshooting data issues, and delivering actionable analytics through dashboards and reporting solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Integrate data from internal and external sources, including APIs, data lakes, and third-party applications.
• Develop ETL workflows using Python, Azure Data Factory, or similar technologies.
• Work with SQL, Kusto Query Language (KQL), and Cosmos DB.
• Implement data validation, reconciliation, and automated testing.
• Analyze application and system logs to identify data and operational issues.
• Troubleshoot data-related problems and implement long-term solutions.
• Develop and maintain Power BI dashboards and reports.
• Integrate APIs and workflow-based services.
• Ensure data is clean, consistent, accessible, and suitable for analytical use.
• Collaborate with engineering, analytics, and application teams.
• Support data pipeline monitoring and production troubleshooting.

Required Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or another engineering discipline.
• 5+ years of experience with Python or C#.
• 5+ years of experience working with database systems.
• Strong experience with SQL and/or Cosmos DB.
• 2+ years of experience with ETL technologies and data pipeline development.
• Experience with Azure Data Factory or similar ETL/data integration platforms.
• Experience with log analysis using SQL, Kusto, Application Insights, Grafana, or similar tools.
• 3+ years of experience creating and maintaining Power BI dashboards.
• Experience working with APIs and workflow integrations.
• Strong analytical and problem-solving skills.
• Ability to synthesize complex information and large datasets to support technical and business decisions.

Preferred Skills

• Azure cloud services
• Kusto Query Language (KQL)
• Azure Data Factory
• Cosmos DB
• Application Insights
• Azure DevOps
• Git and CI/CD
• Data quality and automated validation
• Data lake technologies
• API integration
• Real-time data processing
• Power BI