Data Engineer - On-Premise Data Warehouse Support

Syren Cloud Inc.; Washington; On-site; USD 90,000 - 130,000; Full time

Job summary

Syren Cloud Inc. is seeking a Data Engineer to support an on-premise Data Warehouse and collaborate on cloud data warehouse initiatives. The role covers monitoring, troubleshooting, and building pipelines across on-prem and cloud environments.

You will design data models, implement ETL strategies, and ensure data governance while working with cross-functional teams to minimize downtime and technical debt.

Qualifications

• Requires experience with on-premise data warehouse operations, data quality, and production support.
• Ability to troubleshoot and resolve production issues in SSIS and T-SQL pipelines.
• Experience designing data models and ETL strategies for cloud and on-prem environments.

Responsibilities

• Monitor and re-run failed data pipelines and workflows in the on-premise data warehouse.
• Troubleshoot production issues and implement bug fixes to maintain data integrity.
• Design, build, and test data pipelines for cloud data warehouse initiatives using ADF.
• Implement Medallion Architecture and optimize batch and streaming jobs for timely data refresh.
• Document runbooks and collaborate with onshore/offshore teams to ensure smooth operations.

Skills

SSIS

T-SQL

Azure Data Factory

Data modeling

ETL pipelines

Data governance

Tools

Azure Data Factory (ADF)

Job description

Data Engineer - On-Premise Data Warehouse Support

6 - 9

USA

Full-Time

Location: Atlanta, GA

1. Introduction

This proposal outlines the engagement for Offshore Data Engineering Support to manage and maintain the on-premises Data Warehouse and contribute to the development of business requirements in the Cloud Data Warehouse .

The assigned resources will focus on monitoring, troubleshooting, and resolving production issues in the on-premises environment while also building data models and pipelines in the cloud using Azure Data Factory (ADF) .

2. Scope of Work

On-Premise Data Warehouse Support

• Monitor and re-run failed data pipelines and workflows to ensure seamless operations on SSIS & T-SQL .
• Troubleshoot and resolve production issues, focusing exclusively on bug fixes.
• Maintain data accuracy and integrity across all pipelines.
• Conduct root cause analysis for recurring failures and document resolutions.
• Provide daily status reports on pipeline execution, highlighting failures, root causes, and applied fixes.
• Collaborate with onshore teams to address critical production incidents.
• Implement temporary workarounds to minimize downtime while working toward permanent solutions.

Cloud Data Warehouse Development

• Gather and analyze business requirements for business datasets in the cloud.
• Design, develop, and test data pipelines to support Cloud Data Warehouse initiatives.
• Build and optimize batch processing and streaming jobs to ensure timely data refresh.
• Implement Medallion Architecture and design models for structured data processing across different layers.
• Collaborate with onshore teams to establish best practices and reduce technical debt.
• Define data models and ETL strategies in alignment with stakeholder requirements.
• Participate in regular stand-ups and discussions with onshore and offshore teams to ensure seamless collaboration.
• Ensure compliance with data governance policies, security standards, and best practices.
• Develop and maintain comprehensive runbooks to document cloud operations, ensuring clear, step-by-step guidance for troubleshooting and maintenance.
• Standardize and optimize cloud workflows by creating detailed documentation that enhances efficiency, reduces downtime, and supports seamless knowledge transfer across teams.