Senior Data Engineer – Forecasting Platforms - #26-27213

Us Tech Solutions; Juno Beach (FL); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

Us Tech Solutions is seeking a Senior Data Engineer to develop, maintain, and optimize data pipelines supporting load, wind, and solar energy forecasting within the AURA ecosystem. You will blend data engineering with production support to keep data flowing and forecasting apps reliable.

Responsibilities include building ETL/ELT pipelines with Python and SQL, integrating data from APIs, databases, and cloud storage, and supporting PostgreSQL and other databases.

Qualifikationen

• Design, build, and maintain ETL/ELT pipelines using Python and SQL.
• Integrate data from APIs, databases, flat files, SFTP, cloud storage, and external sources.
• Support PostgreSQL and other relational databases.
• Implement data-quality checks, monitoring, logging, and automated recovery processes.
• Troubleshoot failed data pipelines, scheduled jobs, cloud applications, and data-delivery issues.

Aufgaben

• Design, build, and maintain ETL/ELT pipelines using Python and SQL.
• Integrate data from APIs, databases, flat files, SFTP, cloud storage, and external sources.
• Support PostgreSQL and other relational databases.
• Implement data-quality checks, monitoring, logging, and automated recovery processes.
• Troubleshoot failed data pipelines, scheduled jobs, cloud applications, and data-delivery issues.
• Support AWS-hosted applications and services, including S3, Lambda, ECS, EC2, and CloudWatch.
• Assist with deployments, incident resolution, root-cause analysis, and production support.
• Automate manual processes and document technical procedures and system dependencies.
• Collaborate with Data Scientists to provide reliable data for forecasting models.

Kenntnisse

Python

SQL

ETL/ELT Pipelines

AWS Cloud

Monitoring & Troubleshooting

Data Quality Checks

Ausbildung

Bachelor's degree

Tools

PostgreSQL

S3

Lambda

EC2

ECS

CloudWatch

Git

Jobbeschreibung

Duration: 12 months Contract

Job Description

The Senior Data Engineer will develop, maintain, and improve data pipelines and integrations supporting load, wind, and solar energy forecasting within the AURA ecosystem. The role combines data engineering with production application support, ensuring data flows reliably and forecasting applications remain operational.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines using Python and SQL.
• Integrate data from APIs, databases, flat files, SFTP, cloud storage, and external sources.
• Support PostgreSQL and other relational databases.
• Implement data-quality checks, monitoring, logging, and automated recovery processes.
• Troubleshoot failed data pipelines, scheduled jobs, cloud applications, and data-delivery issues.
• Support AWS-hosted applications and services, including S3, Lambda, ECS, EC2, and CloudWatch.
• Assist with deployments, incident resolution, root-cause analysis, and production support.
• Automate manual processes and document technical procedures and system dependencies.
• Collaborate with Data Scientists to provide reliable data for forecasting models.

Experience

• Strong experience developing and supporting ETL/ELT or data-integration pipelines.
• Proficiency in Python and advanced SQL.
• Experience with relational databases such as PostgreSQL, Oracle, or SQL Server.
• Experience integrating data through APIs, SFTP, databases, and cloud storage.
• Experience troubleshooting production data pipelines and scheduled jobs.
• Experience with AWS or similar cloud platforms.
• Knowledge of monitoring, logging, root-cause analysis, Git, and software-development practices.

Skills

• Python - Data processing, automation, and pipeline development.
• SQL & Databases - Advanced SQL and PostgreSQL, Oracle, or SQL Server.
• ETL/ELT Data Pipelines - Building and maintaining data ingestion and transformation workflows.
• AWS Cloud - Experience with S3, Lambda, EC2, ECS, and CloudWatch.
• Production Support & Troubleshooting - Fixing failed pipelines, scheduled jobs, data integrations, and application issues.

Education

• Bachelor's degree, Information Technology, Computer Science, Engineering, or a related discipline. Equivalent relevant professional experience will be considered.

Additional Qualifications

• Shift Hours: 8:00AM -5:00 PM EST

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement

By applying, you acknowledge that AI-assisted tools may be used during hiring.