Senior Data Engineer — Remote: Scalable AI Data Pipelines

S5 Stratos, Inc.; United States; A distancia; USD 140.000 - 200.000; Jornada completa

Descripción de la vacante

S5 Stratos, Inc. is hiring a Senior Data Engineer for a remote role in the United States. You will design and optimize scalable, event-driven data pipelines in a cloud-based environment, working across APIs and databases and maintaining a data catalog to support data integration.

Responsibilities include building large-scale ETLs, automating data processing, data modeling, and developing analytics tools to enable data-driven decisions in a fast-paced startup setting.

Formación

• Expert-level understanding of relational databases (columnar and row-based).
• Expertise in SQL is a must.
• Proven hands-on experience building complex ETLs in a business environment with large-scale, complex datasets.
• Scripting experience in Python and Bash.
• Fully proficient in pipeline building and job automations.
• Experience building RESTful APIs.
• Experience with error handling and data validation.
• Experience working in GCP or other cloud platforms.
• Must be eligible to work in the US.

Responsabilidades

• Develop and automate large scale, high-performance data processing systems (batch and/or streaming).
• Translate business needs into data models: implement data strategies, build data flows and develop conceptual data models.
• Implement deployment and infrastructure automation strategies.
• Build data support for experimentation efforts, solving problems from statistical test automation to real-time ML pipelines.
• Automate manual processes, optimize data delivery, and redesign infrastructure for scalability.
• Promote data modeling standardization, define and drive adoption of the standards.
• Build analytics and reporting tools that utilize the data pipeline to provide results and business value.
• Maintain and improve existing ETL pipelines.
• Perform routine maintenance and upgrades of server architecture.
• Collaborate with stakeholders to address data-related issues and support data infrastructure needs.
• Apply best practices for testing and deployment in an agile environment.
• Contribute to shared Data Engineering tooling & standards to improve engineering productivity across the company

Conocimientos

Relational databases

SQL

Python

Bash

Git

RESTful APIs

Data pipelines

Data modeling

GCP / cloud platforms

Educación

Bachelor's in Computer Science, Engineering or similar

Herramientas

Git

GCP

Descripción del empleo

S5 Stratos, Inc. is hiring a Senior Data Engineer for a remote role in the United States. You will design and optimize scalable, event-driven data pipelines in a cloud-based environment, working across APIs and databases and maintaining a data catalog to support data integration.

Responsibilities include building large-scale ETLs, automating data processing, data modeling, and developing analytics tools to enable data-driven decisions in a fast-paced startup setting.