Senior Data Engineer: Lead Scalable ETL & AI Pipelines

Iscale Solutions; United States; Teletrabalho; USD 120 000 - 180 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Salary package

Vacation and sick leave

Health coverage

Statutory benefits

Training and mentorship

Team engagement

Modern tools

Career growth

Inclusive culture

Resumo da oferta

Iscale Solutions is seeking a data engineer to design, develop, and maintain large-scale ETL/ELT pipelines across multiple platforms. You will lead technical design, define processing logic and data models, and drive scalable, secure data solutions.

You will write efficient SQL, Hive queries, and Python code, apply Spark where appropriate, and build AWS workflows using S3, Athena, EC2, and EMR. Collaborate with analytics and product teams, mentor 2–3 engineers, and ensure data quality and

Qualificações

• 5+ years of professional experience in data engineering.
• Ownership of production data pipelines and large-scale processing.
• Strong SQL, including joins, window functions, tuning.
• Hive and Hadoop ecosystem expertise.
• Python for data processing, automation, and production code.
• Hands-on with S3, Athena, EC2, EMR.
• Experience with Airflow or similar ETL/orchestration tool.
• Translate business requirements into technical designs; communicate clearly.

Responsabilidades

• Own data pipeline development across ingest, transform, and delivery.
• Lead technical design of processing logic, data models, integration approaches, and workflows.
• Develop and optimize data processing with SQL, Hive, Python, and Spark as needed.
• Build and manage AWS workflows (S3, Athena, EC2, EMR); monitor resources.
• Maintain automated workflows with Airflow including scheduling, retries, and alerts.
• Mentor a small team; review code/designs; support delivery commitments.

Conhecimentos

SQL

Hive

Python

Apache Airflow

PySpark

AWS

Snowflake

OpenAI Codex

Snowflake Cortex

Git

Jira/Confluence

Ferramentas

S3

Athena

EC2

EMR

Airflow

Snowflake

OpenAI Codex

Snowflake Cortex

Git

Jira

Confluence

Descrição da oferta de emprego

Iscale Solutions is seeking a data engineer to design, develop, and maintain large-scale ETL/ELT pipelines across multiple platforms. You will lead technical design, define processing logic and data models, and drive scalable, secure data solutions.

You will write efficient SQL, Hive queries, and Python code, apply Spark where appropriate, and build AWS workflows using S3, Athena, EC2, and EMR. Collaborate with analytics and product teams, mentor 2–3 engineers, and ensure data quality and