Senior Data Engineer

iScale Solutions

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Salary package
Vacation and sick leave
Health coverage
Statutory benefits
Training and mentorship
Team engagement
Modern tools
Career growth
Inclusive culture

Job summary

Iscale Solutions is seeking a data engineer to design, develop, and maintain large-scale ETL/ELT pipelines across multiple platforms. You will lead technical design, define processing logic and data models, and drive scalable, secure data solutions.

You will write efficient SQL, Hive queries, and Python code, apply Spark where appropriate, and build AWS workflows using S3, Athena, EC2, and EMR. Collaborate with analytics and product teams, mentor 2–3 engineers, and ensure data quality and

Qualifications

  • 5+ years of professional experience in data engineering.
  • Ownership of production data pipelines and large-scale processing.
  • Strong SQL, including joins, window functions, tuning.
  • Hive and Hadoop ecosystem expertise.
  • Python for data processing, automation, and production code.
  • Hands-on with S3, Athena, EC2, EMR.
  • Experience with Airflow or similar ETL/orchestration tool.
  • Translate business requirements into technical designs; communicate clearly.

Responsibilities

  • Own data pipeline development across ingest, transform, and delivery.
  • Lead technical design of processing logic, data models, integration approaches, and workflows.
  • Develop and optimize data processing with SQL, Hive, Python, and Spark as needed.
  • Build and manage AWS workflows (S3, Athena, EC2, EMR); monitor resources.
  • Maintain automated workflows with Airflow including scheduling, retries, and alerts.
  • Mentor a small team; review code/designs; support delivery commitments.

Skills

SQL
Hive
Python
Apache Airflow
PySpark
AWS
Snowflake
OpenAI Codex
Snowflake Cortex
Git
Jira/Confluence

Tools

S3
Athena
EC2
EMR
Airflow
Snowflake
OpenAI Codex
Snowflake Cortex
Git
Jira
Confluence

Job description

Own data pipeline development: Design, develop, and maintain reliable ETL/ELT pipelines for ingesting, transforming, and delivering large-scale datasets across multiple platforms and sources.

Lead technical design: Define processing logic, data models, integration approaches, and workflow dependencies, considering scalability, maintainability, security, and cost.

Develop and optimize data processing: Write efficient SQL, Hive queries, and Python code. Apply distributed processing frameworks such as Spark where appropriate.

Build and manage AWS workflows: Develop and support data solutions using Amazon S3, Athena, EC2, and EMR, including monitoring and resource optimization.

Manage workflow orchestration: Build and maintain automated workflows using Apache Airflow or comparable orchestration tools, including scheduling, dependencies, retries, alerting, and recovery.

Ensure production reliability: Monitor pipeline performance and data freshness, investigate failures, perform root cause analysis, and implement improvements that prevent recurring issues.

Maintain data quality and governance : Establish validation checks, reconciliation processes, lineage documentation, and appropriate access controls throughout the data lifecycle.

Lead and mentor a small team: Guide 2-3 engineers, break requirements into actionable tasks, review code and designs, support troubleshooting, and track delivery commitments.

Collaborate with stakeholders: Work closely with analytics, product, engineering, and data science teams to clarify requirements, agree on priorities, communicate progress, and manage dependencies.

Maintain technical documentation: Create and update solution designs, data flow diagrams, data dictionaries, operating procedures, and support runbooks using Confluence or similar platforms.

Apply AI to engineering workflows: Identify practical opportunities to use AI for development, documentation, troubleshooting, and automation. Build simple AI agents and validate their outputs before operational use.

Support agile delivery: Manage work through Jira, contribute to sprint planning and technical reviews, and coordinate across regions and work schedules as required.

Requirements

Requirements:

5+ years of professional experience in data engineering, with demonstrated ownership of production data pipelines and large-scale data processing.

Strong SQL expertise, including complex joins, window functions, transformations, query tuning, and troubleshooting.

Strong working knowledge of Hive and the Hadoop ecosystem, including partitioning, storage formats, and distributed data processing concepts.

Proficiency in Python for data processing, automation, integration, and maintainable production code.

Hands-on experience with Amazon S3, Athena, EC2, and EMR.

Strong experience with Apache Airflow or another ETL/workflow orchestration tool, with Airflow preferred.

Experience implementing data quality checks, monitoring, error handling, and operational support processes.

Ability to translate business requirements into technical designs and deliver solutions with minimal supervision.

Strong documentation and communication skills, including the ability to explain technical issues clearly to business and technical stakeholders.

Working experience with Jira and Confluence for task tracking, delivery coordination, and documentation.

Practical understanding of AI capabilities and limitations, along with hands-on experience creating simple AI agents or AI-assisted automations.

Experience with version control, code reviews, and collaborative development practices.

Preferred Qualifications

Hands-on experience with Apache Spark using PySpark or Scala.

Experience with Snowflake, including data transformation, query optimization, and integration with cloud data pipelines.

Practical experience using OpenAI Codex for engineering tasks and Snowflake Cortex for AI-enabled data workflows.

Previous experience mentoring engineers, leading technical delivery, or managing a small team. Formal people management experience is an added advantage.

Experience supporting marketing technology, audience data, campaign reporting, or customer analytics.

What we offer:

Competitive Salary Package: Receive a pay package that matches your skills and experience.

Vacation and Sick Leave credits: Enjoy vacation and sick leave credits to maintain work-life balance.

Health Coverage: Get medical, dental, and vision insurance for you and your dependents.

Government-Mandated Benefits: Full coverage of all statutory benefits like SSS, PhilHealth, and Pag-IBIG.

Learning Opportunities: Access training, certifications, and mentorship to grow your career.

Team Engagement: Join team-building activities and wellness programs.

Modern Tools: Use the latest technology to excel in your role.

Career Growth: Clear paths for promotion and professional development.

Inclusive Culture: Be part of a diverse, supportive, and collaborative global team.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines
Senior Big Data Engineer: Spark, Hadoop & Cloud Pipelines

Compunnel Inc. • Tysons (VA)

On-site
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

AHL - Saaf AI • United States

Remote
USD 120,000 - 190,000
Unlimited PTO
Remote-first with flexible hours
Development budget
+1
Data Engineer
Data Engineer

Riseup Labs • United States

Remote
USD 120,000 - 180,000
General Leave
Festival Bonus
Annual Salary Review
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Data Engineer
Data Engineer

Free resume • United States

Remote
USD 120,000 - 180,000
Data Engineer: Scalable ETL & Analytics Pipelines
Data Engineer: Scalable ETL & Analytics Pipelines

Compunnel Inc. • Pennsylvania

Hybrid
USD 85,000 - 125,000
Staff Data Engineer
Staff Data Engineer

Join9am • United States

Remote
USD 150,000 - 190,000
Remote work options
Professional development budget
Health, dental, and vision coverage
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Sr Data Engineer
Sr Data Engineer

Recurring Decimal • Dallas (TX)

On-site
USD 130,000 - 190,000
Senior Data Engineer
Senior Data Engineer

VS Tech Solutions • Boise (ID)

Remote
USD 110,000 - 150,000
Comprehensive Healthcare: Medical, Dental and Vision
401(k) with company match
Fully remote opportunities available
+1