Senior Data Engineer

Iflow Energy Solutions Inc.; Irvine (CA); Remote; USD 140,000 - 180,000; Full time

Job summary

Iflow Energy Solutions Inc. is seeking a Senior Data Engineer to migrate and refactor ETL/ELT and analytics pipelines into a new Databricks environment. You will migrate data, validate parity, and coordinate dashboards and reporting assets across stakeholders.

The role focuses on hands-on migration work, backfills, monitoring, and creating robust runbooks. Candidate should have 6+ years in data engineering and reside in or be able to work across Pacific/Mountain/Central time zones.

Qualifications

• 6+ years of experience in Data Engineering, Analytics Engineering, or Software Engineering working with production data systems.
• Strong expertise in SQL and Python for building scalable data pipelines and transformations.
• Hands-on experience building ELT pipelines using modern cloud data platforms (Databricks experience required).
• Deep experience with dbt, including model development, testing, documentation, and CI/CD integration.
• Experience designing and operating production-grade data pipelines with monitoring and observability.

Responsibilities

• Refactor and migrate ETL/ELT and analytics pipelines to the new Databricks account.
• Migrate data pipelines and datasets, including backfills, and validate parity between source and target.
• Migrate dashboards and downstream reporting assets to point at new datasets.
• Update orchestration, scheduling, alerting, and runbooks for post-cutover support.
• Document migrations and train the team for ongoing ownership.

Skills

SQL

Python

Data Pipelines

ETL/ELT

Testing Frameworks

CI/CD

Collaboration

Databricks

Education

Bachelor's or Master's in CS/Engineering/Math

Tools

Databricks

dbt

FiveTran

CI/CD tooling

Job description

Job Title : Senior Data Engineer
Location : 14410 My ford Road, Irvine, California, United States of America, 92606
Duration:4 Months
Experience:8-10 year

Job Description
Job Title: Sr Data Engineer
Worksite location: Remote with Bill rate, please keep in mind location of the candidate. Submit at market rate.
Would prefer someone in Pacific, Mountain or Central time zone in that order, if possible.
Working hours: 9am - 6pm , can adjust
Travel: N/A
About The Team & The Role
The Core Data team builds and scales the data platform and analytics capabilities that power decision-making across client. Within Core Data, the Vehicle Catalog team owns the vehicle domain ingesting, curating, and organizing vehicle data for analytics, ML, and BI use cases used by hundreds of stakeholders across dozens of domain teams.
We are migrating the Vehicle Catalog to a new Databricks account while simultaneously building out a new vehicle catalog on that platform. As a Sr. Data Engineer, you will help us refactor and move the existing ETL/ELT and analytics pipelines into the new environment, migrate the underlying data, and validate that everything lands correctly.
This is hands-on migration work. You'll be working alongside our engineers on well-defined pipelines with clear acceptance criteria, and you'll pick up related migration requests including dashboard and reporting migrations as they come up.
What You Ll Do

• Work with one of our Staff Data Engineers to understand the migration plan, sequence your work against it, and provide regular progress updates.
• Refactor existing ETL/ELT code written in PySpark, DABs and dbt from the current Databricks environment to meet the patterns and standards of the new account.
• Migrate data pipelines and their underlying datasets, including backfills, and validate parity between source and target.
• Build and run reconciliation checks row counts, schema conformance, freshness, completeness to confirm migrated data matches the legacy environment.
• Migrate dashboards and downstream reporting assets to point at the new datasets, coordinating with the analysts who own them.
• Update orchestration, scheduling, alerting, and runbooks so migrated pipelines are supportable after cutover.
• Troubleshoot pipeline failures and data discrepancies during and after cutover.
• Document what was migrated, what changed, and anything the team needs to know to own it going forward.
• Take on adjacent migration and data engineering requests as the program evolves.

Qualifications
Required

• 6+ years of experience in Data Engineering, Analytics Engineering, or Software Engineering working with production data systems.
• Strong expertise in SQL and Python for building scalable data pipelines and transformations.
• Strong familiarity with AI tools like Claude Code / Devin for SW development process
• Hands-on experience building ELT pipelines using modern cloud data platforms (Databricks experience required).
• Building robust testing frameworks for Data Migration ( Completeness, Quality etc)
• Deep experience with dbt, including model development, testing, documentation, and CI/CD integration
• Experience designing and operating production-grade data pipelines with monitoring and observability.
• Strong collaboration skills and ability to partner with engineering teams, analysts, and operational stakeholders.
• Bachelor s or Master s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent practical experience.
• Prior data or platform migration experience

Nice-to-Have Skills

• Familiarity with FiveTran connector management and ingestion architecture.
• Experience with data contracts and schema governance.
• Knowledge of streaming or near-real-time data pipelines.