Senior Data Engineer - Scalable PostgreSQL ETL & Migrations

Inherent Technologies; San Jose (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Inherent Technologies in San Jose, CA is seeking a Senior Data Engineer to lead a critical migration to a PostgreSQL-based data platform. You will own end-to-end ETL/ELT pipelines, validate data quality, and align migration scope and timelines with business stakeholders.

The role emphasizes hands-on design, performance tuning, and mentoring junior engineers. You will optimize loads for millions of records, implement robust monitoring, and document mappings and runbooks to ensure a reliable,

Qualifications

• 5+ years of data engineering with large-scale migrations.
• Proficient in Python for building data pipelines.
• Expertise in PostgreSQL and Oracle performance tuning.
• Experience designing ETL/ELT at scale with millions of records.
• Knowledge of data validation and reconciliation techniques.

Responsibilities

• Lead migration of high-volume data into PostgreSQL infrastructure.
• Build and maintain robust ETL/ELT pipelines.
• Map legacy data structures to a unified schema.
• Define data validation frameworks for integrity and completeness.
• Optimize pipelines with tuning and incremental loads.
• Troubleshoot data quality issues and migrations failures.
• Document mappings, logic, and runbooks for stakeholders.
• Collaborate with stakeholders to align scope and timelines.
• Establish monitoring and alerting for post-migration quality.
• Mentor junior engineers and share best practices.

Skills

Python

PostgreSQL

Oracle

ETL/ELT pipelines

Data migration

Data modeling

Data validation

CI/CD for data pipelines

Tools

Airflow

Dagster

Prefect

Git

Docker

Terraform

dbt tests

Great Expectations

Job description

Inherent Technologies in San Jose, CA is seeking a Senior Data Engineer to lead a critical migration to a PostgreSQL-based data platform. You will own end-to-end ETL/ELT pipelines, validate data quality, and align migration scope and timelines with business stakeholders.

The role emphasizes hands-on design, performance tuning, and mentoring junior engineers. You will optimize loads for millions of records, implement robust monitoring, and document mappings and runbooks to ensure a reliable,