Senior Data Platform Engineer: Real-Time & ETL Lead

INOPTRA DIGITAL

United States

Remote

USD 120,000 - 180,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Inoptra Digital is seeking a Senior Data Engineer to lead the design and development of batch and real-time data pipelines, building scalable data workflows for performance and cost. You will design ETL/ELT solutions, establish data quality and observability standards, and drive data integration across multiple source systems while mentoring engineers.

The role requires strong SQL, Python or Java, Spark and Airflow experience, and hands-on cloud platform skills.

Qualifications

  • 10 to 15 years of experience in Data Engineering.
  • Expert SQL skills.
  • Strong Python or Java development skills.
  • Good experience with Apache Spark and Apache Airflow, including performance tuning.
  • Experience with Dremio.
  • Strong experience designing solutions on modern data platforms.
  • Good experience with Google Cloud Platform.
  • Strong data modeling skills.
  • Experience with Git and CI/CD.
  • Proven experience leading technical design and mentoring engineers.
  • Professional English proficiency.
  • Preferred: Data Mesh experience or awareness.
  • Preferred: Scala.
  • Preferred: Kafka and streaming technologies.
  • Preferred: Banking or insurance sector experience.

Responsibilities

  • Lead the design and development of batch and real-time data pipelines.
  • Build and optimize large-scale data processing workflows for performance and cost.
  • Design ETL/ELT solutions using modern frameworks.
  • Define data quality, monitoring and observability standards.
  • Drive data integration across multiple source systems.
  • Lead technical delivery of cloud-native data platform initiatives.
  • Work with architects and business stakeholders on solution design.
  • Enforce software engineering and DataOps best practices through code reviews.
  • Lead and mentor mid-level and junior engineers.

Skills

SQL
Python
Java
Spark
Airflow
Dremio
Data modeling
GCP
Git
CI/CD
Data Mesh
Scala
Kafka
Streaming tech
Banking/Insurance domain

Tools

Git
CI/CD
Kafka
Spark
Airflow
Dremio
GCP
Scala

Job description

Inoptra Digital is seeking a Senior Data Engineer to lead the design and development of batch and real-time data pipelines, building scalable data workflows for performance and cost. You will design ETL/ELT solutions, establish data quality and observability standards, and drive data integration across multiple source systems while mentoring engineers.

The role requires strong SQL, Python or Java, Spark and Airflow experience, and hands-on cloud platform skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Data Platforms
Senior Data Engineer - Data Platforms

INOPTRA DIGITAL • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Gennte Technologies • Pittsburgh

Hybrid
USD 100,000 - 140,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Platform Engineer – Real-Time Analytics
Senior Data Platform Engineer – Real-Time Analytics

TEKsystems • Addison (TX)

On-site
USD 175,000 - 200,000
Unlimited PTO
Volunteer day
Bonus eligibility
+4
Senior Data Platform Engineer
Senior Data Platform Engineer

Harnham • Los Angeles (CA)

On-site
USD 120,000 - 150,000
Data Engineer — Real-Time Streaming & Data Platforms
Data Engineer — Real-Time Streaming & Data Platforms

Infinitive Inc • McLean (VA)

On-site
USD 104,000 - 140,000
Senior Cloud Data Engineer: Real-Time Pipelines
Senior Cloud Data Engineer: Real-Time Pipelines

Recru • Houston (TX)

On-site
USD 130,000 - 180,000
Senior Data Engineer - Cloud Data Pipelines
Senior Data Engineer - Cloud Data Pipelines

Invesco EMEA • Atlanta (GA)

Hybrid
USD 120,000 - 180,000
Flexible PTO
Hybrid work schedule
401(k) matching
+3
Senior Data Engineer
Senior Data Engineer

Continuus Technologies LLC • Town of Germantown (WI)

On-site
USD 110,000 - 170,000
Senior Data Engineer — Real-Time Data Platforms Lead
Senior Data Engineer — Real-Time Data Platforms Lead

HITEC • Charlotte (NC)

On-site
USD 150,000 - 190,000