Senior Data Engineer - Data Pipelines (Remote India)

Openkrill; United States; Remote; USD 140,000 - 170,000; Full time

Job summary

Oportun is seeking a Senior Data Engineer to design and operate secure, scalable data products powering audience selection, eligibility, consent, and campaign inputs. You will deliver reliable Databricks-based pipelines, improve data quality and observability, and provide technical leadership across cross-functional initiatives that support timely, relevant member communications.

You will lead complex data engineering efforts from requirements through production, collaborating with Privacy,

Qualifications

• 6+ years of data engineering experience focusing on data pipelines and lakehouse management.
• Bachelor's or Master's in CS/Data Science/Engineering or equivalent; strong Python/PySpark and SQL.
• Experience with Databricks, Spark, Delta Lake, CI/CD, Git workflows, and end-to-end data integrations in production.
• Experience with data quality, observability, alerting, lineage, and cloud platforms (AWS).

Responsibilities

• Design scalable, secure data architectures for member communications with clear data ownership.
• Lead complex data engineering initiatives from requirements to production, coordinating teams across engineers and stakeholders.
• Build production-grade data pipelines and integrations using Databricks, Spark, PySpark, Spark SQL, and Delta Lake.
• Establish data quality, governance, monitoring, runbooks, and lineage; address privacy, compliance, and security considerations.
• Collaborate with Product, Analytics, Engineering, Privacy, Compliance, and Security to deliver reliable data products.

Skills

Python

PySpark

SQL

Leadership

Communication

Education

Bachelor's or Master's in Computer Science / Data Science / Engineering

Tools

Databricks

Apache Spark

Spark SQL

Delta Lake

CI/CD

Git workflows

Job description

Oportun is seeking a Senior Data Engineer to design and operate secure, scalable data products powering audience selection, eligibility, consent, and campaign inputs. You will deliver reliable Databricks-based pipelines, improve data quality and observability, and provide technical leadership across cross-functional initiatives that support timely, relevant member communications.

You will lead complex data engineering efforts from requirements through production, collaborating with Privacy,