Data Engineer

Oscar; Grand Prairie (TX); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

15 days of PTO

401(k) enrollment

Relocation assistance

Job summary

Oscar is seeking an experienced Data Engineer to design and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data. The ideal candidate has 5+ years of Data Engineering experience, strong SQL and Python skills, and hands-on experience with scalable data pipelines.

This role involves building batch and real-time processing solutions using Spark/PySpark and working with cloud platforms like Databricks and Snowflake.

Qualifications

• 5+ years of professional Data Engineering experience; additional experience is welcome for the right candidate.
• Strong proficiency in SQL and Python.
• Hands-on experience building scalable data pipelines.
• Experience with Lakehouse and/or Medallion architectures.
• Strong understanding of ETL/ELT, data integration, and data transformation.

Responsibilities

• Design, develop, and maintain scalable cloud data pipelines for high-volume data.
• Build batch and real-time data processing solutions using Spark/PySpark, Kafka, and Airflow.
• Develop data ingestion, transformation, and integration workflows using SQL and Python.
• Process and integrate large volumes of manufacturing, operational, and IoT data.
• Troubleshoot data pipeline issues and improve data quality and performance.

Skills

SQL

Python

Data Engineering

Apache Spark

Apache Kafka

Airflow

Lakehouse architecture

Medallion architecture

ETL/ELT

Data integration

Tools

Databricks

Snowflake

AWS

Azure

Delta Lake

Job description

About the Role

We are seeking an experienced Data Engineer to design, build, and maintain scalable cloud data pipelines supporting high-volume manufacturing and IoT data.

The ideal candidate will have strong hands-on experience with SQL and Python, modern cloud data platforms, and Lakehouse/Medallion architectures. This is a hands‑on engineering role focused on building reliable data pipelines, processing large datasets, and developing scalable data solutions.

Key Responsibilities

• Design, develop, and maintain scalable cloud data pipelines for high-volume data.
• Build batch and real‑time data processing solutions using Spark/PySpark, Kafka, and Airflow.
• Develop data ingestion, transformation, and integration workflows using SQL and Python.
• Design and implement Lakehouse and Medallion architecture solutions.
• Work with cloud data platforms including Databricks, Snowflake, AWS, and/or Azure.
• Build and optimise ETL/ELT pipelines for performance, scalability, and reliability.
• Process and integrate large volumes of manufacturing, operational, and IoT data.
• Troubleshoot data pipeline issues and improve data quality and performance.
• Collaborate with engineering, analytics, and business teams to develop production‑ready data solutions.

Qualifications

• 5+ years of professional Data Engineering experience; additional experience is welcome for the right candidate.
• Strong proficiency in SQL and Python.
• Hands‑on experience building scalable data pipelines.
• Experience with Lakehouse and/or Medallion architectures.
• Experience with Databricks, Snowflake, AWS, and/or Azure.
• Strong experience with Apache Spark and/or PySpark.
• Experience with Apache Kafka and/or other streaming technologies.
• Experience with Apache Airflow or other data orchestration tools.
• Experience working with Delta Lake or similar data lake technologies.
• Strong understanding of ETL/ELT, data integration, and data transformation.

Benefits

Full‑time employees receive a benefits package, including:

• Medical, dental, and vision coverage
• 100% company contribution toward employee medical coverage
• 80% company contribution toward medical coverage for immediate dependents
• 15 days of PTO
• 10 paid holidays, including 8 fixed holidays and 2 floating holidays
• 401(k) enrollment with employee contributions
• Relocation assistance

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.