Senior Data Platform Engineer — Cloud Data Pipelines

Quest Oracle Community; Trenton (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

Quest Oracle Community seeks a Senior Data Platform Engineer to design and operate cloud native data pipelines, storage, and serving layers. You will apply distributed processing and orchestration to deliver scalable, high-quality data products, while focusing on performance, reliability, and cost optimization across the platform.

This hands-on, code-oriented role requires strong Python, SQL, Spark, and CI/CD skills, with experience in Azure or AWS data services.

Qualifications

• 5-8+ years in cloud data engineering roles.
• Strong hands-on proficiency in Python, SQL, Spark, orchestration frameworks, and CI/CD.
• Experience integrating and validating data from multiple storage systems, APIs, and external systems.
• Experience with data quality, data validation, and lineage tooling.
• Hands-on experience with Azure or AWS data services (e.g., ADLS/S3, ADF/Glue, Databricks/EMR).

Responsibilities

• Design, build, and operate cloud native data pipelines, storage, compute, and serving layers.
• Apply distributed processing and orchestration to deliver scalable data products and services.
• Develop data pipelines for batch, streaming, API, and CDC ingestion patterns.
• Implement InfrastructureasCode and robust CI/CD pipelines for deployment.
• Provide oncall support, incident response, and establish SLOs for latency and reliability.
• Collaborate with analytics, governance, MDM, and data product teams to ensure standards.
• Mentor junior engineers and develop reusable templates and patterns.

Skills

Python

SQL

Spark

Orchestration frameworks

CI/CD

Tools

Azure

AWS

Databricks

ADLS/S3

ADF/Glue

Job description

Quest Oracle Community seeks a Senior Data Platform Engineer to design and operate cloud native data pipelines, storage, and serving layers. You will apply distributed processing and orchestration to deliver scalable, high-quality data products, while focusing on performance, reliability, and cost optimization across the platform.

This hands-on, code-oriented role requires strong Python, SQL, Spark, and CI/CD skills, with experience in Azure or AWS data services.