Databricks Data Engineer

Robotics Technologies; Dallas (TX); On-site; USD 63,000 - 89,000; Full time

Job summary

Robotics Technologies LLC in Harrisburg, PA is seeking a Databricks Data Engineer for a hands-on, architecture-driven role. The engineer will design and implement a scalable Sales Data Platform on Databricks (AWS) and lead data ingestion, transformation, and modelling activities.

The position focuses on ACID-compliant, restartable pipelines with CDC and advanced joins/aggregations, ensuring governed, high-performance datasets for downstream consumers.

Qualifications

• Experience designing scalable data platforms on Databricks.
• Proficient in lakehouse patterns Bronze/Silver/Gold.
• Strong ETL/ELT and SQL background.

Responsibilities

• Lead design of scalable Sales Data Platform on Databricks (AWS).
• Build PySpark data pipelines and optimize data flows.
• Define end-to-end Lakehouse architecture and data modelling standards.
• Implement CDC, incremental processing, and fault-tolerant pipelines.
• Ensure performance, scalability, and cost optimization.

Skills

Databricks

PySpark

Data pipelines

Lakehouse architecture

CDC

Incremental processing

Watermarking

ACID transactions

Performance optimization

Tools

Databricks on AWS

SQL

Job description

Job Title :Databricks Data Engineer
Job Type : C2C/1099 Contract
Location :Harrisburg, PA
Duration :10 months
Bill Rate : $55/Hr on c2c

Role Summary

• We are seeking a Databricks Engineer to lead the design and implementation of a scalable Sales Data Platform as part of the One Data initiative on Databricks running on AWS.
• The role is hands-on and architecture-driven, focused on data ingestion, transformation, modelling, and optimization using modern Lakehouse patterns.
• The architect will work closely with data engineers, source system teams, and downstream consumers to deliver high-quality, governed, and performance-optimized sales datasets.
• Define end-to-end Lakehouse architecture on Databricks (AWS) for Sales data domains.
• Design medallion architecture (Bronze / Silver / Gold) aligned with One Data standards.
• Establish data modelling standards for Sales facts, dimensions, hierarchies, and aggregations.
• Define scalable ingestion patterns for batch and incremental loads.
• Drive performance, scalability, and cost optimization best practices.
• Build and guide development of PySpark-based data pipelines in Databricks.
• ACID transactions.
• Design and optimize large-scale joins, aggregations, and window functions.
• Implement CDC and incremental processing using watermarking and change detection.
• Ensure idempotent, restart able, and fault-tolerant pipelines.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.