Databricks Lakehouse Engineer (AWS) for Sales Data Platform

Valiant Technologies LLC; Harrisburg (Dauphin County); On-site; USD 63,000 - 89,000; Part time

Job summary

Valiant Technologies LLC in Harrisburg, PA is seeking a Databricks Data Engineer for a 10-month contract (C2C/1099) to design and implement a scalable Sales Data Platform on Databricks (AWS). The role is hands-on and architecture-driven, focusing on data ingestion, transformation, modelling, and optimization.

You will define end-to-end Lakehouse architecture, Bronze/Silver/Gold medallion patterns, and scalable ingestion; work with data engineers and source teams to deliver governed datasets.

Qualifications

• Experience designing and implementing Lakehouse architectures on Databricks (AWS).
• Hands-on data ingestion, transformation, modelling, and optimization at scale.
• Building PySpark-based data pipelines with ACID transactions and scalable ingestion.

Responsibilities

• Define end-to-end Lakehouse architecture for Sales data domains.
• Design Bronze/Silver/Gold medallion architecture and data models.
• Develop scalable batch and incremental ingestion patterns.
• Build fault-tolerant PySpark pipelines with CDC and watermarking.
• Optimize joins, aggregations, and window functions for performance.

Job description

Valiant Technologies LLC in Harrisburg, PA is seeking a Databricks Data Engineer for a 10-month contract (C2C/1099) to design and implement a scalable Sales Data Platform on Databricks (AWS). The role is hands-on and architecture-driven, focusing on data ingestion, transformation, modelling, and optimization.

You will define end-to-end Lakehouse architecture, Bronze/Silver/Gold medallion patterns, and scalable ingestion; work with data engineers and source teams to deliver governed datasets.