Senior Databricks Data Engineer | Lakehouse Architect (AWS)

Robotics Technologies LLC; Harrisburg (Dauphin County); On-site; USD 85,000 - 121,000; Part time

Job summary

Robotics Technologies LLC seeks a Databricks Data Engineer to design and implement a scalable Sales Data Platform on Databricks (AWS) in Harrisburg, PA. The role is hands-on and architecture-driven, focusing on ingestion, transformation, modelling, and optimization using lakehouse patterns.

You will build PySpark pipelines, establish bronze/silver/gold schemas, ensure data quality and governance, and mentor other data engineers while collaborating with Sales, CRM, and ERP teams under a C2C/1099

Qualifications

• 8+ years in Data Engineering / Data Architecture roles.
• 4+ years hands-on experience with Databricks.
• Strong expertise in PySpark & Spark SQL.
• Delta Lake experience.
• Strong knowledge of AWS services (S3, IAM, Glue, CloudWatch).
• Data modeling knowledge including fact & dimension modelling.

Responsibilities

• Design end-to-end Lakehouse architecture on Databricks (AWS) for Sales data domains.
• Build and guide PySpark-based data pipelines in Databricks with ACID transactions.
• Define scalable ingestion patterns for batch and incremental loads.
• Drive performance, scalability, and cost optimization for pipelines.
• Implement CI/CD pipelines for Databricks notebooks and jobs.
• Mentor data engineers and collaborate with source system teams and downstream consumers.

Tools

Databricks

Job description

Robotics Technologies LLC seeks a Databricks Data Engineer to design and implement a scalable Sales Data Platform on Databricks (AWS) in Harrisburg, PA. The role is hands-on and architecture-driven, focusing on ingestion, transformation, modelling, and optimization using lakehouse patterns.

You will build PySpark pipelines, establish bronze/silver/gold schemas, ensure data quality and governance, and mentor other data engineers while collaborating with Sales, CRM, and ERP teams under a C2C/1099