Senior Onsite Data Engineer - Databricks on AWS

Career Connections, LLC; Lancaster (Lancaster County); On-site; USD 100,000 - 160,000; Full time

Job summary

Career Connections, LLC seeks a seasoned Data Engineer in the Lancaster, PA area for an onsite role. Strong Databricks experience is required, with advanced SQL and Python/PySpark skills.

Responsibilities include designing, delivering, and operating production-grade data solutions, building scalable pipelines, and ensuring data quality and observability across the data platform. Relocation to the Lancaster region is a plus.

Qualifications

• Bachelor's degree or equivalent practical hands-on experience.
• 5+ years in data engineering or related fields.
• Experience delivering production-grade data solutions on Databricks (AWS).
• Advanced SQL and Python/PySpark for large datasets.
• Knowledge of Spark, Delta Lake, and data modeling; performance tuning.
• Experience with AWS data-services (S3, IAM, etc.) and CI/CD practices.

Responsibilities

• Design, deliver, and operate production-grade data solutions on Databricks/AWS.
• Build batch and incremental data pipelines using APIs, files, and databases.
• Ensure data quality, observability, cataloging, and data contracts.
• Collaborate with teams to enable analytics, forecasting, and ML use cases.

Skills

Databricks

Advanced SQL

Python/PySpark

Delta Lake

Spark

AWS services

CI/CD

Data quality

Observability

Education

Bachelor's degree or equivalent

Tools

Git

Terraform

Job description

Career Connections, LLC seeks a seasoned Data Engineer in the Lancaster, PA area for an onsite role. Strong Databricks experience is required, with advanced SQL and Python/PySpark skills.

Responsibilities include designing, delivering, and operating production-grade data solutions, building scalable pipelines, and ensuring data quality and observability across the data platform. Relocation to the Lancaster region is a plus.