Senior Data Engineer - Databricks & Analytics

Federated Hermes; Warrendale (Allegheny County); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Bonus programs

Paid vacation

Parental leave

Volunteer day

Professional development

Job summary

Federated Hermes, Inc. is seeking a Senior Application Specialist to join our Global Technology Organization in Warrendale, PA. You will lead design, development, and optimization of large-scale data solutions on the Databricks platform.

You will design, build, and maintain scalable data pipelines, write PySpark/SQL code, and ensure data quality and governance while handling batch and streaming workflows. The role requires strong data modeling skills and experience with Azure and CI/CD.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 10+ years of programming experience including at least 1 year on a big data platform.
• Experience with Python, SQL, and cloud platforms such as Azure.
• Familiarity with data lakehouse principles, relational and Kimball data models.
• Experience with CI/CD pipelines and version control.
• Knowledge of data visualization tools and BI platforms.
• Databricks certification or relevant cloud platform certification preferred.

Responsibilities

• Design, build, and maintain scalable Databricks data pipelines.
• Write PySpark or SQL code for data transformation.
• Design data models for analytics and reporting.
• Ensure data quality, governance, and security.
• Handle batch and streaming data workflows.
• Provide architectural guidance and support in platform usage.
• Drive best practices in data engineering across the team.
• Monitor and optimize Spark jobs and cluster usage.
• Ensure compliance with security and data privacy standards.

Skills

Python

SQL

Azure

Databricks

Spark

CI/CD

Data modeling

Data governance

Education

Bachelor's degree in Computer Science

Tools

Databricks

Spark

Delta Lake

Power BI

Job description

Federated Hermes, Inc. is seeking a Senior Application Specialist to join our Global Technology Organization in Warrendale, PA. You will lead design, development, and optimization of large-scale data solutions on the Databricks platform.

You will design, build, and maintain scalable data pipelines, write PySpark/SQL code, and ensure data quality and governance while handling batch and streaming workflows. The role requires strong data modeling skills and experience with Azure and CI/CD.