Senior Data Engineer

Life in Pittsburgh; Pittsburgh (Allegheny County); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Comprehensive benefits

Paid time off

401(k) plan

Job summary

Pittsburgh Tomorrow in Pittsburgh, PA is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines using AWS services such as Redshift, Glue, S3, and Step Functions. This hybrid role collaborates with engineering, product, and business stakeholders to turn data into trusted assets for analytics and applications.

You will own ingestion, transformation, validation, and metadata governance, ensure data quality, and help shape the future state of the data platform as the

Qualifications

• Proficient in SQL and Python with large datasets.
• Strong experience designing and maintaining production-grade data pipelines.
• Experience with Git-based workflows and version control.
• Solid data modeling and ETL/ELT pattern understanding.

Responsibilities

• Design, build, and maintain scalable ETL pipelines using AWS Glue, Crawlers, Apache Hudi, and Step Functions.
• Manage data storage and organization in Amazon S3.
• Work with Redshift for analytics, reporting, and data as a service.
• Own metadata management and schema discovery with Glue Data Catalog.
• Ensure data quality, integrity, and consistency across pipelines.

Skills

SQL

Python

AWS

ETL/ELT

Data modeling

Git workflows

Tools

AWS Glue

Amazon Redshift

Amazon S3

Step Functions

Glue Data Catalog

Spark

Job description

RESPONSIBILITIES

Kforce has a client that is seeking a Senior Data Engineer in Wexford, PA that will design, build, and maintain scalable data pipelines and core data workflows using AWS-native services including Redshift, Glue, S3, Step Functions, and the Glue Data Catalog. This is a hybrid role in Pittsburgh, PA.

Summary

In this role, you will own data ingestion, transformation, and validation processes and will be responsible for delivering reliable, well-modeled datasets that support analytics and application use cases. You will collaborate closely with engineering, product, and business stakeholders to ensure data is accurate, accessible, and actionable, while helping shape the future state of the data platform.

Duties

• Design, build, and maintain scalable ETL pipelines using AWS Glue, Crawlers, Apache Hudi, and Step Functions
• Manage and optimize data storage and organization in Amazon S3
• Participate in data modeling and transformation in Amazon Redshift to support analytics, reporting, and downstream applications
• Own metadata management and schema discovery using AWS Glue Data Catalog
• Ensure data quality, integrity, and consistency across all pipelines and datasets
• Develop data access controls and governance practices to ensure secure and appropriate data use
• Implement monitoring, logging, and alerting for data workflows
• Partner with engineering and business teams to define data requirements and deliver trusted datasets
• Enable analytics and reporting through well-documented, well-modeled, and reliable data assets
• Establish best practices for data engineering, documentation, naming conventions, and governance
• Contribute to the roadmap and evolution of the data platform as the organization scales
• Perform other data-related responsibilities as needed

REQUIREMENTS

• Strong experience with AWS data services including Redshift, Spark, Glue ETL, Glue Crawlers, S3, Step Functions, and Glue Data Catalog
• Experience building and supporting production-grade data pipelines
• Experience with Git-based workflows and version control
• Solid understanding of data modeling, ETL/ELT patterns, and downstream consumption needs
• Proficiency in SQL and Python with experience working with large, complex datasets
• Strong analytical skills with the ability to translate business needs into scalable data solutions
• High attention to detail with a strong focus on data accuracy and reliability
• Clear communication skills and the ability to collaborate across technical and non-technical teams
• Structured, methodical approach to problem solving
• A builder mindset and comfort operating without an established playbook
• Ability to work independently, take ownership, and build systems from scratch

Preferred Qualifications

• Relevant technical certifications
• Experience with AWS EMR, data lakes, and Lake Formation
• Experience coaching engineers or acting in a technical lead capacity
• Experience working in small or Agile teams
• Hands-on experience with Jira and Confluence
• Background or exposure to data analytics
• Familiarity with Linux-based environments

The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.

We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.

Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.

This job is not eligible for bonuses, incentives or commissions.

Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.