Senior Data Software Engineer: Scalable Pipelines

EPAM Systems Inc

Newtown (PA)

On-site

MXN 1,000,000 - 2,100,000

Full time

2 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare benefits
Paid time off
Upskilling & certification
LinkedIn Learning access
Global career opportunities
Volunteer opportunities

Job summary

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities.

We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow.

Qualifications

  • 3+ years of relevant hands-on professional background.
  • Strong PySpark and Spark SQL experience for large-scale data workflows.
  • Experience building Lakeflow pipelines and data orchestration.
  • Proficient with Auto Loader and JDBC/CDC ingestion from DB2 and SQL Server.
  • Delta Lake and Unity Catalog for storage and governance.
  • Experience with data quality and source reconciliation.
  • Unit tests with pytest.
  • Git and asset bundles for version control and deployment.
  • Upper-intermediate English (B2) or higher.

Responsibilities

  • Architect and construct scalable data pipelines across platforms.
  • Build and sustain ingestion workflows from diverse source systems.
  • Produce clean, high-performing, well-tested code.
  • Collaborate with teams to translate data needs into technical solutions.
  • Monitor pipeline performance and ensure system dependability.
  • Participate in code reviews to maintain quality benchmarks.

Skills

PySpark
Spark SQL
Delta Lake
Unity Catalog
Data quality
pytest unit tests
Git
Data orchestration
DB2 ingestion
SQL Server ingestion
Databricks

Tools

Auto Loader
JDBC/CDC
DB2
SQL Server
Databricks

Job description

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities.

We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Integration Engineer – AI-Powered Pipelines
Senior Data Integration Engineer – AI-Powered Pipelines

EPAM Systems Inc • Newtown (PA)

On-site
MXN 480,000 - 720,000
Healthcare benefits
Paid time off
Upskilling & certification courses
+3
Lead Data Engineer: Architect & Deliver Scalable Pipelines
Lead Data Engineer: Architect & Deliver Scalable Pipelines

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Healthcare benefits
Employee training & certificates
Paid time off
Senior Data Software Engineer
Senior Data Software Engineer

EPAM Systems Inc • Newtown (PA)

On-site
MXN 1,000,000 - 2,100,000
Healthcare benefits
Paid time off
Upskilling & certification
+3
Data Software Engineering Manager - Pipeline Lead
Data Software Engineering Manager - Pipeline Lead

EPAM Systems • United States

Remote
USD 150,000 - 210,000
Senior Data Engineering & Delivery Lead
Senior Data Engineering & Delivery Lead

EPAM Systems Inc • United States

Remote
USD 120,000 - 160,000
Healthcare benefits
Paid time off
LinkedIn Learning access
+1
Senior Data Engineer - Scalable Pipelines & Insights
Senior Data Engineer - Scalable Pipelines & Insights

Partner Company • United States

Remote
USD 90,000 - 130,000
Senior Data Engineer: Build Scalable Pipelines & Cloud
Senior Data Engineer: Build Scalable Pipelines & Cloud

ReturnPro LLP • Florida

On-site
USD 110,000 - 150,000
Senior Data Integration Engineer
Senior Data Integration Engineer

EPAM Systems Inc • Newtown (PA)

On-site
MXN 480,000 - 720,000
Healthcare benefits
Paid time off
Upskilling & certification courses
+3
Senior Data Engineer: Scalable Pipelines & Analytics
Senior Data Engineer: Scalable Pipelines & Analytics

Devsavant • United States

Remote
USD 140,000 - 190,000
Senior Data Engineer: Scalable Pipelines & Cloud Apps
Senior Data Engineer: Scalable Pipelines & Cloud Apps

Compunnel Inc. • Harrisburg

On-site
USD 110,000 - 150,000