Lead Data Engineer | PySpark, Databricks & Data Lakes

Infinity Outsourcing

Mount Laurel Township (NJ)

On-site

USD 67,502 - 77,145

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading data engineering firm is seeking a Lead Data Engineer with expertise in PySpark to manage data platforms and architectures. This role demands 12+ years of experience, a strong knowledge of ETL and Data Warehousing, and the ability to lead multiple projects. The candidate should possess hands-on skills in using Pyspark and must be adept at working with both structured and unstructured data. Strong organizational and communication skills are essential for success in this dynamic environment.

Qualifications

  • 12+ years of experience in data engineering and architecture.
  • Hands-on experience in PySpark is mandatory.
  • Must possess strong communication and collaboration skills.

Responsibilities

  • Lead the development of data platforms and architectures.
  • Coordinate with various technical teams for project management.
  • Own the end-to-end development lifecycle including testing and deployment.

Skills

PySpark
Databricks
Data Warehousing
ETL
SQL Server
Data Integration
Cloud Architecture
GitHub

Job description

A leading data engineering firm is seeking a Lead Data Engineer with expertise in PySpark to manage data platforms and architectures. This role demands 12+ years of experience, a strong knowledge of ETL and Data Warehousing, and the ability to lead multiple projects. The candidate should possess hands-on skills in using Pyspark and must be adept at working with both structured and unstructured data. Strong organizational and communication skills are essential for success in this dynamic environment.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer - Spark, SQL, Cloud, Data Lakes
Lead Data Engineer - Spark, SQL, Cloud, Data Lakes

CBTS • Irving (TX)

On-site
USD 90,000 - 120,000
Lead Data Engineer – Azure, Databricks & Snowflake (Remote)
Lead Data Engineer – Azure, Databricks & Snowflake (Remote)

Exusia, Inc. • Miami (FL)

Remote
USD 120,000 - 150,000
Lead Data Engineer: Lakehouse & Data Platform Architect
Lead Data Engineer: Lakehouse & Data Platform Architect

Recru • Houston (TX)

On-site
USD 130,000 - 150,000
Lead Data Platform Engineer - Architect & Scale Pipelines
Lead Data Platform Engineer - Architect & Scale Pipelines

Mirion Technologies • United States

On-site
USD 120,000 - 160,000
Senior Data Engineer — Databricks, PySpark, AWS (Remote)
Senior Data Engineer — Databricks, PySpark, AWS (Remote)

Lumenalta • Salt Lake City (UT)

Remote
USD 60,000 - 110,000
Flexible working hours
Health insurance
401(k) contribution
+3
Lead Data Engineer
Lead Data Engineer

Tata Consultancy Services Limited • Irvine (CA)

On-site
USD 120,000 - 200,000
Lead Data Engineer: Data Warehouse, ETL & Analytics
Lead Data Engineer: Data Warehouse, ETL & Analytics

Tree Top Staffing LLC • United States

On-site
USD 90,000 - 120,000
Medical insurance
Vision insurance
401(k)
+2
Remote Lead Data Engineer: Databricks & Data Lakes
Remote Lead Data Engineer: Databricks & Data Lakes

INSPYR Solutions • Georgia

Hybrid
USD 96,432 - 117,096
Comprehensive medical benefits
401(k) retirement plan
Competitive pay
Lead Data Engineer – Databricks
Lead Data Engineer – Databricks

TechDigital Group • Bolingbrook (IL)

On-site
USD 120,000 - 150,000
Lead Data Engineer: Snowflake, ADF & Databricks
Lead Data Engineer: Snowflake, ADF & Databricks

TechDigital Group • Dallas (TX)

On-site
USD 90,000 - 150,000