Senior PySpark Data Engineer - Remote Long-Term Contract

Lorven Technologies Inc.; California (MO); Remote; USD 100,000 - 130,000; Full time

Job summary

A leading technology firm is seeking an experienced Data Engineer skilled in PySpark and Python for a long-term remote project. The ideal candidate will have 10–15 years of experience in data engineering, particularly in the Energy and Utility sectors. Responsibilities include translating business needs into technical solutions, leading engineering initiatives, and enhancing data systems. Strong expertise in Pandas, APIs, CI/CD tools, and familiarity with data quality practices are essential. This role offers the chance to work within a collaborative Agile environment.

Qualifications

• 10–15+ years of overall experience in data engineering/ETL ecosystems.
• Experience in Energy and Utility projects is a significant advantage.
• Experience with unit tests, integration tests, schema validations, and health checks.

Responsibilities

• Translate business requirements into technical solutions using PySpark and Python.
• Lead data engineering initiatives addressing complex data challenges.
• Build infrastructure supporting large scale data access and analysis.

Skills

Strong expertise in PySpark

Strong expertise in Python

Experience with Pandas

Experience with APIs

Experience with Spark Streaming

Solid understanding of database design fundamentals

Familiarity with CI/CD tools

Experience writing production grade code

Experience with unit tests

Knowledge of Palantir Foundry

Education

MS in Computer Science, MIS, or related field

Job description

A leading technology firm is seeking an experienced Data Engineer skilled in PySpark and Python for a long-term remote project. The ideal candidate will have 10–15 years of experience in data engineering, particularly in the Energy and Utility sectors. Responsibilities include translating business needs into technical solutions, leading engineering initiatives, and enhancing data systems. Strong expertise in Pandas, APIs, CI/CD tools, and familiarity with data quality practices are essential. This role offers the chance to work within a collaborative Agile environment.