Senior Data Engineer – Python + Spark Pipelines, Remote

MassGenics, Inc.; New York (NY); Hybrid; USD 83,000 - 90,000; Full time

Benefits offered by this job

Medical & pharmacy coverage

401(k)

Health savings account (HSA)

Flexible spending account (FSA)

Life Insurance

Pet Insurance

Disability Insurance

Sick time & paid leaves

Employee Assistance Program (EAP)

Job summary

Innova Solutions is seeking a Database Engineer for a client project in New York, NY with a remote work option. The role focuses on building scalable data platforms, reusable data pipelines, and production-grade data services using Python and Spark.

The ideal candidate has 5+ years in data engineering, deep Python expertise, Spark/PySpark experience, and familiarity with RESTful APIs and data orchestration tools like Airflow or Dagster.

Qualifications

• 5+ years of data engineering experience.
• 5+ years Python programming for production data pipelines.
• 4+ years Spark/PySpark experience building pipelines.
• 2+ years backend APIs with FastAPI/Django/Flask.
• Exposure to data orchestration tools like Airflow or Dagster.

Responsibilities

• Architect and scale data platforms and storage systems to support analytics.
• Build robust data pipelines and ETL/ELT frameworks for batch and streaming data.
• Develop production-grade data services and RESTful APIs in Python.
• Ensure data reliability, governance, and security across pipelines.
• Lead data engineering initiatives and mentor engineers across teams.

Skills

Python

Spark/PySpark

RESTful APIs

API versioning

Input validation

Pagination

Error handling

FastAPI/Django/Flask

Airflow

Dagster

Tools

Airflow

Dagster

Job description

Innova Solutions is seeking a Database Engineer for a client project in New York, NY with a remote work option. The role focuses on building scalable data platforms, reusable data pipelines, and production-grade data services using Python and Spark.

The ideal candidate has 5+ years in data engineering, deep Python expertise, Spark/PySpark experience, and familiarity with RESTful APIs and data orchestration tools like Airflow or Dagster.