Remote Senior Backend Engineer - Spark & Data Pipelines

Openmind Technologies; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

Openmind Technologies seeks a Sr. Software Engineer/ Backend to own end-to-end data platform components, including Spark pipelines, data lake interactions, and partner integrations. You will deliver high-impact features, writing production-grade code and tests with minimal onboarding.

Led by a revenue-facing data stack, the role emphasizes reliability, scalability, and secure API changes. Remote 6-month contract with a fast ramp and strong collaboration across teams.

Qualifications

• 7+ years of professional software or data engineering experience.
• 4+ years building, optimizing, and maintaining production Apache Spark pipelines, with strong Java and Python skills across JVM Spark and PySpark.
• Advanced SQL, relational data modeling, and large-scale data processing experience, including production work with Snowflake, MySQL, and Iceberg.
• 3+ years operating AWS data workloads using S3 and Airflow (or equivalent production workflow orchestration); container orchestration and data-catalog experience a plus.
• 3+ years building, changing, and operating production REST APIs, including PHP APIs built with Symfony or a closely equivalent PHP MVC framework.
• Demonstrated proficiency using AI development tools to deliver production-quality work efficiently.
• Ability to independently deliver secure, backward-compatible API changes, including implementation, validation, authorization, data access, documentation, automated testing, and production diagnostics.

Responsibilities

• Build, optimize, and operate production Apache Spark pipelines that generate data feeds at scale.
• Design and evolve data models across data lake/warehouse technologies with AWS-based schedulers.
• Build and operate partner feeds and integrations with schemas, identities, and SLAs.
• Develop production REST APIs, including PHP APIs with Symfony or equivalent.
• Trace and modify behavior across controllers, queries, templates, and tests.
• Diagnose production failures, perform backfills, and manage staged releases/rollbacks.
• Write unit and integration tests for data pipelines, APIs, and apps.

Skills

Spark pipelines

Java

Python

SQL

AWS

REST APIs

Tools

Snowflake

MySQL

Iceberg

Airflow

Symfony

PHP

Doctrine

Twig

JavaScript

Job description

Openmind Technologies seeks a Sr. Software Engineer/ Backend to own end-to-end data platform components, including Spark pipelines, data lake interactions, and partner integrations. You will deliver high-impact features, writing production-grade code and tests with minimal onboarding.

Led by a revenue-facing data stack, the role emphasizes reliability, scalability, and secure API changes. Remote 6-month contract with a fast ramp and strong collaboration across teams.