Lead Data Platform Engineer: Spark, Cloud & Big Data

Jobgether; United States; Remote; USD 19,000 - 25,000; Full time

Benefits offered by this job

Leadership opportunities

Enterprise-scale projects

Multi-cloud exposure

Career development

Job summary

Jobgether is seeking a senior data engineering lead to design, build, test, deploy, and operate end-to-end data processing systems for enterprise-scale needs. You will architect and optimize Spark-based pipelines, data lakes, ETL processes, and data warehouses, ensuring scalability, reliability, and performance across environments.

You will mentor teams, coordinate delivery across project streams, and communicate complex technical concepts to clients.

Qualifications

• Strong experience in object-oriented design, software development, and implementation.
• Experience designing, building, testing, deploying, and operating end-to-end data processing systems.
• Hands-on expertise with Apache Spark, Spark SQL, and associated big data technologies.
• Experience deploying production-grade data engineering solutions using cloud-native services.
• Familiarity with multi-cloud deployments is an advantage.
• Excellent communication and presentation skills.

Responsibilities

• Design, develop, test, deploy, and operate end-to-end data processing systems.
• Build and optimize big data solutions using Spark, Spark SQL, and related technologies.
• Apply OO design principles to develop maintainable, scalable applications.
• Build and maintain data platforms: ingestion pipelines, data lakes, ETL, and warehousing.
• Design and implement production deployments for data projects using cloud-native services.
• Identify opportunities to improve data processing performance and reliability.
• Track progress and resolve blockers, collaborating with team members.
• Mentor engineering teams and promote coding and testing standards.
• Collaborate with clients and stakeholders to meet business requirements.

Skills

OO Design

Spark & Spark SQL

Data pipelines

Cloud deployments

Tools

Apache Spark

Spark SQL

Hadoop

Kafka

Hive

Job description

Jobgether is seeking a senior data engineering lead to design, build, test, deploy, and operate end-to-end data processing systems for enterprise-scale needs. You will architect and optimize Spark-based pipelines, data lakes, ETL processes, and data warehouses, ensuring scalability, reliability, and performance across environments.

You will mentor teams, coordinate delivery across project streams, and communicate complex technical concepts to clients.