Big Data Developer

Dataflix; Irvine (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Dataflix is seeking a seasoned Big Data Developer to design, build, and optimize scalable data pipelines and processing of large datasets. You will work with Hadoop, Spark, Hive, Kafka, and SQL across cloud environments, ensuring robust data quality and governance.

The role involves collaboration with data architects and stakeholders to deliver reliable data solutions. The ideal candidate brings 8–10 years of experience in data engineering, strong coding skills in Python/Scala/Java, and hands-on

Qualifications

• 8-10 years of experience in Data Engineering or Big Data development.
• Strong experience with Hadoop, Spark, Hive, Kafka, and SQL.
• Hands-on experience with Python, Scala, or Java.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of data warehousing and distributed computing concepts.
• Strong troubleshooting and performance tuning skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Process and transform large volumes of structured and unstructured data.
• Develop data ingestion, ETL, and batch/streaming solutions.
• Optimize data processing performance and reliability.
• Collaborate with data architects, analysts, and business stakeholders.
• Ensure data quality, governance, and security standards.

Skills

Big Data

Data Engineering

Hadoop

Spark

Hive

Kafka

SQL

Python

Scala

Java

AWS

Azure

GCP

Tools

Hadoop

Spark

Hive

Kafka

SQL

Job description

Irvine, United States | Posted on 09/15/2026

We design, build, and run modern data platforms and AI-native systems that drive productivity, efficiency, and quality — while enabling businesses to move faster and adapt to change.

Job Description

Overview

We are seeking a skilled Big Data Developer with expertise in building scalable data pipelines and processing large datasets. The ideal candidate will have hands-on experience with big data technologies, cloud platforms, and data engineering best practices.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines.
  
• Process and transform large volumes of structured and unstructured data.
  
• Develop data ingestion, ETL, and batch/streaming solutions.
  
• Optimize data processing performance and reliability.
  
• Collaborate with data architects, analysts, and business stakeholders.
  
• Ensure data quality, governance, and security standards.
  

Required Skills

• 8-10 years of experience in Data Engineering or Big Data development.
  
• Strong experience with Hadoop, Spark, Hive, Kafka, and SQL.
  
• Hands-on experience with Python, Scala, or Java.
  
• Experience with cloud platforms such as AWS, Azure, or GCP.
  
• Knowledge of data warehousing and distributed computing concepts.
  
• Strong troubleshooting and performance tuning skills.