Senior Big Data Engineer: Pipelines, Cloud & AI-Ready

Dataflix; Irvine (CA); On-site; USD 150,000 - 190,000; Full time

Job summary

Dataflix is seeking a seasoned Big Data Developer to design, build, and optimize scalable data pipelines and processing of large datasets. You will work with Hadoop, Spark, Hive, Kafka, and SQL across cloud environments, ensuring robust data quality and governance.

The role involves collaboration with data architects and stakeholders to deliver reliable data solutions. The ideal candidate brings 8–10 years of experience in data engineering, strong coding skills in Python/Scala/Java, and hands-on

Qualifications

• 8-10 years of experience in Data Engineering or Big Data development.
• Strong experience with Hadoop, Spark, Hive, Kafka, and SQL.
• Hands-on experience with Python, Scala, or Java.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of data warehousing and distributed computing concepts.
• Strong troubleshooting and performance tuning skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Process and transform large volumes of structured and unstructured data.
• Develop data ingestion, ETL, and batch/streaming solutions.
• Optimize data processing performance and reliability.
• Collaborate with data architects, analysts, and business stakeholders.
• Ensure data quality, governance, and security standards.

Skills

Big Data

Data Engineering

Hadoop

Spark

Hive

Kafka

SQL

Python

Scala

Java

AWS

Azure

GCP

Tools

Hadoop

Spark

Hive

Kafka

SQL

Job description

Dataflix is seeking a seasoned Big Data Developer to design, build, and optimize scalable data pipelines and processing of large datasets. You will work with Hadoop, Spark, Hive, Kafka, and SQL across cloud environments, ensuring robust data quality and governance.

The role involves collaboration with data architects and stakeholders to deliver reliable data solutions. The ideal candidate brings 8–10 years of experience in data engineering, strong coding skills in Python/Scala/Java, and hands-on