Big Data Engineer: Python/Scala, Spark & Hadoop (Hybrid)

Programmers.io; Arlington (VA); Hybrid; USD 110,000 - 170,000; Full time

Job summary

Programmers.io seeks a Big Data Engineer for a full-time hybrid role in Arlington, VA. You will translate business needs into robust data pipelines across teams.

You'll design end-to-end pipelines with Python/Scala, Spark and Hadoop, ensuring data quality and scalable analytics. Experience with Hive, Airflow, NiFi, and Sqoop is a plus.

We value production-grade data apps and ML workflows, with cloud familiarity (Databricks or AWS) as a bonus. Onsite 3 days per week.

Qualifications

• End-to-end data pipelines across business, data management and technical teams.
• Production-grade data-driven applications and analytics workflows.
• Strong Python/Scala and SQL skills with Spark/Hadoop expertise.

Responsibilities

• Move between business, data management and technical teams to identify solutions.
• Build robust data pipelines end-to-end with data quality focus.
• Leverage Python/Scala, Spark and Hadoop tools to deliver data products and platforms.
• Deploy data-driven applications and processing workflows at scale.
• Implement ML systems in Java, Scala or Python and deliver analytics across stages.

Skills

Data pipelines

Python

Scala

Spark

SQL

Data quality

ML systems

Feature engineering

Cloud fundamentals

Tools

Hive

Airflow

NiFi

Sqoop

Job description

Programmers.io seeks a Big Data Engineer for a full-time hybrid role in Arlington, VA. You will translate business needs into robust data pipelines across teams.

You'll design end-to-end pipelines with Python/Scala, Spark and Hadoop, ensuring data quality and scalable analytics. Experience with Hive, Airflow, NiFi, and Sqoop is a plus.

We value production-grade data apps and ML workflows, with cloud familiarity (Databricks or AWS) as a bonus. Onsite 3 days per week.