Senior Big Data Engineer – AWS, Hadoop/Spark, Kafka

Apexon; Great Falls Crossing (VA); Hybrid; USD 100,000 - 130,000; Full time

Job summary

A leading IT consulting firm is seeking a Mid-Senior Level Data Engineer with extensive experience in Java, Python, and Big Data technologies. The role primarily involves integrating data using Hadoop and AWS services, with programming skills in Kafka being crucial. This position allows for in-person work once a week in Reston, Virginia, and requires a commitment to code quality and automated testing.

Qualifications

• 7+ years of programming experience with Java/Python/Scala.
• 3+ years working on Data Integration projects using Hadoop.
• 2+ years of experience on AWS services like Lambda and S3.
• Experience with Kafka-based data ingestion programs.

Responsibilities

• Tune Hadoop/Spark/Hive for optimal performance.
• Write SQL queries and perform data analysis.
• Implement engineering best practices in code quality.

Skills

Java programming

Python

Scala

Hadoop

AWS services

Kafka

SQL

Shell scripting

Job description

A leading IT consulting firm is seeking a Mid-Senior Level Data Engineer with extensive experience in Java, Python, and Big Data technologies. The role primarily involves integrating data using Hadoop and AWS services, with programming skills in Kafka being crucial. This position allows for in-person work once a week in Reston, Virginia, and requires a commitment to code quality and automated testing.