Hybrid Big Data Engineer: Spark, Hadoop & AWS

Eliassen Group

Tysons (VA)

Hybrid

Confidential

Full time

10 days ago

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k with company matching

Life insurance

Job summary

Eliassen Group in Tysons Corner, VA is seeking a highly skilled Big Data Engineer to design, develop, and optimize large-scale data processing systems. You will work with cross-functional teams to architect data pipelines and ensure performance, scalability, and reliability of big data platforms in a hybrid onsite/remote setting.

Ideal candidates bring expertise in Hadoop, Spark, Hive, and Trino, with experience in Java, Scala, or Python.

Qualifications

Bachelor's degree in Computer Science, Information Systems, or related discipline with at least five years of related experience, or equivalent training and work experience.
Master's degree and Financial Services experience preferred.

Responsibilities

Design, develop, and maintain large-scale data processing pipelines using Big Data technologies such as Hadoop, Spark, Python, and Scala.
Implement data ingestion, storage, transformation, and analysis solutions that are scalable, efficient, and reliable.
Stay current with industry trends and emerging Big Data technologies to improve the data architecture.
Collaborate with cross-functional teams to translate business requirements into technical solutions.
Optimize and enhance existing data pipelines for performance, scalability, and reliability.
Develop automated testing frameworks and implement continuous testing for data quality assurance.
Monitor and troubleshoot data pipelines in production to identify and resolve issues.
Partner with data scientists and analysts to support data-driven decision-making.
Write and maintain automated unit, integration, and end-to-end tests.