Senior Data Engineer: Big Data Pipelines & Warehousing

Allnessjobs; Washington (District of Columbia); On-site; USD 110,000 - 115,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Profit-Sharing Program

Job summary

A leading consulting firm in the Washington, DC area is seeking a Data Engineer to design and develop data ingestion and cleaning processes using Python and Spark. The role requires 5+ years of big data experience, strong knowledge in data modeling, and the ability to communicate technical issues to non-technical staff. The position includes competitive pay and benefits like medical and dental insurance.

Qualifications

• 5+ years of experience with big data.
• 3+ years of experience with software development lifecycle.
• 5+ years of Python coding experience.

Responsibilities

• Design and develop data ingestion and cleaning processes.
• Create big data pipelines for structured and unstructured data.
• Support data migration activities and improve database performance.

Skills

Python

Big Data

Data Modeling

UNIX

CI/CD Automation

Education

Bachelor's degree

Tools

Hadoop

Spark

AWS

Databricks

Job description

A leading consulting firm in the Washington, DC area is seeking a Data Engineer to design and develop data ingestion and cleaning processes using Python and Spark. The role requires 5+ years of big data experience, strong knowledge in data modeling, and the ability to communicate technical issues to non-technical staff. The position includes competitive pay and benefits like medical and dental insurance.