Data Engineer: Cloud ETL & Big Data Pipelines

KDA Consulting Inc; Chantilly (VA); On-site; USD 120,000 - 150,000; Full time

Job summary

KDA Consulting Inc. is seeking a Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community.

This role focuses on enabling efficient data processing, analytics, and decision-making by delivering reliable, high-quality data solutions in cloud environments. The ideal candidate will have strong experience with AWS cloud services, data engineering best practices, and big data technologies, with the

Qualifications

• Active TS/ SCI W/ Polygraph Required.
• Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent experience)
• Demonstrated experience in data engineering and pipeline development
• Strong experience with AWS data services (e.g., S3, Glue, Redshift, Lambda, EMR)
• Proficiency in SQL and Python for data processing and transformation
• Experience working with large-scale data sets and big data technologies
• Strong analytical and problem-solving skills

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines ingesting data from multiple sources
• Build and optimize data workflows supporting both batch and real-time processing
• Ensure high availability and reliability of data pipelines across enterprise systems
• Leverage AWS services to support data engineering solutions
• Design and manage cloud-based architectures that are secure, scalable, and cost-efficient
• Implement data storage, partitioning, and lifecycle management
• Ensure data accuracy, consistency, and governance across pipelines
• Collaborate with data scientists, software engineers, and mission stakeholders to support analytics and operations

Skills

SQL

Python

AWS services

Big data

Data governance

Collaboration

Agile

Problem solving

Education

Bachelor's degree in Computer Science/Engineering

Tools

S3

Glue

Redshift

Lambda

EMR

Kinesis

Job description

KDA Consulting Inc. is seeking a Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community.

This role focuses on enabling efficient data processing, analytics, and decision-making by delivering reliable, high-quality data solutions in cloud environments. The ideal candidate will have strong experience with AWS cloud services, data engineering best practices, and big data technologies, with the