Data Engineer: AWS ETL & End-to-End Data Pipelines

Talentify; Washington (District of Columbia); On-site; USD 120,000 - 180,000; Full time

Job summary

BigBear.ai is seeking a skilled Data Engineer to join the Data Architecture & Engineering team in the United States. You will design and build scalable, secure data pipelines that transform raw data into actionable insights, across cloud environments and databases.

Expect to work on ETL development, AWS services, and end-to-end data processing in an Agile setting. You will maintain data schemas and dictionaries, ensure data quality, and collaborate to launch new data features.

Qualifications

• Clearance: Must possess and maintain a TS-SCI clearance.
• Bachelor’s degree in computer science, Engineering, Information Systems, or a related field.
• 4–8 years of relevant experience in data engineering, ETL development, or database administration.
• Proficiency in AWS and cloud-based data integration.
• Strong experience with ETL architecture, data pipeline development, and end-to-end data processing.
• Solid understanding of database management, including schema design, indexing, and optimization.
• Experience with API development and integration.
• Ability to manage and transform raw data into usable formats for analytics and reporting.
• Familiarity with Agile methodologies and collaborative development environments.
• Strong problem-solving skills, attention to detail, and ability to provide technical support for data systems.

Responsibilities

• Design and develop end-to-end data pipelines that support ingestion, transformation, and delivery of structured and unstructured data using ETL best practices.
• Build and maintain ETL processes that ensure data quality, consistency, and performance across environments.
• Integrate data pipelines with AWS services (S3, Lambda, Glue, Redshift) for scalable data processing.
• Develop and maintain schemas, data dictionaries, and transformation logic for robust data architecture.
• Manage and monitor production datasets, ensuring fault tolerance, redundancy, and data integrity across systems.
• Collaborate with cross-functional teams to design and launch new data features and document dataflows and capabilities.
• Support database management tasks such as performance tuning, indexing, and access control.
• Apply Agile practices to deliver iterative improvements and meet evolving data needs.
• Develop and integrate APIs to support data access and interoperability across systems.

Skills

TS-SCI clearance

Data engineering

ETL development

Database administration

API development

Agile methodologies

Education

Bachelor’s degree in computer science, Engineering, Information Systems, or related field

Tools

AWS

S3

Lambda

Glue

Redshift

Job description

BigBear.ai is seeking a skilled Data Engineer to join the Data Architecture & Engineering team in the United States. You will design and build scalable, secure data pipelines that transform raw data into actionable insights, across cloud environments and databases.

Expect to work on ETL development, AWS services, and end-to-end data processing in an Agile setting. You will maintain data schemas and dictionaries, ensure data quality, and collaborate to launch new data features.