Data Engineer
TalentOps
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
TalentOps is seeking a Data Engineer in Chantilly, VA to join a growing team handling complex data for national security mission-critical systems. The role focuses on structuring, processing, and integrating large data volumes into a custom enterprise system.
The ideal candidate will have strong Python, SQL, AWS, and data-pipeline development experience, plus familiarity with PySpark, Elastic/OpenSearch, graph databases, and ML workflows. Collaboration with scientists and engineers is essential.
Qualifications
- Active TS/SCI with Full-Scope Polygraph.
- 3-5+ years of professional experience in data engineering or a related technical role.
- Strong experience with Python and SQL for data processing and pipeline development.
- Experience working with AWS cloud services, particularly AWS S3.
- Experience working in Linux environments.
- Experience using Git for version control and collaborative development.
- Strong understanding of ETL/ELT concepts and data pipeline architecture.
- Ability to work effectively with Data Scientists, Analysts, Engineers, and other technical stakeholders.
- Ability to communicate complex technical concepts to both technical and non-technical audiences.
- Strong attention to detail with an emphasis on data quality and reliability.
- Ability to manage multiple priorities in a fast-paced environment.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines for batch and real-time data processing using Python and SQL.
- Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, Microsoft Office files, and open-source data.
- Develop web scraping and data ingestion workflows to collect and transform open-source information into structured datasets.
- Build scalable data architectures supporting analytics and machine learning workloads.
- Collect, clean, validate, and transform large volumes of structured and unstructured data.
- Design and optimize data storage within AWS S3, including raw, intermediate, and final datasets.
- Optimize data processing and queries for performance and cost efficiency.
- Implement data quality checks, version tracking, and processes to ensure data reliability.
- Support data governance efforts, including documentation, cataloging, lineage, and security.
- Ensure data handling and workflows comply with applicable security standards.
Skills
Tools
Job description
Location: Chantilly, VA
Clearance: Active TS/SCI with Polygraph
Experience: 3-5+ Years
Employment Type: Full-Time
We are seeking a Data Engineer to join a growing team supporting cutting-edge work in the national security mission space. This role will focus on structuring, processing, and integrating large volumes of complex data into a custom-developed enterprise system.
The ideal candidate has strong experience with Python, SQL, AWS, and data pipeline development and is comfortable working with both structured and unstructured data. Experience with PySpark, Elastic/OpenSearch, graph databases, and machine learning workflows is highly desirable.
- Design, develop, and maintain ETL/ELT pipelines for batch and real-time data processing using Python and SQL.
- Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, Microsoft Office files, and open-source data.
- Develop web scraping and data ingestion workflows to collect and transform open-source information into structured datasets.
- Build scalable data architectures supporting analytics and machine learning workloads.
- Collect, clean, validate, and transform large volumes of structured and unstructured data.
- Design and optimize data storage within AWS S3, including raw, intermediate, and final datasets.
- Optimize data processing and queries for performance and cost efficiency.
- Implement data quality checks, version tracking, and processes to ensure data reliability.
- Support data governance efforts, including documentation, cataloging, lineage, and security.
- Ensure data handling and workflows comply with applicable security standards.
- Partner closely with Data Scientists, Analysts, Engineers, and mission stakeholders to understand data requirements.
- Prepare clean, structured, and feature-ready datasets for analytics and machine learning.
- Support feature engineering, aggregations, and large-scale data transformations.
- Assist with deploying ML models into production environments, including monitoring, versioning, and performance optimization.
- Integrate data and applications through REST APIs.
- Utilize Docker, Kubernetes, Git, and CI/CD pipelines to deploy and manage data workflows.
- Participate in code reviews and promote engineering and data-management best practices across the team.
- Active TS/SCI with Full-Scope Polygraph.
- 3-5+ years of professional experience in data engineering or a related technical role.
- Strong experience with Python and SQL for data processing and pipeline development.
- Experience working with AWS cloud services, particularly AWS S3.
- Experience working in Linux environments.
- Experience using Git for version control and collaborative development.
- Strong understanding of ETL/ELT concepts and data pipeline architecture.
- Ability to work effectively with Data Scientists, Analysts, Engineers, and other technical stakeholders.
- Ability to communicate complex technical concepts to both technical and non-technical audiences.
- Strong attention to detail with an emphasis on data quality and reliability.
- Ability to manage multiple priorities in a fast-paced environment.
- PySpark or other big-data processing frameworks.
- Elastic/OpenSearch for search and analytics.
- Understanding of machine learning workflows and MLOps concepts.
- Experience with Docker and Kubernetes.
- Experience developing web scraping and open-source data ingestion solutions.
- Hands-on experience modeling, querying, and optimizing graph databases.
- Experience with Neo4j is highly desired.
A dynamic, quality-focused small business providing innovative and mission-oriented solutions to government and commercial customers. The organization supports defense, intelligence, civilian, and commercial sectors through a team of experienced professionals and subject matter experts.
Our client offers a comprehensive benefits package to support employee well-being, financial security, professional growth, and work-life balance. Benefits may include:
Flexible/Unlimited Time Off for full-time exempt employees, available immediately upon hire, plus up to 48 hours of sick leave and 11 paid holidays.
401(k) with 100% company match on the first 6% contributed, with immediate 100% vesting. Both traditional and Roth 401(k) options are available.
Multiple CareFirst medical plans, including HSA and employer-funded HRA options; HRA contributions can be as high as $3,500 individual / $7,000 family.
Dental and vision coverage, including 100% preventive dental coverage and annual vision benefits.
100% employer-paid Basic Life & AD&D and Short-Term Disability insurance.
$5,000 per year for tuition and professional development reimbursement.
$100/month parking or transit reimbursement.
Additional perks include pet insurance, Employee Assistance Program (EAP), wellness programs, travel assistance, and optional supplemental insurance benefits.
unlimited PTO + 6% 401(k) match + $5K professional development + $100/month commuter benefit
We are an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other protected status under applicable law.
Location: Chantilly, VA
Clearance: Active TS/SCI with Polygraph
Experience: 3-5+ Years
Employment Type: Full-Time
We are seeking a Data Engineer to join a growing team supporting cutting-edge work in the national security mission space. This role will focus on structuring, processing, and integrating large volumes of complex data into a custom-developed enterprise system.
The ideal candidate has strong experience with Python, SQL, AWS, and data pipeline development and is comfortable working with both structured and unstructured data. Experience with PySpark, Elastic/OpenSearch, graph databases, and machine learning workflows is highly desirable.
- Design, develop, and maintain ETL/ELT pipelines for batch and real-time data processing using Python and SQL.
- Integrate data from multiple sources, including databases, APIs, streaming platforms, PDFs, Microsoft Office files, and open-source data.
- Develop web scraping and data ingestion workflows to collect and transform open-source information into structured datasets.
- Build scalable data architectures supporting analytics and machine learning workloads.
- Collect, clean, validate, and transform large volumes of structured and unstructured data.
- Design and optimize data storage within AWS S3, including raw, intermediate, and final datasets.
- Optimize data processing and queries for performance and cost efficiency.
- Implement data quality checks, version tracking, and processes to ensure data reliability.
- Support data governance efforts, including documentation, cataloging, lineage, and security.
- Ensure data handling and workflows comply with applicable security standards.
- Partner closely with Data Scientists, Analysts, Engineers, and mission stakeholders to understand data requirements.
- Prepare clean, structured, and feature-ready datasets for analytics and machine learning.
- Support feature engineering, aggregations, and large-scale data transformations.
- Assist with deploying ML models into production environments, including monitoring, versioning, and performance optimization.
- Support scalable pipeline development using PySpark or similar big-data frameworks.
- Integrate data and applications through REST APIs.
- Utilize Docker, Kubernetes, Git, and CI/CD pipelines to deploy and manage data workflows.
- Participate in code reviews and promote engineering and data-management best practices across the team.
- Active TS/SCI with Full-Scope Polygraph.
- 3-5+ years of professional experience in data engineering or a related technical role.
- Strong experience with Python and SQL for data processing and pipeline development.
- Experience working with AWS cloud services, particularly AWS S3.
- Experience working in Linux environments.
- Experience using Git for version control and collaborative development.
- Strong understanding of ETL/ELT concepts and data pipeline architecture.
- Ability to work effectively with Data Scientists, Analysts, Engineers, and other technical stakeholders.
- Ability to communicate complex technical concepts to both technical and non-technical audiences.
- Strong attention to detail with an emphasis on data quality and reliability.
- Ability to manage multiple priorities in a fast-paced environment.
- PySpark or other big-data processing frameworks.
- Elastic/OpenSearch for search and analytics.
- Understanding of machine learning workflows and MLOps concepts.
- Experience with Docker and Kubernetes.
- Experience developing web scraping and open-source data ingestion solutions.
- Hands-on experience modeling, querying, and optimizing graph databases.
- Experience with Neo4j is highly desired.
A dynamic, quality-focused small business providing innovative and mission-oriented solutions to government and commercial customers. The organization supports defense, intelligence, civilian, and commercial sectors through a team of experienced professionals and subject matter experts.
Our client offers a comprehensive benefits package to support employee well-being, financial security, professional growth, and work-life balance. Benefits may include:
Flexible/Unlimited Time Off for full-time exempt employees, available immediately upon hire, plus up to 48 hours of sick leave and 11 paid holidays.
401(k) with 100% company match on the first 6% contributed, with immediate 100% vesting. Both traditional and Roth 401(k) options are available.
Multiple CareFirst medical plans, including HSA and employer-funded HRA options; HRA contributions can be as high as $3,500 individual / $7,000 family.
Dental and vision coverage, including 100% preventive dental coverage and annual vision benefits.
100% employer-paid Basic Life & AD&D and Short-Term Disability insurance.
$5,000 per year for tuition and professional development reimbursement.
$100/month parking or transit reimbursement.
Additional perks include pet insurance, Employee Assistance Program (EAP), wellness programs, travel assistance, and optional supplemental insurance benefits.
unlimited PTO + 6% 401(k) match + $5K professional development + $100/month commuter benefit
We are an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other protected status under applicable law.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
