Data Engineer (Open Continuous)

US National Geospatial-Intelligence Agency; Jefferson Barracks (MO); On-site; USD 90,000 - 130,000; Full time

Job summary

US National Geospatial-Intelligence Agency is seeking a Data Engineer to design, build, test, and optimize data pipelines and microservice architectures within a secure environment.

You will implement CI/CD and containerized solutions to support machine learning, data cleaning, and geospatial data integration, ensuring rapid access to datasets across capabilities.

Qualifications

• Experience identifying and translating customer needs to create data products that satisfy customer requirements.
• Demonstrated ability to develop, modify, or evaluate data and data structures.
• Demonstrated experience utilizing standards and best practices for data interfaces such as ETL and API.
• Demonstrated experience working with data storage, access and exchange technologies (S3, FTP, WFS, FeatureServer, Elasticsearch, SDK).
• Proficiency in programming and/or manipulation of data with Python, R, or Java.

Responsibilities

• Develop, construct, test, optimize, and maintain microservice architectures.
• Apply CI/CD to deploy containerized data pipelines and solutions.
• Support capabilities such as ML/AI models through data preparation and integration.
• Address data access and integration challenges with scalable solutions.
• Collaborate across teams to ensure data quality and availability.

Skills

Translating customer needs into data-

Data modeling and structures

ETL and API standards

Data storage technologies (S3, FTP, W

Programming in Python, R, or Java

Education

Bachelor's degree in Computer Science / Data Science / Engineering or related field with 24 semester hours

4 years experience in scalable data pipelines and ETL solutions

Tools

S3

FTP

WFS

FeatureServer

Elasticsearch

SDK

Job description

Data Engineers develop, construct, test, optimize, and maintain microservice architectures. Data engineers employ Continuous Integration (CI)/Continuous Deployment (CD) methods to deploy containerized solutions and data pipelines to support various capabilities (e.g., machine learning/AI models, data cleaning and preparation). They solve problems associated with data access and integration. They c

MANDATORY QUALIFICATION CRITERIA

For this particular job, applicants must meet all competencies reflected under the Mandatory Qualification Criteria to include education (if required). Online resumes must demonstrate qualification by providing specific examples and associated results, in response to the announcement's mandatory criteria specified in this vacancy announcement:

• Experience identifying and translating customer needs to create data products that satisfy customer requirements.
• Demonstrated ability to develop, modify, or evaluate data and data structures.
• Demonstrated experience utilizing standards and best practices for data interfaces such as extract-transform-load (ETL) and application programming interfaces (API).
• Demonstrated experience working with data storage, access and exchange technologies, e.g. S3, FTP WFS, FeatureServer, Elasticsearch, SDK, etc.
• Demonstrated proficiency in applied programming and/or manipulation of data with any programing language such as Python, R, or Java.

EDUCATION REQUIREMENT: A. Education: Bachelor's degree from an accredited college or university in Computer Science, Data Science, Engineering, Information Science, Information Systems Management, Mathematics, Operations Research, Physical Sciences, Statistics, Technology Management, or a degree that provided a minimum of 24 semester hours in one or more of the fields identified above and required the development or adaptation of applications, systems, or networks. -OR- B. Combination of Education and Experience: A minimum of 24 semester (36 quarter) hours of coursework in any area listed in option A, plus experience in experience in designing, implementing, and maintaining scalable data pipelines, ETL processes, and data integration solutions, or in a related field that demonstrates the ability to successfully perform the duties associated with this work. As a rule, every 30 semester (45 quarter) hours of coursework is equivalent to one year of experience. Candidates should show that their combination of education and experience totals 4 years. -OR- C. Experience: A minimum of 4 years of experience in experience in designing, implementing, and maintaining scalable data pipelines, ETL processes, and data integration solutions, or in a related field that demonstrates the ability to successfully perform the duties associated with this work. -AND- IT-related experience demonstrating each of the four competencies: Attention to Detail, Customer Service, Oral Communication, and Problem Solving.

DESIRABLE QUALIFICATION CRITERIA

• Demonstrated experience recommending courses of action in alignment with information and technology strategic guidance and data security best practices.
• Demonstrated experience implementing, configuring, or designing databases with one or more current database technologies. e.g., relational (Oracle, MySQL, Postgresql, etc.), noSQL (MongoDB, Accumulo, Elastic, etc.), graph (Allegrograph, JanusGraphy, Neo4J, etc.).
• Demonstrated experience with coding and scripting languages such as Python, JSON, BASH, and/or PowerShell.
• Certification in cloud native services such as Amazon Web Services (AWS), containers, Kubernetes, DevSecOps pipeline tooling, and/or microservices architecture