Data Engineer (Open Continuous)

Intelligence Careers; Springfield (VA); On-site; USD 110,000 - 140,000; Full time

Job summary

Intelligence Careers seeks a Data Engineer to design, build, test, and optimize scalable data pipelines and microservice architectures in the Springfield, Virginia area. You will apply CI/CD practices to deploy containerized data solutions supporting ML/AI models and data preparation tasks.

The role requires a Bachelor's degree and at least four years of experience in ETL, data integration, and data storage technologies, with proficiency in Python or Java.

Qualifications

• Bachelor’s degree in CS, Data Science, Engineering or related field.
• Minimum 4 years of experience in scalable data pipelines and ETL.
• Experience with data interfaces and APIs.
• Experience with data storage technologies (S3, Elasticsearch, SDKs).
• Proficiency in Python and/or Java.

Skills

Customer needs translation

Data structures

ETL/API

Python

Java

Data storage

Education

Bachelor's degree in CS/DS/Engineering

Tools

S3

Elasticsearch

Job description

Data Engineers develop, construct, test, optimize, and maintain microservice architectures. Data engineers employ Continuous Integration (CI)/Continuous Deployment (CD) methods to deploy containerized solutions and data pipelines to support various capabilities (e.g., machine learning/AI models, data cleaning and preparation). They solve problems associated with data access and integration. They c

MANDATORY QUALIFICATION CRITERIA

• Experience identifying and translating customer needs to create data products that satisfy customer requirements.
• Demonstrated ability to develop, modify, or evaluate data and data structures.
• Demonstrated experience utilizing standards and best practices for data interfaces such as extract-transform-load (ETL) and application programming interfaces (API).
• Demonstrated experience working with data storage, access and exchange technologies, e.g. S3, FTP WFS, FeatureServer, Elasticsearch, SDK, etc.
• Demonstrated proficiency in applied programming and/or manipulation of data with any programing language such as Python, R, or Java.

EDUCATION REQUIREMENT: A. Education: Bachelor's degree from an accredited college or university in Computer Science, Data Science, Engineering, Information Science, Information Systems Management, Mathematics, Operations Research, Physical Sciences, Statistics, Technology Management, or a degree that provided a minimum of 24 semester hours in one or more of the fields identified above and required the development or adaptation of applications, systems, or networks. -OR- B. Combination of Education and Experience: A minimum of 24 semester (36 quarter) hours of coursework in any area listed in option A, plus experience in experience in designing, implementing, and maintaining scalable data pipelines, ETL processes, and data integration solutions, or in a related field that demonstrates the ability to successfully perform the duties associated with this work. As a rule, every 30 semester (45 quarter) hours of coursework is equivalent to one year of experience. Candidates should show that their combination of education and experience totals 4 years. -OR- C. Experience: A minimum of 4 years of experience in experience in designing, implementing, and maintaining scalable data pipelines, ETL processes, and data integration solutions, or in a related field that demonstrates the ability to successfully perform the duties associated with this work. -AND- IT-related experience demonstrating each of the four competencies: Attention to Detail, Customer Service, Oral Communication, and Problem Solving.

DESIRABLE QUALIFICATION CRITERIA

• Demonstrated experience recommending courses of action in alignment with information and technology strategic guidance and data security best practices.
• Demonstrated experience implementing, configuring, or designing databases with one or more current database technologies. e.g., relational (Oracle, MySQL, Postgresql, etc.), noSQL (MongoDB, Accumulo, Elastic, etc.), graph (Allegrograph, JanusGraphy, Neo4J, etc.).
• Demonstrated experience with coding and scripting languages such as Python, JSON, BASH, and/or PowerShell.
• Certification in cloud native services such as Amazon Web Services (AWS), containers, Kubernetes, DevSecOps pipeline tooling, and/or microservices architecture