Data Engineer

Arena Technical Resources, LLC (ATR); Washington (District of Columbia); On-site; USD 125,000 - 150,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to enhance and maintain data flows in a dynamic environment. This role involves manipulating data for existing and new systems, providing analytical and operational support, and ensuring data quality. The ideal candidate will have extensive experience in software engineering and ETL processes, along with strong problem-solving skills and the ability to work in a fast-paced, collaborative setting. Join a team that values innovation and continuous improvement, where your contributions will have a significant impact on data management and system efficiency.

Qualifications

• 10-15 years of related software engineering and ETL experience required.
• Experience building and maintaining data flows in NiFi or Pentaho.

Responsibilities

• Research, design, and develop enterprise-wide systems and application software.
• Develop complex data flows and enhance existing pipelines.

Skills

Software Engineering

ETL Processes

Data Mapping

Data Quality Assurance

Problem-Solving

Team Building

Education

Bachelor’s Degree in Computer Science

Equivalent combination of education and experience

Tools

NiFi

Pentaho

Java/J2EE

SQL

Python

Shell Scripting

XML

JSON

Job description

Description
Position is with the VA McLean Customer and requires an active TS/SCI with Full Scope Poly clearance.

The Data Engineer will manipulate data and data flows for both existing and new systems. Additionally, they will provide support in the areas of data extraction, transformation, and load (ETL), data mapping, analytical support, operational support, database support, and maintenance support of data and associated systems. As a member of the team, candidates will work in a multi-tasking, quick-paced, dynamic, process-improvement environment that requires experience with the principles of large-scale (terabytes) database development, large-scale file manipulation, data modeling, data mapping, data testing, data quality, and documentation preparation.

KEY RESPONSIBILITIES:

1. Research, design, develop, and/or modify enterprise-wide systems and/or application software.
2. Develop complex data flows or make significant enhancements to existing pipelines.
3. Resolve complex hardware/software compatibility and interface design considerations.
4. Conduct investigations and tests of considerable complexity.
5. Research emerging technologies to determine impact on application execution.
6. Provide input to staff involved in writing and updating technical documentation.
7. Troubleshoot complex problems and provide customer support for the ETL process.
8. Advise hardware engineers on machine characteristics that affect software systems, such as storage capacity, processing speed, and input/output requirements.
9. Prepare reports on analyses, findings, and project progress.
10. Provide guidance and work leadership to less-experienced software engineers.
11. May serve as a technical team or task leader.

Requirements

REQUIRED KNOWLEDGE/SKILLS:

1. Bachelor’s Degree in Computer Science, Electrical or Computer Engineering, or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.
2. 10-15 years of related software engineering and ETL experience.
3. Experience building and maintaining data flows in NiFi or Pentaho.
4. Excellent organizational, coordination, interpersonal, and team-building skills.

DESIRED KNOWLEDGE/SKILLS:

1. Experience with the following languages: Java/J2EE, C, C++, SQL, XML, XQuery, XPath, Ruby on Rails, HTML/XHTML, CSS, Python, Shell Scripting, JSON.
2. Knowledge of server operating systems: Windows, Linux, Distributed Computing, Blade Centers, and cloud infrastructure.
3. Strong problem-solving skills.
4. Ability to comprehend database methodologies.
5. Focus on continual process improvement with a proactive approach to problem solving.
6. Ability to follow directions and finish tasks.