Senior Data Engineer

Talentify; Herndon (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

VTG is seeking a talented Senior Data Engineer in Herndon, VA to transform financial data into actionable insights. You will develop, optimize, and maintain ETL pipelines, using Python and SQL to condition and normalize data for downstream enterprise tools.

Experience with Airflow/Hop and AWS is highly valued, with a bias toward independent and collaborative work within a technical team. The role emphasizes modern data engineering practices and the adoption of AI-enabled processes to improve

Qualifications

• Bachelor's degree in computer science, Software Engineering, or related field.
• Experience building and maintaining ETL pipelines.
• Proficient in Python and SQL.

Responsibilities

• Transform financial data into actionable insights for a mission-driven customer.
• Develop, optimize, and maintain robust ETL processes and data pipelines.
• Use Python and SQL to condition and normalize data for downstream tools.
• Build repeatable workflows with Airflow/Hop and deploy in AWS cloud.
• Work independently and with a team of technical experts and stakeholders.

Skills

Python

SQL

Apache Airflow

Apache Hop

ETL pipelines

Data conditioning

AWS

Independent work

Collaboration

Education

Bachelor's degree in computer science, Software Engineering, or related field

Job description

Overview

VTG is seeking a talented and experienced Senior Data Engineer to serve as an integrator between business needs and technical solutions. Must be able to work creatively and efficiently to solve difficult technical problems.

In this dynamic role, you will not only support the team in conditioning financial data but also play a key role in the adoption of modern data engineering practices. Your contributions will directly impact the efficiency and effectiveness of data processing, setting the stage for advanced data analysis and decision-making. The ideal candidate will bring a proven track record of building and implementing ETL processes, with a keen eye for optimizing data for various enterprise applications. If you have a passion for data engineering and are ready to take on a challenge that marries technical prowess with mission-critical analysis, this is the opportunity for you.

What will you do?

• As a Data Engineer in this role, you will be at the forefront of transforming financial data into actionable insights for a mission-driven customer.
• Your primary responsibility will be to develop, optimize, and maintain robust ETL processes and data pipelines.
• You will leverage your expertise in Python and SQL to condition and normalize both raw and structured data, enhancing its usability and searchability within downstream enterprise tools. Your work will be pivotal in implementing cutting-edge technology, including AI models, to improve data fidelity and accelerate data engineering tasks.
• Familiarity with Apache Airflow and Apache Hop will be beneficial as you build new and repeatable workflows to support the team's objectives.
• Your success in this position will be bolstered by your ability to work independently as well as collaboratively with a team of technical experts, data managers, and operational stakeholders. Experience with Amazon Web Services (AWS) will be crucial as you deploy scalable solutions in a cloud environment. While not mandatory, a background in Kubernetes will give you an edge, as will any experience with financial data and language translation models.

Do you have what it takes?

• Active TS/SCI with Polygraph required.
• Bachelor's degree in computer science, Software Engineering, or related field.

Required Skills:

• Python
• Structured Query Language (SQL)
• Apache Airflow
• Apache Hop
• Experience normalizing raw, unstructured, and structured data
• Ability to work independently and collaboratively
• Experience building, optimizing, and implementing ETL processes and data pipelines
• Experience with Amazon Web Services (AWS)

Desired Skills:

• Experience with financial data
• Experience with language translation models
• Experience using Kubernetes

This position is open for current and future positions.

• Active TS/SCI with Polygraph required.
• Bachelor's degree in computer science, Software Engineering, or related field.

Required Skills:

• Python
• Structured Query Language (SQL)
• Apache Airflow
• Apache Hop
• Experience normalizing raw, unstructured, and structured data
• Ability to work independently and collaboratively
• Experience building, optimizing, and implementing ETL processes and data pipelines
• Experience with Amazon Web Services (AWS)

Desired Skills:

• Experience with financial data
• Experience with language translation models
• Experience using Kubernetes

This position is open for current and future positions.

• As a Data Engineer in this role, you will be at the forefront of transforming financial data into actionable insights for a mission-driven customer.
• Your primary responsibility will be to develop, optimize, and maintain robust ETL processes and data pipelines.
• You will leverage your expertise in Python and SQL to condition and normalize both raw and structured data, enhancing its usability and searchability within downstream enterprise tools. Your work will be pivotal in implementing cutting-edge technology, including AI models, to improve data fidelity and accelerate data engineering tasks.
• Familiarity with Apache Airflow and Apache Hop will be beneficial as you build new and repeatable workflows to support the team's objectives.
• Your success in this position will be bolstered by your ability to work independently as well as collaboratively with a team of technical experts, data managers, and operational stakeholders. Experience with Amazon Web Services (AWS) will be crucial as you deploy scalable solutions in a cloud environment. While not mandatory, a background in Kubernetes will give you an edge, as will any experience with financial data and language translation models.