Data Engineer: ETL, Data Lake & Cloud Pipelines (Clearance)

SteerBridge, Inc.

Vienna (VA)

On-site

USD 130,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Jobtailor is seeking a senior data engineer to build and optimize batch and real-time data ingestion pipelines in a cloud-first environment. You will design scalable ETL processes across distributed systems and manage data lake architecture for structured and unstructured data.

You will utilize dbt, Informatica, Azure Data Factory, Databricks, AWS Glue, and related services to transform data, orchestrate workflows, and ensure data quality.

Qualifications

  • Bachelor's degree in Computer Science or a related field; minimum 3 years of relevant work experience.
  • U.S. citizenship; active security clearance or ability to obtain one.

Responsibilities

  • Build, optimize, and maintain batch and real-time data ingestion pipelines.
  • Lead design and implementation of scalable ETL processes across distributed systems.
  • Develop and manage data lake architecture for structured and unstructured data.
  • Perform data transformation using dbt, Informatica, Azure Data Factory, Databricks, AWS Glue, and related tools.
  • Write performant SQL queries and Python/JavaScript scripts for data parsing and cleansing.
  • Conduct data profiling, linkage, validation, and quality checks.

Skills

ETL Frameworks
Data Ingestion
Data Transformation
SQL Proficiency
Python Programming
Pandas
PySpark
AWS Glue
Azure Data Factory
Databricks

Education

Bachelor's degree in Computer Science or related field

Tools

Dbt
Informatica
Azure Data Factory
Databricks
AWS Glue
AWS EventBridge
S3 Event Notifications
Pandas
PySpark
Azure Blob

Job description

Jobtailor is seeking a senior data engineer to build and optimize batch and real-time data ingestion pipelines in a cloud-first environment. You will design scalable ETL processes across distributed systems and manage data lake architecture for structured and unstructured data.

You will utilize dbt, Informatica, Azure Data Factory, Databricks, AWS Glue, and related services to transform data, orchestrate workflows, and ensure data quality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Real-Time ETL & Data Lake Solutions
Data Engineer: Real-Time ETL & Data Lake Solutions

ContractStaffingRecruiters.com • Stamford (CT)

Remote
USD 90,000 - 130,000
Data Engineer
Data Engineer

SteerBridge, Inc. • Vienna (VA)

On-site
USD 130,000 - 180,000
Data Engineer: Real-Time Data Pipelines & Cloud
Data Engineer: Real-Time Data Pipelines & Cloud

ContractStaffingRecruiters.com • Aquone (NC)

Remote
USD 110,000 - 150,000
Data Engineer
Data Engineer

EdgeQ Technologies Private Limited • Dallas (TX)

On-site
USD 100,000 - 160,000
Data Engineer
Data Engineer

VTG Defense • McLean (VA)

On-site
USD 100,000 - 130,000
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data
Senior Data Engineer: Cloud Pipelines, Analytics & ML Data

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Data Engineer
Data Engineer

Compunnel Inc. • Jersey City (NJ)

On-site
USD 100,000 - 130,000
Senior Data Engineer — End-to-End Pipelines & Cloud
Senior Data Engineer — End-to-End Pipelines & Cloud

TechDigital Group • Warsaw (IN)

On-site
USD 80,000 - 120,000
Data Engineer
Data Engineer

Talent Software Services, Inc. • Hartford (CT)

Remote
USD 90,000 - 130,000
Data Engineer: Build Scalable Pipelines & Insights
Data Engineer: Build Scalable Pipelines & Insights

Compunnel Inc. • Orlando (FL)

On-site
USD 85,000 - 110,000