Senior Data Pipeline Engineer - Cloud ETL & Quality

TekStream Solutions; Baltimore (MD); Sur place; USD 90 000 - 120 000; Plein temps

Résumé du poste

A leading IT services firm in Baltimore is seeking an experienced Data Engineer specializing in the design and optimization of data pipelines. You will collaborate with Data Scientists and Analysts to ensure the delivery of quality data solutions. The ideal candidate should have at least 5 years of experience in data engineering and proficiency in cloud-based technologies. This full-time position requires strong problem-solving and communication skills.

Qualifications

• 5+ years of experience in data engineering, with a focus on building and maintaining data pipelines.
• 1-2 years experience with building NiFI data flows or similar for Kafka and Hadoop-based NoSQL databases.
• Experience with API-led design.
• Strong problem-solving skills and attention to detail.

Responsabilités

• Design, develop, and optimize end-to-end data pipelines for efficient data ETL processes.
• Collaborate with cross-functional teams to understand data requirements.
• Implement best practices for data integration.

Connaissances

Data pipeline development

ETL processes

Sql

Cloud technologies

Data validation and cleansing

Formation

Bachelor’s degree in Computer Science, Engineering, or a related field

Outils

Apache NiFi

AWS S3

Redshift

Google BigQuery

Python

Scala

ELK stack

Description du poste

A leading IT services firm in Baltimore is seeking an experienced Data Engineer specializing in the design and optimization of data pipelines. You will collaborate with Data Scientists and Analysts to ensure the delivery of quality data solutions. The ideal candidate should have at least 5 years of experience in data engineering and proficiency in cloud-based technologies. This full-time position requires strong problem-solving and communication skills.