Senior Data Engineer: Azure Data Platform & Streaming

Valiant Technologies LLC

Stamford (CT)

On-site

USD 83,000 - 110,000

Part time

23 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valiant Technologies LLC in Stamford, CT is seeking a Data Engineer to design and deliver end-to-end data pipelines, including streaming and batch processes. The role includes migrating on-prem to Azure and building event-driven pipelines using Kafka, Flink, and Spark.

You will build a data warehouse and lakehouse on Azure Databricks and ADLS, review code, mentor developers, and collaborate with teams to roll out regulatory and business programs.

Qualifications

  • 10+ years of hands-on experience in IT projects, enterprise integration and SOA.
  • Streaming experience with Flink (or Spark Streaming) for event-driven use cases.
  • Core Java.
  • Oracle or SQL Server, plus data warehouse and lakehouse design.

Responsibilities

  • Build and deliver high-quality data pipelines and platform components end to end.
  • Design and migrate streaming and data platforms from on-prem to Azure.
  • Develop event-driven pipelines integrating Kafka with Flink and Spark.
  • Build and manage the data warehouse and lakehouse on Azure Databricks and ADLS.
  • Review code and designs, mentor developers and enforce engineering standards.
  • Work with development, testing and implementation teams to roll out regulatory and business programs.

Skills

Streaming with Flink/Spark Streaming
Core Java
Data warehouse design

Tools

Oracle
SQL Server
Azure Databricks
Azure Data Lake Storage

Job description

Valiant Technologies LLC in Stamford, CT is seeking a Data Engineer to design and deliver end-to-end data pipelines, including streaming and batch processes. The role includes migrating on-prem to Azure and building event-driven pipelines using Kafka, Flink, and Spark.

You will build a data warehouse and lakehouse on Azure Databricks and ADLS, review code, mentor developers, and collaborate with teams to roll out regulatory and business programs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Azure Data Pipelines & Streaming
Senior Data Engineer - Azure Data Pipelines & Streaming

Quantum Technologies LLC • Stamford (CT)

On-site
USD 83,000 - 110,000
Senior Data Engineer - Azure, Databricks & Streaming
Senior Data Engineer - Azure, Databricks & Streaming

Ethereum Technologies LLC • Stamford (CT)

On-site
USD 80,000 - 107,000
Senior Data Engineer: Azure Data Lakes & Streaming
Senior Data Engineer: Azure Data Lakes & Streaming

Robotics Technologies • Stamford (CT)

On-site
USD 80,000 - 107,000
Senior Data Engineer — Lakehouse & Streaming Platform
Senior Data Engineer — Lakehouse & Streaming Platform

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 120,000 - 180,000
Senior Azure Data Engineer: Pipelines, Databricks & SQL
Senior Azure Data Engineer: Pipelines, Databricks & SQL

Valiant Technologies LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Azure Data Architect | Cloud Data Engineering Lead
Azure Data Architect | Cloud Data Engineering Lead

Valiant Technologies LLC • Minnesota

On-site
USD 120,000 - 150,000
Senior Data Engineer: Spark, Databricks & Data Lakehouse
Senior Data Engineer: Spark, Databricks & Data Lakehouse

Valiant Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 190,000
Azure Data Engineer: Pipelines, Data Lakes & CDC
Azure Data Engineer: Pipelines, Data Lakes & CDC

Valiant Technologies LLC • Grand Rapids (MI)

On-site
USD 110,000 - 150,000
Azure Data Engineer: Cloud Data Pipelines & Spark Pro
Azure Data Engineer: Cloud Data Pipelines & Spark Pro

Valiant Technologies LLC • Austin (TX)

On-site
USD 110,000 - 160,000
Azure Data Engineer: ETL, Data Factory & Analytics
Azure Data Engineer: ETL, Data Factory & Analytics

Valiant Technologies LLC • Atlanta (GA)

On-site
USD 110,000 - 160,000