Senior Data Engineer - Azure Data Pipelines & Streaming

Quantum Technologies LLC

Stamford (CT)

On-site

USD 83,000 - 110,000

Part time

23 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Stamford, CT is seeking a senior Data Engineer to design end-to-end data pipelines and migrate streaming platforms to Azure. You will develop event-driven pipelines using Kafka with Flink and Spark, and manage the data warehouse and lakehouse on Azure Databricks and ADLS.

Responsibilities include code reviews, mentoring developers, and ensuring engineering standards while coordinating with cross-functional teams to deploy regulatory and business programs.

Qualifications

  • 10+ years of hands-on experience in IT projects, enterprise integration and SOA.
  • Streaming experience with Flink (or Spark Streaming) for event-driven use cases.
  • Core Java development experience.
  • Oracle or SQL Server, plus data warehouse and lakehouse design.

Responsibilities

  • Build and deliver high-quality data pipelines and platform components end to end.
  • Design and migrate streaming and data platforms from on-prem to Azure.
  • Develop event-driven pipelines integrating Kafka with Flink and Spark.
  • Build and manage the data warehouse and lakehouse on Azure Databricks and ADLS.
  • Review code and designs, mentor developers and enforce engineering standards.
  • Work with development, testing and implementation teams to roll out regulatory and business programs.

Skills

Core Java
Streaming with Flink
Spark Streaming
Data warehousing

Tools

Azure Databricks
ADLS
Kafka

Job description

Quantum Technologies. LLC in Stamford, CT is seeking a senior Data Engineer to design end-to-end data pipelines and migrate streaming platforms to Azure. You will develop event-driven pipelines using Kafka with Flink and Spark, and manage the data warehouse and lakehouse on Azure Databricks and ADLS.

Responsibilities include code reviews, mentoring developers, and ensuring engineering standards while coordinating with cross-functional teams to deploy regulatory and business programs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Azure Data Platform & Streaming
Senior Data Engineer: Azure Data Platform & Streaming

Valiant Technologies LLC • Stamford (CT)

On-site
USD 83,000 - 110,000
Senior Data Engineer: Azure Data Lakes & Streaming
Senior Data Engineer: Azure Data Lakes & Streaming

Robotics Technologies • Stamford (CT)

On-site
USD 80,000 - 107,000
Senior Data Engineer - Azure, Databricks & Streaming
Senior Data Engineer - Azure, Databricks & Streaming

Ethereum Technologies LLC • Stamford (CT)

On-site
USD 80,000 - 107,000
Senior Azure Data Engineer: Pipelines & Databricks
Senior Azure Data Engineer: Pipelines & Databricks

Quantum Technologies LLC • Houston (TX)

On-site
USD 120,000 - 180,000
Senior Data Engineer: AI-Driven Data Pipelines
Senior Data Engineer: AI-Driven Data Pipelines

Quantum Technologies LLC • Dallas (TX)

On-site
USD 130,000 - 190,000
Azure Data Engineer — Lead Data Pipelines & Databricks
Azure Data Engineer — Lead Data Pipelines & Databricks

Quantum Technologies LLC • Pennsylvania

On-site
USD 91,000 - 124,000
Cloud Data Engineer: Spark, Snowflake & Azure Pipelines
Cloud Data Engineer: Spark, Snowflake & Azure Pipelines

Quantum Technologies. LLC • San Jose (CA)

On-site
USD 120,000 - 180,000
Senior Data Engineer: Scalable Pipelines & Warehouses
Senior Data Engineer: Scalable Pipelines & Warehouses

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 160,000
Data Engineer - Databricks & Spark on Azure
Data Engineer - Databricks & Spark on Azure

Quantum Technologies LLC • Quincy (MA)

On-site
USD 80,000 - 107,000
Senior ETL Architect - Azure Data Factory & Databricks
Senior ETL Architect - Azure Data Factory & Databricks

Quantum Technologies. LLC • Tallahassee (FL)

On-site
USD 110,000 - 170,000