Senior Data Engineer & Tech Lead - Databricks Pipelines

Simarn Solutions; Connecticut; On-site; USD 140,000 - 210,000; Full time

Job summary

Simarn Solutions seeks a Senior Data Engineer / Technical Lead to join a long-term cloud data solutions project. You will design scalable data pipelines, drive data products with Databricks and PySpark, and ensure governance and security across data flows.

The role requires extensive experience in data engineering, cloud platforms (Azure or AWS), and leadership to mentor teammates and collaborate with architects and stakeholders.

Qualifications

• 8+ years of IT experience.
• 6+ years of Data Engineering experience.
• Kafka / Event Hub / Kinesis / SNS.
• Azure or AWS Cloud.
• ETL Development & Data Warehousing.

Responsibilities

• Design and develop scalable data pipelines and ETL processes.
• Build data products using Databricks, PySpark, and DBT.
• Ensure data quality, governance, and security standards.
• Provide technical leadership and mentor team members.
• Collaborate with architects and business stakeholders.

Skills

Data engineering

Technical leadership

Mentoring

Architectural design

Cloud platforms

Tools

Azure Databricks

PySpark

Python

ADF

SQL

Kafka

Kinesis

Event Hub

SNS

DBT

Job description

Simarn Solutions seeks a Senior Data Engineer / Technical Lead to join a long-term cloud data solutions project. You will design scalable data pipelines, drive data products with Databricks and PySpark, and ensure governance and security across data flows.

The role requires extensive experience in data engineering, cloud platforms (Azure or AWS), and leadership to mentor teammates and collaborate with architects and stakeholders.