Senior Data Engineer / Technical Lead

SIMARN Solutions; Connecticut; On-site; USD 140,000 - 210,000; Full time

Job summary

Simarn Solutions seeks a Senior Data Engineer / Technical Lead to join a long-term cloud data solutions project. You will design scalable data pipelines, drive data products with Databricks and PySpark, and ensure governance and security across data flows.

The role requires extensive experience in data engineering, cloud platforms (Azure or AWS), and leadership to mentor teammates and collaborate with architects and stakeholders.

Qualifications

• 8+ years of IT experience.
• 6+ years of Data Engineering experience.
• Kafka / Event Hub / Kinesis / SNS.
• Azure or AWS Cloud.
• ETL Development & Data Warehousing.

Responsibilities

• Design and develop scalable data pipelines and ETL processes.
• Build data products using Databricks, PySpark, and DBT.
• Ensure data quality, governance, and security standards.
• Provide technical leadership and mentor team members.
• Collaborate with architects and business stakeholders.

Skills

Data engineering

Technical leadership

Mentoring

Architectural design

Cloud platforms

Tools

Azure Databricks

PySpark

Python

ADF

SQL

Kafka

Kinesis

Event Hub

SNS

DBT

Job description

We're Hiring: Senior Data Engineer / Technical Lead

Are you a highly experienced Data Engineer with expertise in Azure Databricks, PySpark, Python, ADF, SQL, and Kafka? We're looking for a strong senior-level consultant to join a long-term project focused on building scalable cloud data solutions.

Required Skills:

• 8+ years of IT experience
• 6+ years of Data Engineering experience
• Kafka / Event Hub / Kinesis / SNS
• Azure or AWS Cloud
• ETL Development & Data Warehousing

Nice to Have:

• DBT
• Data Mesh / Data as a Product
• Immuta
• API Management
• Multi-Cloud Integration Experience

Key Responsibilities:

• Design and develop scalable data pipelines and ETL processes
• Build data products using Databricks, PySpark, and DBT
• Ensure data quality, governance, and security standards
• Provide technical leadership and mentor team members
• Collaborate with architects and business stakeholders