Senior Data Engineer - Databricks Pipelines & Data Mesh

Nityo Infotech Limited; Connecticut; On-site; USD 120,000 - 180,000; Full time

Job summary

Nityo Infotech Limited is seeking a senior Data Engineer to translate requirements into scalable data product designs and to build robust pipelines in Databricks using PySpark and DBT. You will stream data with Kafka, enforce data quality, and collaborate with architects and data owners to deliver high-quality solutions.

The role requires 8+ years of IT experience with 6+ years in data engineering, and hands-on experience with Databricks, PySpark, DBT, and Kafka in a multi-cloud/on-prem

Qualifications

• 8+ years of IT experience with 6+ years in data engineering.
• Experience delivering data engineering solutions for enterprise workloads.
• Hands-on with Databricks, PySpark, DBT, and streaming with Kafka.

Responsibilities

• Translate requirements into end-to-end technical data design for data products.
• Develop pipelines in Databricks using PySpark and DBT to onboard sources.
• Collaborate with architects and data owners to ensure high-quality deliverables.

Skills

Data engineering experience

Data integration

Communication with stakeholders

Tools

Databricks

Data Mesh

Data as a Product

Python

DBT

Kafka

Cloud-based API management

Immuta

Multi-cloud and on-prem integration

Job description

Nityo Infotech Limited is seeking a senior Data Engineer to translate requirements into scalable data product designs and to build robust pipelines in Databricks using PySpark and DBT. You will stream data with Kafka, enforce data quality, and collaborate with architects and data owners to deliver high-quality solutions.

The role requires 8+ years of IT experience with 6+ years in data engineering, and hands-on experience with Databricks, PySpark, DBT, and Kafka in a multi-cloud/on-prem