Senior Data Engineer — Fabric & Databricks

Global Technical Talent, Inc.; Reston (VA); Hybrid; USD 82,000 - 106,000; Part time

Benefits offered by this job

Medical Insurance

Vision Insurance

Dental Insurance

401k Retirement

Job summary

Global Technical Talent, Inc. is seeking a Senior Data Engineer to design and operate enterprise data platforms on Microsoft Fabric and Databricks. You will drive ingestion pipelines, lakehouse architectures, and data governance across production environments.

The position requires 10–15 years of experience in data engineering, data platforms, cloud technologies, and cross-functional collaboration to deliver scalable, secure data solutions with cost efficiency.

Qualifications

• 10–15 years of overall relevant experience in data engineering, data platforms, analytics, and cloud technologies.
• Minimum 5 years of hands-on experience with Databricks and 2 years with Microsoft Fabric environments.
• Proven experience designing and supporting production-grade ETL/ELT and data integration solutions.

Responsibilities

• Own end-to-end technical design, development, and delivery of enterprise data engineering solutions.
• Design and implement scalable ETL/ELT, data integration, and data transformation pipelines for structured and unstructured data sources.
• Develop and maintain batch, near real-time, and streaming data ingestion pipelines from databases, APIs, files, cloud storage, and enterprise applications.
• Build reusable notebooks, data transformations, and processing frameworks using Databricks, Fabric, Python, PySpark, and SQL.
• Design Lakehouse architectures using Delta Lake, OneLake, and medallion layers (Bronze, Silver, Gold).
• Create trusted datasets, curated data products, and semantic data structures for analytics, AI, and ML initiatives.
• Implement data quality frameworks, validation rules, reconciliation controls, and exception management processes.
• Design scalable data models, dimensional schemas, and data marts to optimize reporting and analytics.
• Optimize Spark workloads, SQL queries, storage strategies, and data processing performance.

Skills

Databricks

Spark

Delta Lake

Microsoft Fabric

OneLake

Lakehouse

Data Warehouse

Python

PySpark

SQL

ETL/ELT

Ingestion patterns

Batch processing

Streaming data

Dimensional modeling

Education

B.Tech in Computer Science or Engineering

Microsoft Fabric Analytics Engineer (preferred)

Azure Data Engineer Associate (preferred)

Databricks Data Engineer Professional/Associate (preferred)

Tools

Databricks Admin

Fabric Admin

Azure AD / Entra

RBAC

Key Vault

Job description

Global Technical Talent, Inc. is seeking a Senior Data Engineer to design and operate enterprise data platforms on Microsoft Fabric and Databricks. You will drive ingestion pipelines, lakehouse architectures, and data governance across production environments.

The position requires 10–15 years of experience in data engineering, data platforms, cloud technologies, and cross-functional collaboration to deliver scalable, secure data solutions with cost efficiency.