Senior Data Engineer: AWS, Databricks & Fabric (Onsite Indy)

Teamware Solutions Inc.; Indianapolis (IN); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Travel expenses covered for onsite

Job summary

Teamware Solutions Inc. in Indianapolis, IN seeks a Senior Data Engineer with strong Python, SQL, PySpark and AWS data services to build and maintain scalable data pipelines and enterprise data lakes.

You will work with Databricks, Microsoft Fabric, OneLake and Power BI data integration, implement Parquet data formats, and ensure data quality and governance in a regulated GMP environment.

Qualifications

• We are seeking a Senior Data Engineer with GMP experience.
• Strong experience in Python, SQL, PySpark and AWS data services.
• Experience with data lakes, medallion architecture (Bronze, Silver, Gold) on AWS.
• Experience with Databricks, Microsoft Fabric, OneLake and Power BI data integration.
• GMP or regulated industry experience preferred.

Responsibilities

• Build and maintain scalable data pipelines.
• Develop and manage enterprise data lakes on AWS.
• Integrate Parquet data and ensure data quality and governance.

Skills

Python

SQL

PySpark

AWS Glue

AWS Lambda

Step Functions

AWS DMS

REST API

Databricks

Microsoft Fabric

OneLake

Power BI

Tools

Parquet

Job description

Teamware Solutions Inc. in Indianapolis, IN seeks a Senior Data Engineer with strong Python, SQL, PySpark and AWS data services to build and maintain scalable data pipelines and enterprise data lakes.

You will work with Databricks, Microsoft Fabric, OneLake and Power BI data integration, implement Parquet data formats, and ensure data quality and governance in a regulated GMP environment.