Senior Data Engineer - Azure Databricks & Synapse

Software Technology Inc; Indianapolis (IN); Vor Ort; USD 120.000 - 180.000; Vollzeit

Zusammenfassung

Software Technology Inc is hiring a Data Engineer to design, build, and maintain secure data solutions across Azure Databricks and Azure Synapse Analytics. Local candidates only are considered.

You will partner with data architects, scientists, analysts, and project managers to translate business needs into robust technical designs, implement governance, and optimize workloads while delivering reliable data products for the agency.

Qualifikationen

• Requires advanced data engineering experience with batch and streaming pipelines.
• Knowledge of data governance, security controls, and HIPAA-like considerations.
• Experience with medallion architecture (bronze/silver/gold).
• Ability to translate business needs into scalable data solutions.

Aufgaben

• Assist with data technology strategy and resolve data integration issues.
• Design and implement data pipelines in Azure Databricks and Synapse.
• Develop dimensional models and SQL workloads to support reporting.
• Orchestrate workflows with Databricks Jobs and Synapse pipelines.
• Apply data governance, access controls, and masking for sensitive data.

Kenntnisse

Databricks

PySpark

Spark SQL

Delta Lake

Azure Synapse

Azure Databricks

Unity Catalog

ADF Pipelines

Databricks Workflows

GitHub

Structured Streaming

Ausbildung

Master's degree in data science, analytics, informatics, computer science, mathematics, engineering, or related field

Bachelor's degree in a related field + 2+ years of experience

Tools

Auto Loader

Lakehouse

OPENROWSET

Synapse/CETAS

Azure Data Factory

Git

Databricks

Jobbeschreibung

Software Technology Inc is hiring a Data Engineer to design, build, and maintain secure data solutions across Azure Databricks and Azure Synapse Analytics. Local candidates only are considered.

You will partner with data architects, scientists, analysts, and project managers to translate business needs into robust technical designs, implement governance, and optimize workloads while delivering reliable data products for the agency.