Technical Engineer Senior | Level III

Sunrise Systems; Hartford (CT); Hybrid; USD 130,000 - 190,000; Full time

Job summary

Sunrise Systems in Hartford, CT is seeking a Senior Databricks Architect/Administrator to design and optimize enterprise data platforms. You will lead architecture, governance, performance, and cost optimization while supporting scalable data pipelines across cloud environments.

The role requires 7+ years in data engineering with 4+ years in Databricks, strong Python/PySpark/SQL skills, and hands-on experience with Unity Catalog, Delta Lake, and Workflows. Hybrid onsite work is offered.

Qualifications

• 7+ years in data engineering
• 4+ years in Databricks
• Strong Python, PySpark, SQL
• Expertise in Databricks Unity Catalog, Delta Lake, Workflows
• Unix/Linux scripting (Bash)
• Experience with AWS/Azure/GCP
• Knowledge of CI/CD, Git, Jira/ServiceNow

Responsibilities

• Architect and manage Databricks platform (Unity Catalog, Delta Lake, Workflows)
• Design scalable data pipelines (DLT, Spark/PySpark, streaming)
• Optimize performance, cost (DBUs), and cluster configurations
• Manage Unix/Linux environments, scripting, and automation
• Ensure governance, security, and compliance standards
• Integrate with tools like Fivetran, Ab Initio, and cloud platforms
• Support AI/ML workflows (MLflow, AutoML)

Skills

Python

PySpark

SQL

Cloud platforms

Unix/Linux scripting

Tools

Databricks Unity Catalog

Delta Lake

Databricks Workflows

Fivetran

Ab Initio

Git

Jira/ServiceNow

Job description

Location: Hartford, CT (Hybrid)

Duration: Contract to hire

Summary:

Seeking a senior Databricks Architect/Admin to design, implement, and optimize enterprise data platforms. This role will lead architecture, governance, performance, and cost optimization while supporting scalable data pipelines and cloud infrastructure.

Key Responsibilities:

• Architect and manage Databricks platform (Unity Catalog, Delta Lake, Workflows)


• Design scalable data pipelines (DLT, Spark/PySpark, streaming)


• Optimize performance, cost (DBUs), and cluster configurations


• Manage Unix/Linux environments, scripting, and automation


• Ensure governance, security, and compliance standards


• Integrate with tools like Fivetran, Ab Initio, and cloud platforms


• Support AI/ML workflows (MLflow, AutoML)

Requirements:

• 7+ years in data engineering; 4+ years Databricks


• Strong Python, PySpark, SQL


• Expertise in Databricks (Unity Catalog, Delta Lake, Workflows)


• Unix/Linux & scripting (Bash)


• Experience with AWS/Azure/GCP


• Knowledge of CI/CD, Git, Jira/ServiceNow

Nice to Have:

• MLflow, AutoML, AI/LLM exposure


• Airflow or workflow orchestration tools


• Data governance tools (Collibra, Alation)