Senior Data Engineer (Databricks)

ALOIS Solutions; Wilmington (DE); Hybrid; USD 140,000 - 145,000; Full time

Job summary

ALOIS Solutions in Wilmington, DE is hiring a Senior Data Engineer - Databricks for our client. This hybrid role requires 10+ years of Data Engineering/Data & Analytics experience and hands-on Azure Databricks.

The role focuses on designing scalable ETL pipelines for batch and streaming data, leading the data engineering team, and collaborating with data scientists and product owners on data and AI initiatives. Compensation is $140k–$145k per year.

Qualifications

• 10+ years of Data Engineering/Data & Analytics experience.
• 8+ years of Data Engineering / Data & Analytics experience.
• 4+ years of recent hands-on Azure experience.
• Strong hands-on experience with Azure Databricks.
• Strong experience with Azure Data Factory (ADF).
• Strong Python, PySpark, and SQL skills.
• Experience with Databricks Unity Catalog for data governance and security.
• Experience with CI/CD and Azure DevOps.
• Strong ETL and data pipeline development experience.
• Experience designing scalable and secure data architectures.

Responsibilities

• Partner with business stakeholders to understand requirements and translate them into scalable data solutions.
• Design and develop scalable ETL and data ingestion frameworks for batch and streaming workloads.
• Provide technical leadership across architecture, development, troubleshooting, and delivery.
• Collaborate with Data Architects, Data Scientists, and Product Owners on data and AI initiatives.
• Lead and mentor data engineering team members and promote engineering best practices.
• Maintain and optimize data platforms supporting analytics, reporting, and AI workloads.

Skills

Python

PySpark

SQL

Data modeling

Stakeholder mgmt

Tools

Azure Databricks

Azure Data Factory

Databricks Unity Catalog

Azure DevOps

CI/CD pipelines

Job description

Please Note: This position requires 10+ years of overall Data Engineering/Data & Analytics experience. Candidates with less than 10 years of experience, please do not apply.

We are hiring for one of our clients for a Senior Data Engineer - Databricks opportunity in Wilmington, DE.

Work Model: Hybrid - 3-4 days onsite/week

Compensation: $140-145K annually

Visa: No Visa Sponsorship/Transfer and no Corp to Corp

What You'll Do

• Partner with business stakeholders to understand requirements and translate them into scalable data solutions.
• Design and develop scalable ETL and data ingestion frameworks for batch and streaming workloads.
• Provide technical leadership across architecture, development, troubleshooting, and delivery.
• Collaborate with Data Architects, Data Scientists, and Product Owners on data and AI initiatives.
• Lead and mentor data engineering team members and promote engineering best practices.
• Maintain and optimize data platforms supporting analytics, reporting, and AI workloads.
• 8+ years of experience in Data Engineering / Data & Analytics.
• 4+ years of recent hands-on Azure experience.
• Strong hands-on experience with Azure Databricks.
• Strong experience with Azure Data Factory (ADF).
• Strong Python, PySpark, and SQL skills.
• Experience with Databricks Unity Catalog for data governance and security.
• Experience with CI/CD and Azure DevOps.
• Strong ETL and data pipeline development experience.
• Experience designing scalable and secure data architectures.
• Strong stakeholder management and communication skills.
• Ability to translate business requirements into effective technical solutions.