Senior Data Engineer - Azure Databricks & ETL Architect

Scorpion Therapeutics; Chapel Hill (NC); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Medical/dental/vision/prescription

Wellness resources

401k/ESPP

Paid time off

Paid parental leave

Disability benefits

Additional programs

Job summary

Scorpion Therapeutics is seeking a senior Data Engineer to design, build, and optimize enterprise data pipelines. You will work with Databricks and Azure Data Factory to support data warehousing and analytics, while collaborating with analysts, data scientists, and stakeholders to deliver data solutions.

You will mentor junior engineers, oversee data processing reliability, and help define data management best practices across the team.

Qualifications

• 5+ years building and maintaining EDW and pipelines with a Bachelor's degree.
• 3+ years data architecting/engineering delivering complex data solutions.
• 3+ years Tier 1 SaaS integration (e.g., Salesforce) or equivalent.
• 3+ years working with AppDev/BI/AI team members.
• Advanced SQL with performance tuning and stored procedures.
• Hands-on Azure Databricks (Spark processing, notebooks, Delta Lake).
• Hands-on Azure Data Factory (build/orchestrate/monitor ETL/ELT pipelines).
• Cloud experience (Azure preferred).
• Proficiency in Python.
• Strong problem-solving/communication; manage multiple priorities.
• Experience delivering data processing reliability.

Responsibilities

• Design, build, and optimize ETL/ELT pipelines using Databricks and Azure Data Factory.
• Provide access and security controls with stakeholders.
• Support and maintain daily data processing operations.
• Collaborate with analysts and data scientists to deliver data solutions.
• Provide mentorship to junior data engineers.
• Monitor data systems for performance and reliability.
• Lead data management initiatives to improve practices and tools.
• Participate in code reviews and technical documentation.
• Consult and lead BI and analytics platforms.

Skills

Advanced SQL

Azure Databricks

Azure Data Factory

Python

Data warehousing concepts

Stakeholder comms

Project management

Education

Bachelor's degree

Tools

Salesforce

Job description

Scorpion Therapeutics is seeking a senior Data Engineer to design, build, and optimize enterprise data pipelines. You will work with Databricks and Azure Data Factory to support data warehousing and analytics, while collaborating with analysts, data scientists, and stakeholders to deliver data solutions.

You will mentor junior engineers, oversee data processing reliability, and help define data management best practices across the team.