Lead Data Engineer — Azure Databricks

Sunray Enterprise, Inc.; Washington (District of Columbia); On-site; USD 150,000 - 190,000; Full time

Job summary

Sunray Enterprise, Inc. is seeking a Lead Developer to guide the MIGA Data Track, providing hands-on leadership across data engineering, integration, and modernization initiatives.

You will translate business and analytics needs into scalable data solutions using Azure Databricks, Spark/PySpark, SQL, and related Azure services. You will mentor engineers, enforce best practices, and collaborate with data architects to deliver reliable, secure, and maintainable data pipelines and architectures

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, Data Engineering, or related discipline with significant hands-on enterprise data engineering experience.
• Demonstrated experience as a Lead Developer/Technical Lead for complex integrated data solutions.

Responsibilities

• Provide hands‑on technical leadership across data engineering, integration, transformation, and implementation activities.
• Lead design, development, and modernization of enterprise data solutions translating requirements into scalable implementations.
• Design and develop data pipelines using Azure Databricks, Spark/PySpark, SQL and Azure data services.
• Build and optimize ETL/ELT pipelines and reusable data components across multiple systems.
• Collaborate with Data/Solution Architects to ensure scalable, secure, modular data architectures.
• Lead data integration from multiple applications, databases, APIs, files, and upstream/downstream systems.
• Implement data quality, validation, reconciliation, logging, monitoring, metadata, and audit controls.
• Optimize Spark/Databricks workloads and SQL queries for performance and resource utilization.
• Establish and enforce development standards, code reviews, automated testing, and CI/CD practices.
• Collaborate with DevOps/platform teams to enable CI/CD and DevSecOps using Azure DevOps/GitHub.
• Lead troubleshooting, root‑cause analysis, and production stabilization for complex data processing.

Skills

Lead Developer

Data Engineering

Azure Databricks

Spark/PySpark

SQL

Azure data services

ETL/ELT

CI/CD

DevSecOps

Mentoring

Education

Bachelor's/Master's in CS/Engineering/IT

Tools

Azure DevOps

GitHub

Job description

Sunray Enterprise, Inc. is seeking a Lead Developer to guide the MIGA Data Track, providing hands-on leadership across data engineering, integration, and modernization initiatives.

You will translate business and analytics needs into scalable data solutions using Azure Databricks, Spark/PySpark, SQL, and related Azure services. You will mentor engineers, enforce best practices, and collaborate with data architects to deliver reliable, secure, and maintainable data pipelines and architectures