Software Engineering Lead (#9BCTLJP00003123)

Smart Synergies; Glendale (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Smart Synergies is hiring a Software Engineering Lead to head data initiatives focused on Azure Data Lake and Databricks. You will architect scalable data solutions, enforce best practices for ingestion, storage, and processing, and lead a team of data engineers across cross‑functional programs.

The role emphasizes security, governance, and Azure platform optimization, with a roadmap driven by business objectives and industry best practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 8+ years of experience in data engineering, with leadership experience.
• Hands‑on experience with Azure Data Lake, Databricks, and other Azure services.
• Proven ability to architect and implement large‑scale data solutions.
• US citizenship is required for this position.

Responsibilities

• Architect and implement scalable data architectures using Azure Data Lake and Databricks.
• Define best practices for data ingestion, storage, processing, and retrieval.
• Lead and mentor a team of data engineers and collaborate with cross‑functional teams.
• Oversee security measures, RBAC, encryption, and audits within Azure.
• Develop roadmaps and stay current with Azure tech and data engineering trends.

Skills

SQL

Azure Data Lake

Databricks

Leadership

Data engineering

Data governance

RBAC

Security concepts

CI/CD

DevOps

Big data

Education

Bachelor’s or Master’s degree in Computer Science / IT

Tools

Azure Data Lake

Databricks

RBAC

CI/CD

Job description

Description:

Job Title – Software Engineering Lead

Job Summary:

We are seeking an experienced and highly skilled Software Engineering Lead to spearhead our data initiatives, with a primary focus on Azure Data Lake and its associated ecosystem. The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure, and a proven track record of leading teams in delivering scalable and secure data solutions. #LI-TN1

Major Responsibilities:

Architectural Design and Implementation:

• Design and implement robust, scalable, and efficient data architectures leveraging Azure Data Lake and Databricks.
• Define and enforce best practices for data ingestion, storage, processing, and retrieval.
• Optimize data workflows to ensure high performance and cost efficiency.

Data Governance and Security:

• Develop and implement security measures for Azure Data Lake, ensuring compliance with organizational and regulatory standards.
• Manage role-based access control (RBAC), encryption, and other security protocols within Azure Subscriptions.
• Collaborate with security teams to perform regular audits and vulnerability assessments.

Team Leadership and Collaboration:

• Lead and mentor a team of data engineers, providing technical guidance and fostering professional development.
• Collaborate with cross-functional teams, including data scientists, business analysts, and IT teams, to deliver data-driven solutions.
• Drive agile practices and ensure timely delivery of projects.

Platform Optimization and Monitoring:

• Oversee the deployment and management of Azure Data Lake and Databricks environments.
• Implement monitoring and alerting systems to ensure system reliability and performance.
• Evaluate and incorporate new Azure services and technologies to enhance the data platform.

Strategic Planning and Roadmap Development:

• Develop and execute a roadmap for data engineering aligned with business objectives.
• Stay abreast of industry trends and advancements in data engineering and Azure technologies.
• Provide recommendations for long-term data strategy, including data lakehouse adoption and cloud optimization.

Education and Experience Requirements:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 8+ years of experience in data engineering, with at least 3 years in a leadership role.
• Extensive hands‑on experience with Azure Data Lake, Databricks, and other Azure services.
• Proven expertise in architecting and implementing large-scale data solutions.
• US citizenship is required for this position.

Required Knowledge and Skills:

Technical Skills:

• Proficiency in SQL.
• Deep understanding of Azure security concepts, including subscription management, RBAC, and data encryption.
• Experience with data modeling, ETL pipelines, and big data technologies.
• Familiarity with CI/CD pipelines and DevOps practices in a data engineering context.

Soft Skills:

• Strong leadership and team management abilities.
• Excellent communication and stakeholder management skills.
• Analytical mindset with a proactive approach to problem‑solving.

Preferred Qualifications:

• Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.
• Experience with implementing data lakehouse architectures.
• Familiarity with data governance frameworks like GDPR, CCPA, or HIPAA.