Lead Software Engineer

SPECTRAFORCE; Glendale (AZ); On-site; Full time

Job summary

A leading company is seeking a Software Engineering Lead to spearhead data initiatives focused on Azure Data Lake. The role requires deep architectural knowledge, team leadership, and a strong understanding of security concepts. Ideal candidates will have extensive experience in data engineering and a proven track record of delivering scalable solutions.

Qualifications

• 8+ years of experience in data engineering, with at least 3 years in a leadership role.
• Extensive hands-on experience with Azure Data Lake and Databricks.

Responsibilities

• Design and implement scalable data architectures leveraging Azure Data Lake.
• Lead and mentor a team of data engineers.
• Develop and implement security measures for Azure Data Lake.

Skills

SQL

Leadership

Communication

Problem Solving

Education

Bachelor's or Master's degree in Computer Science

Tools

Azure Data Lake

Databricks

ETL

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by SPECTRAFORCE. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$59.35/hr - $77.03/hr

Role: Software Engineering Lead

Duration: 12 months

Location: Glendale, AZ

*Local in Arizona only will be considered*

Job Summary:

We are seeking an experienced and highly skilled Software Engineering Lead to spearhead our data initiatives, with a primary focus on Azure Data Lake and its associated ecosystem. The ideal candidate will possess deep architectural knowledge of Azure Data Lake and Databricks, a solid understanding of security concepts within Azure, and a proven track record of leading teams in delivering scalable and secure data solutions.

Major Responsibilities:

Architectural Design and Implementation:

• Design and implement robust, scalable, and efficient data architectures leveraging Azure Data Lake and Databricks.

• Define and enforce best practices for data ingestion, storage, processing, and retrieval.

• Optimize data workflows to ensure high performance and cost efficiency.

Data Governance and Security:

• Develop and implement security measures for Azure Data Lake, ensuring compliance with organizational and regulatory standards.

• Manage role-based access control (RBAC), encryption, and other security protocols within Azure Subscriptions.

• Collaborate with security teams to perform regular audits and vulnerability assessments.

Team Leadership and Collaboration:

• Lead and mentor a team of data engineers, providing technical guidance and fostering professional development.

• Collaborate with cross-functional teams, including data scientists, business analysts, and IT teams, to deliver data-driven solutions.

• Drive agile practices and ensure timely delivery of projects.

Platform Optimization and Monitoring:

• Oversee the deployment and management of Azure Data Lake and Databricks environments.

• Implement monitoring and alerting systems to ensure system reliability and performance.

• Evaluate and incorporate new Azure services and technologies to enhance the data platform.

Strategic Planning and Roadmap Development:

• Develop and execute a roadmap for data engineering aligned with business objectives.

• Stay abreast of industry trends and advancements in data engineering and Azure technologies.

• Provide recommendations for long-term data strategy, including data lakehouse adoption and cloud optimization.

Education and Experience Requirements:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

• 8+ years of experience in data engineering, with at least 3 years in a leadership role.

• Extensive hands-on experience with Azure Data Lake, Databricks, and other Azure services.

• Proven expertise in architecting and implementing large-scale data solutions.

• US citizenship is required for this position.

Required Knowledge and Skills:

Technical Skills:

• Proficiency in SQL.

• Deep understanding of Azure security concepts, including subscription management, RBAC, and data encryption.

• Experience with data modeling, ETL pipelines, and big data technologies.

• Familiarity with CI/CD pipelines and DevOps practices in a data engineering context.

Soft Skills:

• Strong leadership and team management abilities.

• Excellent communication and stakeholder management skills.

• Analytical mindset with a proactive approach to problem-solving.

Preferred Qualifications:

• Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect Expert.

• Experience with implementing data lakehouse architectures.

• Familiarity with data governance frameworks like GDPR, CCPA, or HIPAA.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  Staffing and Recruiting

Referrals increase your chances of interviewing at SPECTRAFORCE by 2x

Sign in to set job alerts for “Software Engineer” roles.

Tempe, AZ $105,000.00-$230,000.00 6 months ago

Tempe, AZ $70,000.00-$110,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.