Sr Lead Data Engineer - Cloud

Cox; Candler-McAfee (GA); Hybrid; USD 131,000 - 220,000; Full time

Job summary

An established industry player is seeking a Senior Lead Data Engineer to join their innovative Data Solutions Team. This role offers the chance to lead complex technology engagements and drive the architecture of cloud data solutions. You will leverage your extensive experience with cloud platforms, particularly Microsoft Azure, to deliver high-quality data solutions that meet stakeholder needs. The position emphasizes collaboration, critical thinking, and a commitment to continuous improvement in data and analytics delivery. If you are passionate about data engineering and eager to make an impact in a dynamic environment, this opportunity is perfect for you.

Benefits

Flexible vacation policy

Paid holidays

Paid wellness hours

Bereavement leave

Military leave

Parental leave

Volunteer time off

Qualifications

• 8+ years of experience as a Data Engineer with a focus on Azure.
• Strong experience in designing and implementing ETL pipelines.
• Hands-on experience with cloud platforms like AWS and Azure.

Responsibilities

• Lead cloud engineering efforts and mentor Data Engineers.
• Architect and build cloud solutions from end to end.
• Monitor and optimize data pipelines for performance.

Skills

Microsoft Azure

Python

ETL/ELT Pipelines

Cloud Solutions Architecture

Data Integration

Agile Methodologies

Data Reliability Engineering

Education

Bachelor's Degree in a related discipline

Master's Degree

Ph.D.

Tools

Azure Data Factory

Informatica

Tableau

Microsoft Power BI

Alteryx

Databricks

Job description

Job Summary

Cox Enterprises' Data Solutions Team is currently looking for a Senior Lead Data Engineer - Cloud to join our team in Atlanta, GA.

The Senior Lead Cloud Data Engineer will end-to-end responsibility for new projects, processes, standards, and the continuous improvement of data and analytics solution delivery across customer portfolios, business partners, and internal initiatives. Additionally, this position will guide data analytics resources to deliver and support solutions that exceed stakeholder needs. This role will solve unique, significant, complex problems and drive creative solutions to provide consistent and standardized data solutions.

The Senior Lead Cloud Data Engineer will have hands-on technical and functional experience with cloud platforms (i.e. Oracle, Azure, Amazon Web Services, Informatica), and functional familiarity with self-service tools (i.e. Tableau, Microsoft Power BI, Alteryx) to support stakeholder requirement. This role will have a history of independent judgment and decision-making across a large span of influence.

Job Responsibilities

Solution Architecture and Design

• Coach, mentor, and develop cloud engineering and platform skills of Data Engineer resources.
• Lead large, complex technology engagements, roadmaps and strategy requiring in-depth data evaluation and critical thinking.
• Provide expert knowledge of modern cloud data architecture patterns and solutions.
• Understand the "big picture" to assess impacts across the Business Intelligence platforms, Corporate IT solutions, and platforms in the Enterprise.
• Recommend technical design consistent with industry best-practices and Cox standards and Industry standards for cloud platforms conforming.
• Partner with Leadership, Portfolio, Enterprise Architecture, Analytics, Security, and Data Governance teams to collaborate on platform solutions and direction and analytics and reporting opportunities and priorities.
• Understand Agile software methodology and tools, encouraging an iterative mindset as the team prepares for a broad transition to agile.
• Develop an understanding of Cox Enterprises applications and their interdependencies with source applications, customers, and business processes within the areas they support.
• Identify solution architectural issues and propose alternative solutions.
• Interact and build trusted relationships with all levels of personnel, including management, from both business and technology teams.
• Know how to identify and mitigate risks and escalate potential business issues.

Data Integration Delivery

• Perform data integrations into Microsoft Fabric, including data sourcing and Fabric ETL development/set-up.
• Support data engineering for analytics products, including transformations, table views, or other needs to enable analytics products developed within lakehouse medallion architecture.
• Monitor and optimize the performance of data pipelines and storage solutions.
• Implement and enhance Data Reliability Engineering (DRE) practices.
• Help prepare Features and User Stories, functional and technical designs, test scenarios, and deployment plans related to the data platform.
• Perform gap analysis related to data processes and database table structures that populate reporting and analytics requirements.
• Construct, manage, monitor, and support data integration between multiple systems.

Qualifications- Required:

• Bachelor's degree in a related discipline and 8 years' experience in a related field. The right candidate could also have a different combination, such as a master's degree and 6 years' experience; a Ph.D. and 3 years' experience in a related field; or 20 years' experience in a related field
• Minimum of 8 years of experience as a Data Engineer, with a strong focus on Microsoft Azure.
• 5+ years of experience in Azure services (ADLS, ADF, DevOps, etc.).
• 1+ years' hands-on experience in architecting and building cloud solutions from end to end with Microsoft Azure and Fabric or Databricks platforms.
• 7+ years of Experience implementing modern cloud-based solution/platform (AWS, Azure, GCP).
• 8+ years of experience in designing and implementing ETL/ELT pipelines using ADF, integrating with other Azure services.
• 7+ years of Python development experience. Should have capability of developing own libraries.
• 4+ years of working in Spark applications (in Python/Scala) for data transformation and integration with cloud services and proficiency in PySpark
• Experience with or knowledge of Agile Software Development methodologies

Qualifications - Preferred:

• Technical Skills: Azure networking, security (RBAC, Azure AD), Infrastructure as Code, CI/CD.
• Certifications: Microsoft Certified: Azure Solutions Architect or equivalent.
• Advanced level proficiency ETL / Data Orchestration technology (i.e. Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend), data processing, ETL pipelines, and big data technologies
• Familiarity with designing and building APIs, ETL and data ingestion processes and utilization of tools to support enterprise solutions.
• Experience in performance tuning, query optimization, security, monitoring, and release management
• Experience in cloud native technologies and patterns (AWS, Google Cloud)
• Experience in driving and/or influencing the data strategy of your team or organization.
• Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).

Work Environment:

• Team agreement in place to support hybrid work environment that balances in-office with remote work to maximize collaboration and customer-centric value delivery.
• Ability to work in a "team-first" mentality where teams swarm on objectives and success is determined at the team, rather than individual level.
• Ability to work under pressure and meet deadlines within specified time constraints.
• Ability to adapt to changes in assigned work tasks, duties, and priorities in a fast-paced and dynamic work environment.

USD 131,600.00 - 219,400.00 per year

Compensation:

Compensation includes a base salary of $131,600.00 - $219,400.00. The base salary may vary within the anticipated base pay range based on factors such as the ultimate location of the position and the selected candidate's knowledge, skills, and abilities. Position may be eligible for additional compensation that may include an incentive program.

Benefits:

The Company offers eligible employees the flexibility to take as much vacation with pay as they deem consistent with their duties, the company's needs, and its obligations; seven paid holidays throughout the calendar year; and up to 160 hours of paid wellness annually for their own wellness or that of family members. Employees are also eligible for additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.