Lead Analyst Data Engineer

Texas Gas Transmission; Houston (TX); Sur place; USD 140 000 - 190 000; Plein temps

Résumé du poste

Boardwalk Pipelines, LP seeks a Lead Data Engineer to architect scalable data pipelines across cloud environments, driving Databricks and Lakehouse adoption in Houston. You will guide data integration, governance and analytics initiatives while mentoring engineers to raise team standards.

Required: 7–10 years in cloud data architecture with 5+ years AWS, plus strong SQL/Python and leadership abilities. This role emphasizes collaboration and delivering business value through data.

Qualifications

• 7–10 years of experience in cloud data architecture; at least 5 years in AWS.
• Proficiency with AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
• Extensive experience with Databricks; strong data governance tooling (Alation).
• Strong SQL (T-SQL/PL-SQL) and Python (PySpark/Pandas) skills; knowledge of DAX and M.
• Experience with SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
• Proficiency with Power BI, Git, VS Code, SSMS.
• Familiarity with Medallion architecture, data mesh, Lakehouse concepts.
• Excellent communication, collaboration, and leadership abilities.

Responsabilités

• Architect and deliver scalable data pipelines and platforms in cloud environments.
• Lead the adoption of Lakehouse and Databricks architectures.
• Strengthen data integration, governance, and security across systems.
• Support analytics and AI/ML use cases; mentor engineers and analysts.
• Collaborate across teams to drive business value through data.

Connaissances

Cloud data architecture

Leadership

Communication

Mentoring

Data governance

Collaboration

Analytics/ML

SQL

Python

Formation

Bachelor’s degree in CS/DS/Engineering

Masters degree (preferred)

Outils

Databricks

AWS

Alation

SQL Server

Oracle

PostgreSQL

Azure SQL

SSMS

Git

Visual Studio Code

Power BI

Description du poste

*To access Dayforce at its best, log in from the latest version of Chrome, Safari, Firefox, or Edge. *

Boardwalk is a limited partnership operating in the midstream portion of the natural gas and natural gas liquids industry, providing transportation and storage services for our customers. Our 14,000 miles of pipeline and storage assets provide diverse market connectivity to producers and end-users who need reliable sources of natural gas for power generation, home heating or petrochemical feedstocks. We have the experience, knowledge, and flexibility to design service offerings and create system enhancements tailored to our customers’ needs throughout the 13 states in which we operate. As an organization focused on sustainability, we are committed to protecting the environment while delivering this energy source. This commitment is made to our customers, employees, and the communities in which we operate. We incorporate environmental stewardship, safety, and compliance into our day-to-day operations and seek to strengthen and support the communities we serve. Additional information about the company can be found online at www.bwpipelines.com.

We are currently looking for a Lead Analyst Data Engineer for our Houston, TX office.

Position Description

The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability.

Required Skills, Knowledge, And Experience

• 7-10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
• Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
• Extensive experience working with Databricks.
• Working knowledge of the Alation data governance tool.
• Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
• Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
• Skilled in Power BI, Git, Visual Studio Code, SSMS.
• Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
• Excellent communication, collaboration, and leadership abilities.

Preferred Skills, Knowledge, And Experience

• AWS and Databricks certifications.
• Experience leading cloud migration and data modernization initiatives.
• Designing and implementing scalable data architectures in AWS and Databricks.
• Managing data governance, security, and compliance in complex environments.
• Mentoring junior architects and engineers.
• Working with cross-functional teams to deliver business value through data.

Required Education

• Bachelor’s degree in Computer Science, Data Science, Engineering, or related field

Preferred Education

• Masters Degree

Additional Information

Boardwalk Pipelines, LP, maintains a drug-free workplace and will require pre-employment drug & substance abuse testing before hiring.

Boardwalk Pipelines, LP, is an equal opportunity employer. All applicants will be considered for employment regardless of race, color, religion, age, sex, gender identity, national origin, veteran, or disability status.