Lead Analyst Data Engineer

Bwpipelines; Houston (TX); On-site; USD 120,000 - 150,000; Full time

Job summary

Bwpipelines in Houston, TX, seeks a Lead Analyst Data Engineer to architect and deliver high-performance data pipelines across cloud environments. The role involves adopting modern architectures like Lakehouse and Databricks, supporting analytics and AI/ML, and mentoring data professionals.

Ideal candidates will have extensive AWS experience, strong skills in SQL and Python, and a Bachelor's degree in a relevant field. Boardwalk Pipelines promotes a drug-free workplace and equal opportunity employment.

Qualifications

• 7–10 years of experience in cloud data architecture, with 5 years in AWS environments.
• Proficiency in AWS services such as Glue, Redshift, and Athena.
• Extensive hands-on experience with Databricks.

Responsibilities

• Architect and deliver scalable data pipelines across cloud environments.
• Lead the adoption of modern data architectures and mentor junior engineers.
• Support analytics and AI/ML use cases.

Skills

Cloud data architecture

AWS services (Glue, Redshift, Athena)

Databricks

SQL (T‑SQL)

Python (PySpark/Pandas)

Power BI

Data governance (Alation)

Collaboration and leadership

Education

Bachelor’s degree in Computer Science, Data Science, Engineering, or related field

Master’s Degree

Tools

SQL Server

Oracle

PostgreSQL

Azure SQL

Teradata

Git

Visual Studio Code

SSMS

Job description

We are currently looking for a Lead Analyst Data Engineer for our Houston, TX office.

POSITION DESCRIPTION

The Lead Data Engineer is responsible for architecting and delivering scalable, high-performance data pipelines and platforms across cloud environments. This role leads the adoption of modern data architectures such as a Lakehouse and Databricks, strengthens data integration and governance, supports analytics and AI/ML use cases, and mentors data engineers and analysts to advance engineering standards and team capability.

REQUIRED SKILLS, KNOWLEDGE, AND EXPERIENCE

• 7–10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments.
• Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions.
• Extensive experience working with Databricks.
• Working knowledge of the Alation data governance tool.
• Strong skills in SQL (T‑SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL.
• Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata.
• Skilled in Power BI, Git, Visual Studio Code, SSMS.
• Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers.
• Excellent communication, collaboration, and leadership abilities.

PREFERRED SKILLS, KNOWLEDGE, AND EXPERIENCE

• AWS and Databricks certifications.
• Experience leading cloud migration and data modernization initiatives.
• Designing and implementing scalable data architectures in AWS and Databricks.
• Managing data governance, security, and compliance in complex environments.
• Mentoring junior architects and engineers.
• Working with cross‑functional teams to deliver business value through data.

REQUIRED EDUCATION

• Bachelor’s degree in Computer Science, Data Science, Engineering, or related field

PREFERRED EDUCATION

• Masters Degree

ADDITIONAL INFORMATION

Boardwalk Pipelines, LP, maintains a drug‑free workplace and will require pre‑employment drug & substance abuse testing before hiring.

Boardwalk Pipelines, LP, is an equal opportunity employer. All applicants will be considered for employment regardless of race, color, religion, age, sex, gender identity, national origin, veteran, or disability status.