Lead Data Engineer

ECCO Select; Fort Worth, Arlington, Dallas (TX, TX, TX); Hybrid; USD 140,000 - 190,000; Full time

Job summary

ECCO Select is seeking a Lead Data Engineer to design, build, and maintain robust data pipelines and the Snowflake platform on AWS. You will collaborate with analysts, BI developers, and app engineers to ensure well-modeled, trustworthy data supporting analytics and BI needs.

You will lead data modeling, ETL/ELT processes, and data governance while optimizing performance, security, and cost. Hybrid work with on-site days in Dallas or Atlanta is supported.

Qualifications

• 8+ years of hands-on data engineering experience, with at least 2 years in technical leadership.
• Deep expertise with Snowflake data modeling, SQL development, and performance tuning.
• Extensive experience with AWS data services in production environments.
• Strong knowledge of dimensional modeling and ELT best practices.
• Proficiency with .NET-based data integrations and CI/CD workflows.
• Experience with Git and collaboration across diverse teams.
• Bachelor’s degree in Computer Science, Engineering, or related field.

Responsibilities

• Design, build, and maintain data pipelines and the Snowflake platform on AWS.
• Collaborate with analysts, BI developers, app engineers, and business stakeholders.
• Develop batch and near real-time data pipelines on AWS services (S3, Glue, Lambda, Step Functions).
• Model Snowflake data across raw, staging, and reporting layers for analytics.
• Load and transform data in Snowflake with Snowpipe, Streams, and Tasks.
• Integrate data from internal apps, SaaS, and third-party sources via APIs and file feeds.
• Tune Snowflake performance, manage warehouses, and monitor usage.
• Build data quality checks, monitoring, and alerting for pipeline reliability.
• Apply data security and governance practices, including RBAC and data masking.
• Work with .NET teams to source data and ensure data reliability; document data flows and pipeline processes.

Skills

Leadership

Communication

Cross-functional collaboration

Problem solving

Education

Bachelor’s degree in Computer Science or related field

Tools

Snowflake

SQL

AWS (S3, Glue, Lambda, Step Functions)

Snowpipe / Streams / Tasks

Git

CI/CD

Terraform / CloudFormation

Power BI / Tableau

Job description

ECCO Select is a talent acquisition and consulting company specializing in people, process and technology solutions. We provide the talent behind the technology enabling our clients to achieve their goals. For more information about ECCO Select, visit us at www.eccoselect.com.

Position Title: Lead Data Engineer

Location Information

Hybrid – 2-3 days onsite in Atlanta, GA or Dallas, TX

Position Responsibilities:

As a Lead Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and the Snowflake data platform on AWS. You will collaborate with cross-functional teams—including data analysts, BI developers, application engineers, and business stakeholders to ensure the delivery of well-modeled, trustworthy data that serves analytics, reporting, and business intelligence needs. Your combined hands-on technical expertise and leadership will ensure that data assets are reliable, performant, and secure.

Key responsibilities include:

• Designing and building batch and near-real-time data pipelines on AWS using services such as S3, Glue, Lambda, and Step Functions.
• Developing and maintaining Snowflake data models—across raw, staging, and reporting layers—to support analytics and reporting.
• Loading and transforming data in Snowflake, utilizing Snowpipe, Streams and Tasks, and external stages for automation and efficiency.
• Integrating data from internal applications, SaaS platforms, and third-party sources through APIs and file-based feeds.
• Performing Snowflake performance tuning/cost optimization by managing warehouse sizing, query optimization, and usage monitoring.
• Building data quality checks, monitoring systems, and alerting mechanisms to proactively identify and resolve data pipeline failures and issues.
• Applying data security and governance best practices, including role-based access controls and data masking for compliance and confidentiality.
• Collaborating with application teams working on .NET-based systems to source data, implement integrations, and ensure data reliability.
• Documenting data flows, data models, and pipeline processes, and participating in code reviews for continuous improvement.

To excel in this role, you will need the following expertise and qualities:

• 8+ years of hands-on data engineering experience, with a minimum of 2 years in a technical lead or supervisory capacity.
• Extensive experience with Snowflake, including end-to-end data modeling, SQL development, and performance optimization/tuning.
• Demonstrated experience with AWS data services, specifically S3, Glue, Lambda, and Step Functions, in a production environment.
• Advanced SQL expertise and a strong understanding of data warehousing fundamentals, such as dimensional modeling and ELT best practices.
• Working proficiency with C#/.NET, including reading, supporting, or building data integrations with .NET-based applications.
• Familiarity with Git for version control and best practices in continuous integration/continuous deployment (CI/CD).
• Excellent communication skills and an ability to work collaboratively across diverse technology and business teams.
• Bachelor’s degree in Computer Science, Engineering, or a related technology field—or equivalent professional experience.

Qualifications:

• Experience with dbt, Python, or Airflow preferred.
• Familiarity with infrastructure-as-code practices using Terraform or CloudFormation is a plus.
• Exposure to reporting and BI tools such as Power BI, Tableau, or others that integrate with Snowflake.
• Background in events, hospitality, or customer engagement data is an advantage.
• Relevant technical certifications—such as SnowPro Core or AWS Data Engineer (Associate)—are desirable.

ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities.

Equal Employment Opportunity is The Law

This Organization Participates in E-Verify