Lead Data Engineer #11625

ECCO Select; Dallas (TX); Hybrid; USD 130,000 - 190,000; Full time

Job summary

ECCO Select is seeking a Data Tech Team Lead to steer design and operation of a modern data platform. You will architect data lakes and warehouses on GCP and OCI, build robust ETL/ELT pipelines, and mentor a team of data engineers and DB specialists.

You will ensure governance, security, cost optimization, and reliable delivery of data-driven insights across BI and data science functions.

Qualifications

• Eight+ years in data engineering, data warehousing, or software engineering.
• Minimum 3 years in team leadership or management.
• Strong experience with GCP data tools and OCI offerings.
• Proficient SQL and Python, and CI/CD pipelines.

Responsibilities

• Architect, implement, and maintain scalable data lakes, lakehouses, and warehouses across GCP and OCI.
• Design low-latency ETL/ELT pipelines from diverse sources.
• Mentor and lead data engineers, analytics engineers, and DB specialists.
• Enforce code quality; conduct architecture reviews for reliability and performance.
• Collaborate with dev, data science, BI, and operations teams for timely insights.
• Oversee data pipeline scheduling and overall platform operations at scale.
• Implement data testing, anomaly detection, and data lineage protocols.
• Monitor performance of databases and query engines (BigQuery, OCI).
• Enforce data governance, access control, and cataloging; meet audit needs.
• Control storage and compute costs across BigQuery, Dataproc, OCI Compute.

Skills

GCP data tools

BigQuery

Dataproc

Cloud Functions

Pub/Sub

Oracle OCI

Autonomous Data Warehouse

SQL

Python

CI/CD pipelines

GitLab CI

Data governance

Data lineage

Cost optimization

Education

Bachelor's degree in CS/Engineering

Tools

GitLab CI

OCI

Job description

Location: Dallas, TX Hybrid (3 days a week onsite)

Position Responsibilities:

We are seeking an accomplished Data Tech Team Lead to provide technical leadership and hands‑on support for the development and operation of a modern, enterprise‑scale data platform. In this multifaceted role, you will leverage your expertise in both Google Cloud Platform (GCP) and Oracle Cloud Infrastructure (OCI) to architect, implement, and oversee advanced data solutions. You will be responsible for the design and optimization of data pipelines, data lakes, data warehouses, and analytics environments to enable robust business intelligence (BI) and data science across the organization.

Key responsibilities include:

• Architecting, implementing, and maintaining scalable data lakes, lakehouses, and warehousing ecosystems across GCP and OCI.
• Designing robust, low‑latency ETL and ELT pipelines to ingest, cleanse, and transform data from diverse enterprise sources.
• Providing technical mentorship and day‑to‑day leadership for a team of data engineers, analytics engineers, and database specialists.
• Establishing and maintaining code quality standards; conducting architecture reviews to ensure the delivery of reliable, scalable, and high‑performing data solutions.
• Collaborating closely with application development, data science, business intelligence, merchandising, and supply chain teams to ensure data platforms provide timely, accurate, and actionable insights.
• Orchestrating data pipeline scheduling and supporting overall data platform operations for large‑scale data environments.
• Developing and implementing automated data testing, anomaly detection, and data lineage tracking protocols to guarantee trust and transparency in enterprise reporting.
• Monitoring and optimizing the performance of databases and query engines, utilizing advanced techniques such as BigQuery partitioning and clustering and Autonomous Data Warehouse indexing.
• Strictly enforcing data governance, access control, and security policies—including row‑and‑column‑level security and data cataloging—to meet audit and data discovery requirements.
• Analyzing and controlling storage and compute costs, with a focus on efficient management of BigQuery slots, Serverless Dataproc, OCI Compute, and related resources.
• Eight (8+) years’ experience in data engineering, data warehousing, or software engineering.
• Proven experience (3+ years) leading technical teams in a fast‑paced, dynamic environment.
• Deep, hands‑on expertise with GCP data tools and services, including BigQuery, Dataproc, Cloud Functions, Cloud Storage, and Pub/Sub.
• Strong working knowledge of Oracle Cloud Infrastructure (OCI) data offerings, including Autonomous Data Warehouse, OCI GoldenGate, Oracle Integration Cloud, and Oracle Database Cloud Services.
• Advanced proficiency in SQL and Python to support robust data extraction, transformation, and integration logic.
• Direct experience building and maintaining CI/CD pipelines with tools such as GitLab CI.
• Familiarity with delivering data solutions that support downstream business intelligence, analytics, and data science initiatives.
• Sound communication and interpersonal skills with the capability to effectively collaborate across both technical and business domains.
• Strong understanding of data governance, data cataloging, security protocols, and cost‑optimization best practices in large enterprise data environments.
• Experience with GCP Vertex AI, data lineage tools, and implementing data quality and observability practices is a plus.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related STEM discipline preferred.
• Eight or more years of experience in a data‑focused engineering role.
• Minimum three years of experience in a team leadership or management position.
• Certifications in GCP or OCI are a plus.

ECCO Select is committed to hiring and retaining a diverse workforce. Our policy is to provide equal opportunity to all people without regard to race, color, religion, national origin, ancestry, marital status, veteran status, age, disability, pregnancy, genetic information, citizenship status, sex, sexual orientation, gender identity or any other legally protected category. Veterans of our United States Uniformed Services are specifically encouraged to apply for ECCO Select opportunities.

Equal Employment Opportunity is The Law

This Organization Participates in E-Verify