Lead Data Engineer at Abode Techzone LLC Dallas, TX
Abode Techzone LLC
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Job summary
Prodapt/ AT&T seeks a Lead Data Engineer onsite in Dallas to guide ETL, Python development, and data warehousing initiatives. You will lead a team across multiple projects, design scalable architectures, and ensure high-quality delivery in a contract, 12-month engagement.
The role requires hands-on Python and ETL/ELT expertise, strong data modeling skills, and collaboration with stakeholders to build modern cloud-native data platforms and governance practices.
Qualifications
- Extensive experience leading data engineering teams.
- Strong Python development and ETL/ELT expertise.
- Proficiency with cloud-based data platforms (Azure, AWS, or GCP).
Responsibilities
- Lead a team of ETL and Python developers across projects.
- Design and drive technical architecture and development standards.
- Mentor team members and conduct solution design workshops.
- Collaborate with architects and project managers to ensure delivery.
- Develop enterprise-scale ETL/ELT and data pipelines.
Skills
Tools
Job description
Job Description Job Description
Job Title: Lead Data Engineer
Location: Dallas, TX
Client: Prodapt/ AT&T
Project Duration: 12 months
Job Type: Contract
Work Arrangement: Onsite role – 5 days a week
Interview: In person
We are seeking a highly skilled Technical Lead – ETL & Python Development to lead the design, development, and delivery of enterprise data integration and data engineering solutions. The ideal candidate will possess strong expertise in Python, ETL development, data warehousing, cloud-based data platforms, and technical leadership. The role involves collaborating with business stakeholders, solution architects, data analysts, and engineering teams to build scalable, high-performance data pipelines and modern data solutions while mentoring development teams and driving engineering best practices.
- Lead a team of ETL and Python developers across multiple projects.
- Drive technical design, code reviews, development standards, and best practices.
- Provide technical mentoring and guidance to team members.
- Conduct solution design workshops and architecture discussions.
- Collaborate with architects and project managers to ensure successful project delivery.
- Design, develop, and maintain enterprise-scale ETL/ELT solutions.
- Build scalable and reusable data ingestion frameworks.
- Design complex data transformation and enrichment pipelines.
- Integrate data from multiple sources including databases, APIs, cloud storage, SaaS applications, and external systems.
- Ensure data quality, consistency, validation, and reconciliation.
- Develop robust and scalable Python applications for data processing and automation.
- Build reusable libraries, frameworks, and utilities.
- Develop APIs and microservices supporting data integration processes.
- Create automated data validation, monitoring, and alerting solutions.
- Optimize Python code for performance and scalability.
- Design and implement data warehouse solutions.
- Develop data models supporting reporting and analytics needs.
- Build batch and near real-time data processing pipelines.
- Support data lake and lakehouse architectures.
- Implement metadata management and data governance processes.
- Design and deploy cloud-native data solutions.
- Work with cloud services for data ingestion, storage, processing, and analytics..
- Support migration from legacy ETL platforms to modern cloud-based architectures.
- Implement Infrastructure as Code (IaC) and automation where applicable.
- Perform performance tuning for ETL jobs and Python applications.
- Identify bottlenecks and recommend optimization strategies.
- Ensure adherence to security, compliance, and governance standards.
- Lead root cause analysis and production issue resolution.
- Strong hands-on experience with:
- Python 3.x
- Pandas
- NumPy
- SQLAlchemy
- PySpark
- FastAPI / Flask
- Object-Oriented Programming (OOP)
- Experience developing production-grade Python applications.
- Strong debugging and optimization skills.
- Hands-on experience with one or more ETL platforms:
- Informatica PowerCenter
- Azure Data Factory (ADF)
- SSIS
- Talend
- DataStage
- AWS Glue
- Apache Airflow
- Matillion
- Strong understanding of:
- ETL/ELT Concepts
- Data Integration Patterns
- Data Migration
- Data Transformation
- Data Validation Frameworks
- Advanced SQL expertise and experience with:
- SQL Server
- Oracle
- PostgreSQL
- MySQL
- Snowflake
- Amazon Redshift
- Knowledge of:
- Query Optimization
- Indexing
- Partitioning
- Performance Tuning
- Hands-on experience with at least one cloud platform:
- Microsoft Azure
- Azure Data Factory
- Azure Data Lake
- Azure SQL Database
- Synapse Analytics
- Azure Functions
- AWS
- AWS Glue
- S3
- Lambda
- Redshift
- EMR
- Google Cloud (Preferred)
- BigQuery
- Dataflow
- Cloud Storage
- Preferred experience with:
- Apache Spark
- PySpark
- Hadoop Ecosystem
- Databricks
- Kafka
- Delta Lake
- Lakehouse Architecture
- Git / GitHub / GitLab
- Azure DevOps
- Jenkins
- CI/CD Pipelines
- Docker
- Kubernetes (Preferred)
- Terraform (Preferred)
- Lead a team of 5-15 data engineers and developers.
- Conduct code reviews and technical assessments.
- Drive sprint planning and technical estimations.
- Support hiring and onboarding activities.
- Establish development standards and governance practices.
- Ensure project deliverables meet quality and performance objectives.
- Bachelor's Degree in Computer Science, Engineering, Information Technology, or related discipline.
- 12 years of overall IT experience.
- 5 years of hands‑on ETL development experience.
- 4 years of Python development experience.
- 2 years of technical leadership experience.
- Strong understanding of Software Development Lifecycle (SDLC) and Agile methodologies.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
