Lead AWS Data Engineer
INSPYR Solutions
Get more replies from employers
Send a job-specific resume in minutes.
Benefits offered by this job
Job summary
Qualifications
- At least 8 years of hands-on data engineering experience or equivalent.
- Strong experience with AWS data services and open table formats.
- Experience in orchestrating data pipelines using Airflow.
Responsibilities
- Design and operate end-to-end production-grade data pipelines.
- Re-engineer ETL processes into a lakehouse architecture.
- Develop pipelines using Python, PySpark, and Spark on AWS.
Skills
Education
Tools
Job description
Title: Lead Data Engineer (AWS Lakehouse)
Location: Dallas, TX or Houston, TX (hybrid)
Duration: Direct Hire
Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S.
We’re hiring a hands-on Lead Data Engineer to help modernize an enterprise data platform from legacy, on-prem systems to a cloud-native AWS lakehouse. This is a lead individual contributor role with high ownership and a strong hands-on focus (approximately 70%), balancing deep technical delivery with design guidance, code reviews, and mentorship.
While we leverage AWS S3 Tables (managed Apache Iceberg), success in this role requires a solid understanding of how modern table formats operate under the hood, beyond reliance on fully managed tooling.
This position will offer flexibility for hybrid work schedules to include both in-office presence and telecommute/virtual work, to be based from either Houston or Dallas, TX.
- Design, build, and operate end-to-end, production-grade data pipelines in AWS
- Re-engineer legacy ETL into a lakehouse architecture (Bronze/Silver/Gold) on S3
- Work hands-on with open table formats in AWS (S3 Tables / Apache Iceberg) and understand their metadata, snapshots, schema evolution, and performance characteristics
- Develop pipelines using Python, PySpark, and Spark on AWS Glue and/or EMR
- Orchestrate workloads using Airflow or AWS Step Functions
- Partner with data architects to translate business requirements into data products
- Perform code reviews, mentor engineers, and contribute hands-on in production
- Support agile development practices, including planning, demos, and reviews
- BA/BS in Computer Science, Engineering, or a related field plus at least 8 years of hands-on data engineering experience, or demonstrated equivalent experience and education
- Strong, current hands-on experience with AWS data services, including S3 and Spark-based processing
- Hands-on experience with an open table format (such as Apache Iceberg, Delta Lake, or Hudi), with a clear understanding of table metadata, schema evolution, partitioning, and performance tradeoffs
- Proficiency in Python and PySpark for production data pipelines
- Experience designing, building, and operating data pipelines end-to-end in AWS
- Experience orchestrating data pipelines using Airflow or AWS Step Functions
- Strong communication skills and ability to operate as a hands-on technical lead
- Master\'s degree in a relevant field
- Experience working with AWS S3 Tables or native Apache Iceberg in AWS environments
- Experience modernizing on-prem or legacy data warehouse platforms
- Familiarity with lakehouse performance tuning, schema evolution, and partitioning
- Experience with data pipeline orchestration frameworks
- Exposure to AI/ML data readiness or downstream analytics use cases
- Experience working in large, complex enterprise environments
- Leadership Impact: Shape the direction of our enterprise data platform and mentor the next generation of data engineers
- Enterprise Reach: Work with diverse, large-scale datasets from critical business systems.
- Modern Tech Stack: AWS-first environment with continuous improvement and best-practice adoption.
- Career Growth: Opportunities to advance into architecture or senior leadership roles.
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients\' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities.
Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions’ Privacy Policy and INSPYR Solutions’ AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
