Lead AWS Data Engineer

3Core Systems, Inc; Miami, Northern (FL, KY); Hybrid; USD 130,000 - 170,000; Full time

Job summary

3Core Systems, Inc is seeking a Lead Data Engineer to oversee the data engineering team, guide data initiatives, and collaborate with stakeholders to deliver scalable data solutions. Hybrid role across Miami, FL or Irving, TX.

The candidate will drive architectural decisions, establish standards, and manage data pipelines, modeling, and governance while mentoring junior engineers. A strong leadership background and cloud expertise are essential for success.

Qualifications

• 7–10 years of data engineering experience with leadership and project management.
• Experience with cloud data platforms (AWS) and big data ecosystems.
• Proficient in Python and Java/Scala.
• Knowledge of data governance, MDM, and metadata management.

Responsibilities

• Lead and manage the data engineering team, planning resources and performance.
• Develop and enforce data standards and best practices.
• Translate business needs into technical requirements with stakeholders.
• Ensure scalable, secure data solutions aligned with goals.
• Drive adoption of new data technologies and methodologies.
• Oversee data documentation like architecture diagrams and specs.
• Manage technical debt and modernize legacy systems.
• Provide technical leadership in resolving complex data issues.

Skills

Data leadership

Data pipelines

AWS cloud

Big data

Python

Java/Scala

Data governance

Education

BSc/MSc in CS/IT

Tools

Apache Airflow

Apache NiFi

AWS Glue

Snowflake

dbt

Prefect

S3

Kafka

Job description

Miami, United States | Posted on 09/10/2026

Location: Miami, Florida or Irving, Texas (Hybrid)

Duration: Contract to Hire

A Career that Empowers You to Build Your Future

The Lead Data Engineer is responsible for overseeing the data engineering teamand driving the strategic direction of data initiatives. The role involvesmanaging projects, ensuring the scalability of data solutions, andcollaborating with stakeholders to meet organizational goals.

Your Responsibilities on the Team

• Leadand manage the data engineering team, including project planning, resourceallocation, and performance management.
• Developand enforce data engineering standards, processes, and best practices,ensuring consistency and quality across all data projects.
• Collaboratewith stakeholders, including business leaders, data scientists, and ITteams, to understand and prioritize data-related business needs andtranslate them into actionable technical requirements.
• Ensuredata solutions are scalable, secure, and aligned with the long-term goalsof the organization, considering both current and future data needs.
• Drivethe adoption of new technologies, tools, and methodologies that improvethe efficiency, reliability, and scalability of data engineeringpractices.
• Overseethe development and maintenance of comprehensive data documentation,including data architecture diagrams, process flows, and technicalspecifications.
• Managethe team's technical debt, ensuring that legacy systems are modernized andthat new solutions are built with maintainability and scalability in mind.
• Providetechnical leadership in the resolution of complex data issues, guiding theteam in troubleshooting and problem-solving efforts

Knowledge

• Extensiveexperience with data pipeline orchestration tools (e.g., Apache Airflow,Luigi) and data integration platforms (e.g., Apache NiFi, Glue).
• Strongleadership and project management skills, with experience leadingcross-functional teams and managing multiple projects simultaneously.
• Expertisein cloud data platforms (AWS) and big data ecosystems, with a focus onoptimizing cost, performance, and scalability.
• Proficientin advanced data modeling, including the design of enterprise datawarehouses, data lakes, and data marts.
• In-depthknowledge of data governance practices, including data cataloging, datalineage, and data quality management.
• Experiencewith enterprise data management frameworks, such as Master Data Management(MDM) and metadata management.
• Advancedskills in programming and scripting languages (e.g., Python, Java, Scala)for developing and automating data workflows.
• Experiencewith real-time data processing and event-driven architectures, leveragingtools such as Apache Kafka, Spark Streaming, and AWS Lambda.

Your Toolbox

• Bachelor'sor Master's degree in Computer Science, Information Technology, or arelated field.
• 7-10years of experience in data engineering, with significant leadership andproject management experience.
• SQL,Python, Java
• Exceptionalability to influence and engage senior leaders with data-driven insights.
• Expertin resolving complex, high-stakes problems with innovative solutions.
• Leadswith a collaborative spirit, driving team success through shared goals.
• Setsthe standard for integrity within the organization, fostering a culture oftrust and ethical behavior.
• Demonstratesunwavering resilience in the face of adversity, guiding the team throughchallenges.
• Actsas a change agent, leading transformative initiatives that drive businesssuccess.
• Leadsand coordinates efforts across multiple departments, ensuring alignmentwith organizational goals.
• Providesvisionary leadership, inspiring and developing future leaders within theorganization.
• Establishesa culture of accountability, ensuring that all team members meet theircommitments and deliver high-quality work.

Skill set

7-10 years of experience in data engineering, with significant leadership and project management experience.AWS, Snowflake, AzureAWS Glue, AWS AppFlow, Prefect, dbt, S3, QlikSQL, Python, Java