Lead AWS Data Engineer

JobCubby; Miami, Northern (FL, KY); Hybrid; USD 140,000 - 200,000; Full time

Job summary

JobCubby is seeking a Lead AWS Data Engineer to head the data engineering team in a hybrid role based in Miami, FL, or Irving, TX. The position focuses on strategic data initiatives, scalable architectures, and actionable technical requirements across stakeholders.

The ideal candidate has 7–10 years in data engineering with highly developed leadership and PM skills, extensive AWS experience, and strong programming capabilities in Python, Java, or Scala.

Qualifications

• 7–10 years of data engineering experience with strong leadership and project management.
• Proficiency in AWS, data pipeline orchestration, and programming languages like Python, Java, or Scala.
• Experience with data governance, data modeling, and scalable data architectures.

Responsibilities

• Lead and manage the data engineering team, including project planning, resource allocation, and performance management.
• Develop and enforce data engineering standards, processes, and best practices for data projects.
• Collaborate with business leaders, data scientists, and IT to translate data needs into technical requirements.
• Ensure data solutions are scalable, secure, and aligned with long-term organizational goals.
• Drive adoption of new technologies and methodologies to improve efficiency and reliability.
• Oversee data documentation, architecture diagrams, and technical specifications.
• Manage technical debt and modernize legacy systems for maintainability and scalability.

Skills

Leadership & PM

Data engineering

AWS

Python/Java/Scala

Real-time processing

Education

Bachelor's or Master's in CS/IT

Tools

Apache Airflow

Apache NiFi

AWS Glue

Prefect

dbt

S3

Kafka

Spark

Snowflake

Azure

AWS AppFlow

Job description

to apply - email only, no card. You can also save this posting or score it againstyour profile with AI.## About the roleThe Lead Data Engineer will manage the data engineering team, oversee project planning, and drive the strategic direction of data initiatives. They are responsible for developing data standards, ensuring scalability, and collaborating with stakeholders to translate business needs into technical requirements.## RequirementsCandidates must have 7-10 years of experience in data engineering with strong leadership and project management skills. Proficiency in AWS, data pipeline orchestration, and advanced programming languages like Python, Java, or Scala is required.## Full descriptionJob Title: Lead AWS Data EngineerLocation: Miami, Florida or Irving, Texas (Hybrid)Duration: Contract to HireA Career that Empowers You to Build Your Future The Lead Data Engineer is responsible for overseeing the data engineering team and driving the strategic direction of data initiatives. The role involves managing projects, ensuring the scalability of data solutions, and collaborating with stakeholders to meet organizational goals.Your Responsibilities on the Team* Leadand manage the data engineering team, including project planning, resource allocation, and performance management.* Developand enforce data engineering standards, processes, and best practices, ensuring consistency and quality across all data projects.* Collaboratewith stakeholders, including business leaders, data scientists, and IT teams, to understand and prioritize data-related business needs and translate them into actionable technical requirements.* Ensuredata solutions are scalable, secure, and aligned with the long-term goals of the organization, considering both current and future data needs.* Drivethe adoption of new technologies, tools, and methodologies that improve the efficiency, reliability, and scalability of data engineering practices.* Overseethe development and maintenance of comprehensive data documentation, including data architecture diagrams, process flows, and technical specifications.* Managethe team's technical debt, ensuring that legacy systems are modernized and that new solutions are built with maintainability and scalability in mind.* Providetechnical leadership in the resolution of complex data issues, guiding the team in troubleshooting and problem-solving effortsKnowledge* Extensiveexperience with data pipeline orchestration tools (e.g., Apache Airflow, Luigi) and data integration platforms (e.g., Apache NiFi, Glue).* Strongleadership and project management skills, with experience leading cross-functional teams and managing multiple projects simultaneously.* Expertisein cloud data platforms (AWS) and big data ecosystems, with a focus on optimizing cost, performance, and scalability.* Proficientin advanced data modeling, including the design of enterprise data warehouses, data lakes, and data marts.* In-depthknowledge of data governance practices, including data cataloging, data lineage, and data quality management.* Experiencewith enterprise data management frameworks, such as Master Data Management (MDM) and metadata management.* Advancedskills in programming and scripting languages (e.g., Python, Java, Scala) for developing and automating data workflows.* Experiencewith real-time data processing and event-driven architectures, leveraging tools such as Apache Kafka, Spark Streaming, and AWS Lambda.Your Toolbox* Bachelor'sor Master's degree in Computer Science, Information Technology, or a related field.* 7-10years of experience in data engineering, with significant leadership and project management experience.* AWS,Snowflake, Azure* AWSGlue, AWS AppFlow, Prefect, dbt, S3, Qlik* SQL,Python, Java* Exceptionalability to influence and engage senior leaders with data-driven insights.* Expertin resolving complex, high-stakes problems with innovative solutions.* Leadswith a collaborative spirit, driving team success through shared goals.* Setsthe standard for integrity within the organization, fostering a culture of trust and ethical behavior.* Demonstratesunwavering resilience in the face of adversity, guiding the team through challenges.* Actsas a change agent, leading transformative initiatives that drive business success.* Leadsand coordinates efforts across multiple departments, ensuring alignment with organizational goals.* Providesvisionary leadership, inspiring and developing future leaders within the organization.* Establishesa culture of accountability, ensuring that all team members meet their commitments and deliver high-quality work.