Lead Data Engineer

Jobtailor; North Carolina; On-site; USD 120,000 - 160,000; Full time

Job summary

Jobtailor is seeking a senior Data Engineer to lead data integration and BI initiatives in a cloud environment. You will design scalable data pipelines, optimize large SQL workloads, and mentor junior engineers while collaborating with analytics teams to drive data-driven decisions.

Bring 10+ years of data engineering or BI experience, strong Python skills, and expertise with AWS databases. You will participate in DevOps practices and contribute to an Agile development culture.

Qualifications

• A 4-year college degree in Computer Science, Engineering, Mathematics, or related technical field or equivalent combination of education and experience.
• 10+ years of relevant work experience in data engineering, business intelligence or related field.
• Experience with a variety of database technologies and data warehouse schema design patterns.
• Hands-on experience with cloud-based databases, specifically AWS technologies.
• Advanced experience using SQL queries and optimization in large-scale datasets.
• Proficiency in Python coding.
• Experience with AI-assisted tools (e.g., GitHub Copilot, Duo) for code development and testing.
• Experience creating ETL and/or ELT jobs.
• Familiarity with DevOps methodologies and tools (e.g., Git, Artifactory).
• Familiarity with Agile software development methodologies.

Responsibilities

• Collaborate with analytics and business teams to improve data models for BI tools and data-driven decisions.
• Build scalable data integration and storage solutions aligned with governance and architectural roadmaps.
• Design, develop, test, and document data integration solutions and tests.
• Manage automated deployments using Git pipelines and version control.
• Work with teams to streamline deployment workflows and monitor pipeline reliability.
• Perform data analysis to troubleshoot issues and develop a data quality framework.
• Mentor teammates through code reviews and hands-on guidance.

Skills

Data Engineering

SQL Query Optimization

AWS Technologies

ETL/ELT

DevOps Methodologies

Python

Education

Bachelor's degree in CS/Engineering/Math or related field

Tools

Git

GitHub Copilot

Duo

Artifactory

Job description

• Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Build and implement scalable solutions that align to our data governance standards and architectural roadmap for data integrations, data storage, reporting, and analytic solutions.
• Design, develop and test data integration solutions. Write, automate and document unit/integration/functional tests.
• Manage automated deployments using Git pipelines, ensuring code changes are efficiently version-controlled and deployed.
• Collaborate with multiple teams to streamline deployment workflows, monitor and troubleshoot pipelines for reliability and performance.
• Perform data analysis required to troubleshoot data-related issues by building a data quality framework and assist in the resolution of data issues.
• Serve as tech lead by mentoring less experienced members of the team through code reviews, pair programming and similar hands‑on interactions.

Requirements

• Education*: 4-year college degree in Computer Science, Engineering, Mathematics, or related technical field or equivalent combination of education and experience.
• 10 years of relevant work experience in data engineering, business intelligence or related field.
• Current hands‑on experience with a variety of database technologies and data warehouse schema design patterns.
• Current hands‑on experience with cloud‑based databases, specifically AWS technologies.
• Advanced experience using SQL queries as well as writing and optimizing SQL queries in a business environment with large‑scale, complex datasets.
• Proficiency in Python coding.
• Experience with AI‑assisted tools (e.g., GitHub Copilot, Duo) for code development, testing, and documentation across the SDLC.
• Experience creating ETL and/or ELT jobs.
• Familiarity with DevOps methodologies and tools (e.g., Git, Artifactory, etc.).
• Familiarity with Agile software development methodologies.

Core Competencies

Demonstrates expertise in data engineering and business intelligence, with a strong focus on data integration, cloud‑based databases, and SQL optimization. Proven ability to lead teams, mentor peers, and implement scalable solutions aligned with data governance standards.

Highest-signal resume keywords

• Data Engineering
• SQL Query Optimization
• AWS Technologies
• ETL/ELT Job Creation
• DevOps Methodologies

ATS Optimization Keywords

Hard Skills

• Data Integration Solutions
• SQL
• Python
• Data Warehouse Schema Design
• Data Quality Framework

Soft Skills

• Mentoring
• Collaboration
• Troubleshooting

Industry Keywords

• Business Intelligence
• Data Governance
• Agile Methodologies
• Automated Deployments

Tools & Technologies

• Git
• GitHub Copilot
• Duo
• Artifactory