Senior Data Engineer

The Talent Mine; Charlotte (NC); On-site; USD 130,000 - 160,000; Full time

Benefits offered by this job

401K and Roth accounts

Educational assistance

Medical, dental, and vision benefits

Job summary

The Talent Mine is partnering with a major US steel manufacturer to hire a Senior Data Engineer for an on-site FTE role in Charlotte, NC or Irvine, TX.

The Senior Data Engineer will design, build, and optimize scalable data platforms and intelligent data workflows, enabling data-driven decision-making across the enterprise within a safety-first environment.

Qualifications

• 6+ years of experience designing and building modern data platforms and pipelines.
• 2+ years of experience providing technical leadership.
• Experience with AI/ML-driven workflows.
• Strong experience with SQL and Python.
• Hands-on experience with Databricks, Delta Lake, and Spark.
• Experience implementing ETL/ELT solutions in Azure.
• Experience with workflow orchestration tools.
• Familiarity with agentic automation concepts.
• Experience designing Data Warehouses, Data Lakes, or Lake houses.
• Experience with metadata-driven integration and data pipeline architecture.

Responsibilities

• Design, build, and maintain secure, scalable data pipelines and data products.
• Lead the development and implementation of agentic data workflows for intelligent automation.
• Collaborate with business and technical teams to translate requirements into scalable data solutions.
• Provide technical leadership and mentorship to the data engineering team.
• Oversee Data Lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native tech.
• Ensure observability, monitoring, and automated alerting for pipelines.

Education

Bachelor's degree in Computer Science/IT/related discipline

Tools

Databricks

Delta Lake

Spark

Azure

Azure DevOps

Job description

The Talent Mine is partnering with a major US steel manufacturer to hire a Senior Data Engineer for an immediate, on-site FTE role in either Charlotte, NC or Irvine, TX. This client is the nation's #1 recycler of any product, a company with unmatched job security and stable growth!

***NOTE: Our clients are NOT able to consider candidates with H1B/OPT-EAD/C2C work authorization status or visa sponsorship requirements.***

The Senior Data Engineer plays a critical role by designing, building, and optimizing scalable data platforms and intelligent data workflows to advance the client’s data and automation initiatives. This role enables high-quality, trusted data products while leveraging agentic automation frameworks and modern lake house architectures to drive efficiency and innovation.

This position combines deep technical expertise in data engineering with emerging capabilities in automated, self-orchestrating data systems. The Senior Data Engineer works closely with cross-functional teams to deliver data-driven solutions, automate complex data processes, and support real-time decision-making across the enterprise. The role requires a strong analytical mindset, attention to detail, and the ability to lead technical initiatives in a collaborative environment.

Safety is the most important part of all jobs within the organization; therefore, candidates must be able to demonstrate the ability to initiate, lead, and uphold safety policies, practices, procedures, and housekeeping standards at all times.

Responsibilities include but not limited to:

• Ensure industry best practices in data engineering, data governance, and automation are implemented and continuously improved to meet technical and business objectives.
• Design, build, and maintain secure, scalable, and reliable data pipelines and data products using modern lake house architectures (Databricks).
• Lead the development and implementation of agentic data workflows, enabling intelligent automation, orchestration, and self-healing data pipelines.
• Work closely with business and technical teams to gather requirements and translate them into scalable data and automation solutions.
• Provide technical leadership and mentorship to the data engineering team.
• Lead the design and implementation of a scalable Data Lakehouse architecture leveraging Databricks, Delta Lake, and cloud-native technologies.
• Develop reusable data frameworks and accelerators to improve engineering velocity.
• Drive the integration of AI-assisted development and automation tools.
• Collaborate on Master Data Management (MDM) and Reference Data strategies.
• Ensure observability, monitoring, and automated alerting are in place for data pipelines.

TOTAL COMPENSATION = $189,000-$238,000, broken down as follows:

• Base salary range – $130,000-$160,000
• Annual ROA of 23-33% over the past 5 years!
• Profit sharing bonus averaging 16% over the past 5 years!
• 401K and Roth accounts
• Educational assistance (up to $10K per year for you and your family members)
• Outstanding medical, dental, and vision benefits for you and your family!

Ideal candidates will bring most of the following:

• 6+ years of experience designing and building modern data platforms and pipelines
• 2+ years of experience providing technical leadership
• Experience with AI/ML-driven workflows
• Strong experience with SQL and Python
• Hands-on experience with Databricks, Delta Lake, and Spark
• Experience implementing ETL/ELT solutions in Azure
• Experience with workflow orchestration tools
• Familiarity with agentic automation concepts
• Experience designing Data Warehouses, Data Lakes, or Lake houses
• Experience with CI/CD pipelines , preferably within Azure DevOps
• Experience working within Agile frameworks
• Bachelor's degree in Computer Science/IT/related discipline, or an equivalent experience + education
• Exposure to data governance and master data management practices
• Experience with metadata-driven integration and data pipeline architecture
• Preference for cross-functional collaboration and business context

Must have supervisor and/or manager recommendation, and must be able to perform all essential functions of the job (with or without a reasonable accommodation). The client is an Equal Opportunity Employer and a drug-free workplace.