Data Engineer

Insight Global; Chattanooga (TN); Hybrid; USD 110,000 - 160,000; Full time

Job summary

Insight Global in Chattanooga, TN is seeking a Data Engineer III to help migrate and transform enterprise data into a cloud-based environment. You will design scalable data pipelines, work with Databricks and Azure, and collaborate with business stakeholders to ensure data quality during ERP modernization.

Applicants should have 5+ years in data engineering, strong SQL skills, and experience in ETL/ELT processes, data migration, and cross-functional teamwork across technical and non-technical

Qualifications

• 5+ years of data engineering experience.
• Strong SQL writing and optimization skills.
• Production Databricks experience.
• Hands-on Azure cloud services experience.
• Experience building ETL/ELT pipelines.
• Background supporting data migration initiatives.
• Experience with large cloud-based datasets.
• Strong communication and stakeholder engagement.
• Ability to work in cross-functional teams.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL.
• Support ERP-related data migration efforts.
• Extract, transform, validate, and load data between systems.
• Develop complex SQL queries for data validation and reporting.
• Build and optimize datasets in Databricks and Azure.
• Validate data accuracy with SMEs during migration.
• Participate in daily standups and sprint planning.
• Create and maintain data mappings and technical docs.
• Support reporting and BI tools like Tableau.
• Collaborate to resolve data quality and integration issues.
• Assist with user stories and delivery of reporting objects.
• Follow software engineering best practices (source control, testing).

Skills

SQL

Databricks

Azure

PySpark

ETL/ELT

Data migration

Data validation

Stakeholder comms

Cross-functional collab

Tools

Tableau

Git

Job description

Location: Hybrid in Chattanooga, TN (4 Days Onsite, 1 Day Remote)

Employment Type: Full-Time, Direct Hire

Overview

We are seeking a Data Engineer III to join a growing software engineering organization supporting a large-scale ERP modernization initiative. This individual will play a critical role in migrating and transforming enterprise data from legacy systems into a cloud-based environment while partnering closely with business stakeholders, software engineers, and subject matter experts.

The ideal candidate brings strong experience with SQL, Databricks, Azure, and PySpark, along with a collaborative approach and the ability to communicate effectively across technical and non-technical teams.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes
• Support enterprise-wide data migration efforts tied to a major ERP implementation
• Extract, transform, validate, and load data between multiple systems
• Develop complex SQL queries to support data validation, reporting, and business requirements
• Build and optimize datasets within Databricks and Azure cloud environments
• Partner with subject matter experts to validate data accuracy throughout migration efforts
• Participate in daily standups, sprint planning, and requirements discussions
• Create and maintain technical documentation and data mappings
• Support reporting and analytics initiatives through Tableau and other BI tools
• Collaborate with cross-functional teams to resolve data quality and integration issues
• Assist with development of user stories and delivery of reporting objects for business users
• Follow software engineering best practices, including source control and testing standards

Required Qualifications

• 5+ years of Data Engineering experience
• Strong expertise writing and optimizing SQL queries
• Experience working with Databricks in a production environment
• Hands-on experience with Azure cloud services
• Experience building and maintaining ETL/ELT pipelines
• Background supporting data migration or data conversion initiatives
• Experience working with large datasets in cloud environments
• Strong communication and stakeholder engagement skills
• Ability to work effectively in a collaborative, cross-functional environment

Preferred Qualifications

• Exposure to Snowflake
• Experience with MuleSoft or other integration platforms
• Experience supporting AI, machine learning, or advanced analytics initiatives
• Exposure to container technologies such as Docker or Kubernetes
• Familiarity with modern software development tools and CI/CD practices