GenAI Data Engineer

Insight Global; Charlotte (NC); Hybrid; USD 68,880 - 75,768; Full time

Job summary

A leading recruitment firm is seeking a Mid-Senior level professional in data analysis and development for a hybrid role in Charlotte, NC. This contract position requires extensive experience with SQL, Python, and ETL tools, as well as cloud platforms like AWS and GCP. Responsibilities include modernizing legacy data systems and designing data pipelines to support advanced analytics and Generative AI initiatives. Ideal candidates will have 7+ years in the field and a strong background in cloud technologies.

Qualifications

• 7+ years of experience in data analysis, transformation, and development.
• Strong proficiency in SQL, Python, and ETL tools.
• Experience with large-scale data and analytics applications on cloud platforms.

Responsibilities

• Modernize legacy data assets by migrating to modern cloud solutions.
• Design and develop ETL/ELT pipelines for diverse data types.
• Integrate AI/ML models into data pipelines.

Skills

Data analysis

SQL

Python

ETL tools

Cloud platforms (AWS, GCP, Snowflake)

Tools

Informatica IDMC

Docker

Kubernetes

Job description

This range is provided by Insight Global. Your actual pay will be based on your skills and experience—talk with your recruiter to learn more.

Base Pay Range

$50.00/hr - $55.00/hr

Direct message the job poster from Insight Global

NextGen AI Professional Recruiter at Insight Global

Duration: 6 Month Contract to Hire

Location: Hybrid in Charlotte, NC

Interview Process: In-person first round, virtual final

Hourly Rate Range: $50/hr-$55/hr

Required Skills & Experience:

• 7+ years of experience in data analysis, transformation, and development, with ideally 2+ years in the insurance or a related industry.
• 5+ years of strong proficiency in SQL, Python, and ETL tools such as Informatica IDMC for data integration and transformation.
• 3+ years of experience developing and deploying large-scale data and analytics applications on cloud platforms such as AWS, GCP and Snowflake.
• Experience in small or medium-scale Generative AI (GenAI) integration within data workflows or enterprise solutions.
• 3+ years of expertise in designing and optimizing data models for Data Warehouses, Data Marts, and Data Fabric, including dimensional modeling, semantic layers, metadata management, and integration for scalable, governed, and high-performance analytics.

Nice to Haves:

• 3+ years of experience in Agile methodologies, including Scrum and Kanban frameworks.
• Knowledge of data observability (metrics, tracing, logs) and monitoring frameworks.
• Exposure to metadata management (catalogs, glossary) and data lineage tools.
• Familiarity with containerization & orchestration (Docker, Kubernetes).

Job Description:

• Modernize legacy data assets by migrating and re-engineering them into modern cloud solutions (AWS, GCP, Snowflake) for scalability, security, and cost efficiency.
• Design, develop, and optimize ETL/ELT pipelines for structured and unstructured data, ensuring resilience and high performance.
• Build and manage data pipelines leveraging cloud services such as AWS Glue, EMR, Redshift; GCP BigQuery, Dataflow; and Snowflake.
• Curate and publish Data Products to support analytics, visualization, machine learning, and Generative AI use cases.
• Implement DataOps practices for automated deployments, CI/CD integration, and continuous delivery of data solutions.
• Integrate AI/ML models into data pipelines, enabling real-time scoring, feature engineering, and model retraining workflows.
• Enable Generative AI capabilities by embedding LLMs into data workflows for intelligent automation and advanced insights.
• Develop and deploy AI Agents for automated decision-making and conversational analytics.
• Lead Proof of Concepts (POCs) and pilot initiatives for emerging technologies—beyond GenAI—such as real-time streaming, AI agents, and next-gen data platforms.

Seniority Level

Mid-Senior level

Employment Type

Contract

Job Function

Insurance