Lead Data Engineer - Information Technology - Analysts

MassGenics, Inc.; Charlotte, Northern (NC, KY); Hybrid; USD 96,000 - 110,000; Full time

Benefits offered by this job

Medical & pharmacy coverage

Dental/vision insurance

401(k)

HSA & FSA

Life Insurance

Pet Insurance

Short/Long term Disability

Accident & Critical illness coverage

Pre‑paid legal & ID theft protection

Sick time

Paid leaves

Job summary

Innova Solutions is seeking a Lead Data Engineer for a contract role based in multiple US locations, including Charlotte, NC. You will lead the design and development of scalable data pipelines using Spark streaming, Kafka, and Flink, and help implement a lakehouse architecture with governance controls.

Ideal candidates have 10+ years in data engineering, strong cloud experience with Hadoop and Google Cloud, and hands-on expertise in Python, PySpark, Airflow and SQL.

Qualifications

• 10+ years of experience in data engineering, including hands-on Hadoop and Google Cloud data solutions.
• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming.
• Experience with Data Lakehouse architecture and design.
• Experience with Python, PySpark, Apache Kafka, Airflow, SQL, GCP Cloud Storage, BigQuery, Data Proc, Cloud Composer.
• NoSQL databases including columnar, graph, document, KV stores and related formats.

Responsibilities

• Creating/supporting Spark-based processing and Kafka streaming.
• Developing data flows using Kafka, Flink, and Spark streaming.
• Designing and implementing scalable, modular data pipelines with built-in data governance controls.

Skills

Spark

Kafka

Flink

Python

Airflow

SQL

BigQuery

NoSQL

Tools

Hadoop

Google Cloud

Data Lakehouse

Kafka

Spark Streaming

GCP Cloud Storage

Parquet/Iceberg/Delta

Data Proc

Cloud Composer

Job description

Job Description

A client of Innova Solutions is immediately hiring for a Lead Data Engineer position

Position type: Fulltime, Contract

Duration: 12 months

Location: Charlotte, NC/ Irving, TX/ Phoenix, AZ/ Columbus, OH/ Minneapolis, MN

As a Data Engineer you will be:

Day to Day Responsibilities

• Creating/supporting Spark based processing, Kafka streaming


• Developing data flows using Kafka, Flink, and Spark streaming


• Designing and implementingof highly scalable and modular data pipelines with built‑in data controls for automating data governance

Required Qualifications

• 10+ years of experience in data engineering including hands‑on experience working with Hadoop and Google Cloud data solutions.


• Hands‑on experience developing data flows using Kafka, Flink, and Spark streaming.


• Experience with Data Lakehouse architecture and design.


• Experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer.


• NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats.

Desired Qualifications

• Proven skills with data migration from on‑prem to a cloud native environment


• Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables


• Design and implementation of highly scalable and modular data pipelines with built‑in data controls for automating data governance


• Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent‑based data capabilities


• Dev Ops and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes


• Web based UI development using React and Node JS is a plus

This position is only open to applicants who can be engaged on a W‑2 basis.

PAY RANGE AND BENEFITS

Pay Range*: $70- $80 per hour

*Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.

Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre‑paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).

ABOUT INNOVA SOLUTIONS

Founded in 1998 and headquartered in Atlanta, Georgia, Innova Solutions employs approximately 50,000 professionals worldwide and reports an annual revenue approaching $3 Billion. Through our global delivery centers across North America, Asia, and Europe, we deliver strategic technology and business transformation solutions to our clients, enabling them to operate as leaders within their fields.

Recent Recognitions

• Named One of America’s Best Employers for New Grads by Forbes (2024


• Named One of the Best Companies to Work for by U.S. News & World Report (Private Companies List, 2024-2025)


• One of the Largest IT Staffing Firms in the US – Ranked #3 by Staffing Industry Analysts (SIA, 2024)


• One of the Largest Staffing Firms in the US – Ranked #13 by Staffing Industry Analysts (SIA, 2024; includes Innova Solutions, Volt, & HireGenics)


• Named One of the Top Ten Private Companies in Atlanta by the Atlanta Business Chronicle (2023)


• One of the Largest Certified Minority Business Enterprises (MBEs) in the United States (NMSDC, 2024)


• AWS Advanced Tier Services Partner with 100+ certifications

Website: https://www.innovasolutions.com/

Innova Solutions offers a referral bonus for qualified Ambassadors who refer eligible referrals. Submit referrals at https://innovasolutions.workllama.com/atsuser/anonreferafriend and earn $250-$1,000 per referral.

Innova Solutions is an Equal Opportunity Employer and prohibits any kind of unlawful discrimination and harassment. Innova Solutions is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment on the basis of race, color, religion or belief, national origin, citizenship, social or ethnic origin, sex, age, physical or mental disability, veteran status, marital status, domestic partner status, sexual orientation, or any other status protected by the statutes, rules, and regulations in the locations where it operates. If you are an individual with a disability and need a reasonable accommodation to assist with your job search or application for employment, please contact us at [e-mail] or [phone]. Please indicate the specifics of the assistance needed. Innova Solutions encourages all interested and qualified candidates to apply for employment opportunities. Innova Solutions (HireGenics/Volt) does not discriminate against applicants based on citizenship status, immigration status, or national origin, in accordance with 8 U.S.C. § 1324b.

The company will consider for employment qualified applicants with arrest and conviction records in a manner that complies with the San Francisco Fair Chance Ordinance, the Los Angeles Fair Chance Initiative for Hiring Ordinance, and other applicable laws.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Innova Solutions and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at Privacy Policy - Innovasolutions .