Data Engineer- Offshore

Insight Global; Houston (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global is seeking a Senior Data Engineer to design, build, and support enterprise-scale streaming and big data pipelines across AWS, Spark, Hadoop, Kafka, and cloud-native ingestion platforms.

The role is hands-on and production-focused, emphasizing reliable real-time data movement, ingestion modernization, and distributed systems engineering in a large enterprise setting.

Qualifications

• 10+ years of experience in data engineering or related fields.
• Strong expertise with AWS cloud platform services and data engineering patterns.
• Hands-on Spark using Scala and PySpark for large-scale processing.
• Deep knowledge of the Hadoop ecosystem and distributed architectures.
• Strong experience with Kafka and streaming technologies for real-time pipelines.
• Hands-on with ingestion platforms such as Flume and Kinesis Firehose.
• Proficiency in Python, Scala, and Java.
• Understanding of enterprise data warehousing and big data architectures.

Responsibilities

• Design, build, and support enterprise-scale streaming pipelines.
• Hands-on work with Kafka, Spark, and AWS Kinesis for real-time movement.
• Modernize ingestion by migrating patterns to AWS-native services.
• Production engineering ownership with strong troubleshooting skills.
• Operate within a large-scale enterprise data environment and cross-platform integration.

Skills

AWS

Spark

PySpark

Scala

Java

Kafka

Kinesis

Hadoop

Python

Data warehousing

Tools

Flume

Kinesis Firehose

Job description

Job Description

The Senior Data Engineer / Streaming Data Engineer will design, build, and support enterprise-scale streaming and big data pipelines across AWS, Spark, Hadoop, Kafka, and cloud-native ingestion platforms. This role is hands‑on and production-focused, with responsibility for reliable real‑time data movement, ingestion modernization, distributed systems engineering, and scalable data processing in a large enterprise environment.

• Hands‑on streaming and real‑time data engineering using Kafka, Spark, AWS Kinesis, and cloud‑native data services.
• Modernization opportunity focused on moving legacy ingestion patterns to scalable AWS‑native services.
• Production engineering role requiring strong troubleshooting, operational ownership, and distributed systems depth.
• Enterprise‑scale environment with complex data warehousing, big data, and cross‑platform integration needs.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to [e-mail]. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Skills and Requirements

• 10+ years of experience in data engineering, software engineering, or related fields.
• Strong expertise with AWS cloud platform services and cloud‑native data engineering patterns.
• Hands‑on experience with Apache Spark using Scala and PySpark for large‑scale data processing.
• Deep working knowledge of the Hadoop ecosystem and distributed data processing architectures.
• Strong experience with Kafka and streaming technologies, including real‑time data pipeline design and support.
• Hands‑on experience with data ingestion platforms such as Flume, AWS Kinesis, Kinesis Firehose, or similar tooling.
• Strong programming experience in Python, Scala, and Java.
• Deep understanding of enterprise data warehousing, big data architectures, distributed systems, and large‑scale enterprise operating environments.