Data Engineer

Netrolynx AI; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global is seeking a Senior Data Engineer to design, build, and scale cloud-based data systems that power analytics, ML, and AI initiatives. You will develop batch and streaming pipelines, create reusable data products, and promote data quality, governance, and reliability across teams.

You will mentor engineers, shape technical standards, and collaborate with data scientists, product, and business stakeholders to turn complex data challenges into trusted solutions in a fast-paced

Qualifications

• 5+ years of data engineering experience with production pipelines.
• Strong Python and SQL development skills.
• Experience with Google Cloud Platform and BigQuery, dbt, Airflow/Cloud Composer.
• Knowledge of data modeling, semantic layers, and reusable data products.
• Experience with structured and unstructured data from multiple sources.
• Understanding of data testing, lineage, schema management, governance, monitoring, and reliability.
• Ability to optimize cloud workloads for cost, performance, and latency.
• Excellent communication and ability to mentor teammates.

Responsibilities

• Architect, build, and maintain scalable batch and streaming data pipelines.
• Develop analytics-ready datasets for data science, reporting, AI, and operational applications.
• Create automated data validation, monitoring, alerting, retry, and recovery patterns.
• Ensure data is trustworthy, traceable, secure, and governed with security and platform teams.
• Improve BigQuery performance and cost through modeling, partitioning, clustering, and query optimization.
• Build shared libraries, templates, and engineering standards for productivity.
• Partner with data scientists to develop feature pipelines for forecasting and analytics.
• Support AI initiatives, including retrieval-augmented generation and semantic search.

Skills

Python

SQL

GCP experience

Data modeling

Data testing

Observability

Mentoring

Communication

Tools

BigQuery

dbt

Airflow/Cloud Composer

Pub/Sub

Dataflow

Job description

About The Company

Insight Global is seeking a Senior Data Engineer to help build and advance modern data capabilities. This role supports organization-wide analytics, machine learning, artificial intelligence, and operational needs by creating reliable, scalable data platforms. You will work with colleagues across engineering, data science, analytics, product, and business teams to turn complex data challenges into trusted solutions.

Insight Global is seeking a Senior Data Engineer to help build and advance modern data capabilities. This role supports organization-wide analytics, machine learning, artificial intelligence, and operational needs by creating reliable, scalable data platforms. You will work with colleagues across engineering, data science, analytics, product, and business teams to turn complex data challenges into trusted solutions.

About The Role

As a Senior Data Engineer, you will take a hands‑on role in designing, developing, and scaling cloud‑based data systems. You will build batch and streaming pipelines, create reusable data products, and establish strong practices for data quality, governance, observability, and performance. You will also help shape technical standards and mentor engineers, contributing to a collaborative environment focused on ownership, continuous learning, and thoughtful engineering.

Qualifications

• Strong professional experience in data engineering, including designing and operating production‑grade data pipelines and platforms.
• Advanced proficiency in Python and SQL, with experience developing reusable frameworks and maintainable data transformations.
• Experience with cloud data engineering, ideally on Google Cloud Platform, and technologies such as BigQuery, dbt, Airflow or Cloud Composer, Pub/Sub, and Dataflow.
• Knowledge of data modeling approaches, including layered and dimensional models, semantic layers, and reusable data products.
• Experience working with structured and unstructured data from sources such as transactional systems, APIs, applications, web events, and third parties.
• Understanding of data testing, lineage, schema management, access controls, governance, monitoring, and production reliability practices.
• Ability to optimize cloud workloads for cost, performance, scalability, and latency.
• Clear communication skills and the ability to collaborate with technical and nontechnical stakeholders, mentor teammates, and explain design decisions and trade-offs.

Responsibilities

• Architect, build, and maintain scalable batch and streaming pipelines, ingestion frameworks, and data transformations.
• Develop analytics‑ready and model‑ready datasets for data science, reporting, AI, and operational applications.
• Create automated data validation, testing, monitoring, alerting, retry, and recovery patterns to detect and resolve pipeline failures, anomalies, and schema changes.
• Ensure data is trustworthy, traceable, secure, and governed appropriately in partnership with security and platform teams.
• Improve BigQuery performance and cost through thoughtful modeling, partitioning, clustering, and query optimization.
• Build shared libraries, templates, and engineering standards that improve productivity and consistency across the team.
• Partner with data scientists to develop feature pipelines and datasets for forecasting, pricing, recommendations, and customer analytics.
• Support AI initiatives, including conversational analytics, retrieval‑augmented generation, semantic search, and other enterprise applications; evaluate tools such as BQML and vector search where they offer clear value.
• Translate evolving requirements into production solutions, participate in architecture reviews, and mentor engineers across development, testing, deployment, and documentation.

Benefits

Insight Global offers a professional environment where employees can contribute to meaningful data initiatives, collaborate across disciplines, and continue developing their technical expertise. Compensation and benefits are provided in accordance with the applicable employment arrangement and eligibility requirements. Details will be shared during the hiring process.

Equal Opportunity

Insight Global is committed to providing equal employment opportunities. Employment decisions are made without discrimination based on any protected status under applicable law. We value respectful collaboration and a workplace where people with different backgrounds and perspectives can contribute and grow.