Senior Data Engineer: Scalable Cloud Data Pipelines

Netrolynx AI; United States; On-site; USD 140,000 - 190,000; Full time

Job summary

Insight Global is seeking a Senior Data Engineer to design, build, and scale cloud-based data systems that power analytics, ML, and AI initiatives. You will develop batch and streaming pipelines, create reusable data products, and promote data quality, governance, and reliability across teams.

You will mentor engineers, shape technical standards, and collaborate with data scientists, product, and business stakeholders to turn complex data challenges into trusted solutions in a fast-paced

Qualifications

• 5+ years of data engineering experience with production pipelines.
• Strong Python and SQL development skills.
• Experience with Google Cloud Platform and BigQuery, dbt, Airflow/Cloud Composer.
• Knowledge of data modeling, semantic layers, and reusable data products.
• Experience with structured and unstructured data from multiple sources.
• Understanding of data testing, lineage, schema management, governance, monitoring, and reliability.
• Ability to optimize cloud workloads for cost, performance, and latency.
• Excellent communication and ability to mentor teammates.

Responsibilities

• Architect, build, and maintain scalable batch and streaming data pipelines.
• Develop analytics-ready datasets for data science, reporting, AI, and operational applications.
• Create automated data validation, monitoring, alerting, retry, and recovery patterns.
• Ensure data is trustworthy, traceable, secure, and governed with security and platform teams.
• Improve BigQuery performance and cost through modeling, partitioning, clustering, and query optimization.
• Build shared libraries, templates, and engineering standards for productivity.
• Partner with data scientists to develop feature pipelines for forecasting and analytics.
• Support AI initiatives, including retrieval-augmented generation and semantic search.

Skills

Python

SQL

GCP experience

Data modeling

Data testing

Observability

Mentoring

Communication

Tools

BigQuery

dbt

Airflow/Cloud Composer

Pub/Sub

Dataflow

Job description

Insight Global is seeking a Senior Data Engineer to design, build, and scale cloud-based data systems that power analytics, ML, and AI initiatives. You will develop batch and streaming pipelines, create reusable data products, and promote data quality, governance, and reliability across teams.

You will mentor engineers, shape technical standards, and collaborate with data scientists, product, and business stakeholders to turn complex data challenges into trusted solutions in a fast-paced