Remote Real-Time Data Integration Engineer

Insight Global; Edina (MN); Remote; USD 115,000 - 130,000; Full time

Benefits offered by this job

Full benefits

401k matching

PTO

Job summary

Insight Global is seeking two Remote Integration Engineers to design and maintain real-time data pipelines linking Salesforce, Confluent Kafka, and Snowflake. You will build microservices, implement pub/sub messaging, and ensure seamless data delivery across platforms with CDC workflows.

The role involves extracting data from Salesforce, transforming it with backend logic and SQL, publishing to Kafka topics, and monitoring connectors.

Qualifications

• Strong experience with Confluent Kafka and pub/sub messaging architecture, including topics, producers/consumers, Schema Registry, and Kafka Connect.
• Proficiency in microservices design and distributed systems.
• Experience integrating data from Salesforce or similar CRM platforms.
• Strong experience with Snowflake for data pipelines, querying, and transformations.
• Solid understanding of Change Data Capture (CDC) and real-time data sync.
• Ability to write and optimize SQL queries for backend data transformation.
• Familiarity with Kafka topics, connectors, and troubleshooting lag or failures.
• Experience developing and maintaining APIs using Java (preferred) or Python/Node.
• Experience working in data engineering or application integration environments.
• Proven ability to collaborate across teams and explain integration processes clearly.
• Familiarity with event-driven architecture and service-oriented design.
• Exposure to HR systems or billing platforms.
• Knowledge of containerized services (e.g., Docker, Kubernetes).
• Experience with CI/CD pipelines (Azure DevOps or similar).

Responsibilities

• Build and maintain real-time data pipelines between Salesforce, Confluent Kafka, and Snowflake.
• Design microservices and implement pub/sub messaging.
• Extract data from Salesforce, transform with backend logic and SQL, publish to Kafka.
• Monitor Kafka connectors, troubleshoot failures, and implement CDC workflows.
• Ensure reliable data flow into Snowflake environments.

Skills

Confluent Kafka

Microservices design

Salesforce integration

Snowflake data pipelines

Change Data Capture (CDC)

SQL queries

API development (Java/Python/Node)

Event-driven architecture

Cross-team collaboration

HR systems / Billing platforms

Docker/Kubernetes

CI/CD (Azure DevOps)

Tools

Docker

Kubernetes

Kafka Connect

Azure DevOps

Job description

Insight Global is seeking two Remote Integration Engineers to design and maintain real-time data pipelines linking Salesforce, Confluent Kafka, and Snowflake. You will build microservices, implement pub/sub messaging, and ensure seamless data delivery across platforms with CDC workflows.

The role involves extracting data from Salesforce, transforming it with backend logic and SQL, publishing to Kafka topics, and monitoring connectors.