Remote Real-Time Data Pipeline Engineer

Cint; New Orleans (LA); On-site; USD 95,000 - 106,000; Full time

Benefits offered by this job

Remote Work

Medical, Dental, and Vision insurance

401K with company matching

PTO, unlimited sick days

Paid maternity and paternity leave

Job summary

Cint is a global leader in research technology seeking a software engineer to build real-time data pipelines and analytics solutions. You will work on scalable data architectures, ETL processes, and on-demand data extraction, collaborating with product teams to refine requirements and deliver features that drive business insights.

In this role, you will contribute to end-to-end data processing, CI/CD, and on-call monitoring while leveraging tools like Github, SQL, REST APIs, and Jira.

Qualifications

• Master’s degree in Computer Science or closely related field.
• At least 1 year of experience as a software engineer or similar role.
• Experience with pull requests reviews and CI/CD pipeline integration.
• Experience migrating large-scale datasets securely and efficiently.
• Proficient in writing and optimizing complex SQL queries.
• Experience with Github, SQL, REST APIs, and Jira.

Responsibilities

• Develop real-time data pipelines and solve big data problems using Spark, Python/Scala, SQL, and AWS.
• Write reliable, scalable code with good documentation for millions of respondents.
• Create and maintain optimal data pipeline architecture and ETL processes.
• Participate in Agile software development and on-call rotation.
• Collaborate with Product Managers to refine requirements and design.
• Contribute to unit and integration testing, pull requests, and CI/CD."
• Assist business teams with data extracts and analysis.
• Build analytics tools leveraging data pipelines for insights on acquisition and efficiency.
• Ensure secure and efficient migration of large datasets from MSSQL to cloud warehouses.

Skills

Spark

Python/Scala

SQL

AWS

CI/CD

ETL pipelines

Data architecture

GitHub

REST APIs

Jira

Unit testing

Education

Master's degree in Computer Science

Tools

Kinesis Data Streams

Kinesis Data Analytics

SNS

GitHub

REST APIs

Jira

Job description

Cint is a global leader in research technology seeking a software engineer to build real-time data pipelines and analytics solutions. You will work on scalable data architectures, ETL processes, and on-demand data extraction, collaborating with product teams to refine requirements and deliver features that drive business insights.

In this role, you will contribute to end-to-end data processing, CI/CD, and on-call monitoring while leveraging tools like Github, SQL, REST APIs, and Jira.