Data Pipeline Engineer II — Scale & Cloud

Compact Information Systems; United States; On-site; USD 110,000 - 140,000; Full time

Benefits offered by this job

Best-in-class benefits

Job summary

Deep Sync is seeking a Software Engineer II to join our India engineering team and help design and build large-scale data pipelines and platform services. You will own features end-to-end—from design through production support—on systems processing hundreds of millions to billions of records on fixed schedules.

You will work on cloud-native infrastructure, integrate with data vendors and cloud warehouses, and contribute to testing, instrumentation, and observability.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent practical experience.
• 2+ years of professional software engineering experience building and supporting production software.
• Strong programming ability in at least one modern language, with the judgment and adaptability to pick up others.
• Solid SQL skills, with experience across relational databases and/or cloud data warehouses.
• Experience with distributed data processing at scale (e.g., Spark) or comparable large-scale data systems.
• Hands-on experience with a major cloud platform (ideally AWS)—specifically object storage, IAM, and at least one compute service.
• Sound production habits: automated testing, version control, code review, and debugging from logs and metrics rather than guesswork.
• Bonus: Experience with EMR, infrastructure-as-code (such as Terraform), CI/CD tooling, or handling PII under contractual or regulatory constraints.

Responsibilities

• Design, develop, test, and deploy features across our data pipelines and platform services, owning them through to production.
• Implement distributed data processing jobs, along with the orchestration and configuration that drive them.
• Build services and APIs that expose pipeline data and platform capabilities to internal teams and clients.
• Integrate external systems—including data vendors, client delivery endpoints, cloud warehouses, and third-party software—and make those integrations observable and recoverable when they fail.
• Add instrumentation, alerting, and automated tests so problems surface before reaching a client.
• Contribute to infrastructure-as-code and CI/CD pipelines.
• Participate in code reviews, incident response, and knowledge sharing across the team.

Skills

Programming in modern language

SQL

Distributed data processing

Education

Bachelor’s or Master’s in Computer Science or equivalent

Tools

AWS

Terraform

CI/CD

EMR

Job description

Deep Sync is seeking a Software Engineer II to join our India engineering team and help design and build large-scale data pipelines and platform services. You will own features end-to-end—from design through production support—on systems processing hundreds of millions to billions of records on fixed schedules.

You will work on cloud-native infrastructure, integrate with data vendors and cloud warehouses, and contribute to testing, instrumentation, and observability.