Software Engineer – Data Platform

Jobtailor; Chennai District; On-site; INR 2,500,000 - 3,800,000; Full time

Job summary

Jobtailor in India is seeking a senior software engineer to design and implement IT solutions using Agile, with a focus on scalable data pipelines and cloud infrastructure.

You will work on GCP Dataflow, Apache Beam, Pub/Sub, BigQuery, and build secure RESTful APIs with Java/Spring Boot while creating responsive Angular interfaces.

The role includes mentoring peers, data migration leadership, and integrating end-to-end systems with CI/CD practices in a fast-paced environment.

Qualifications

• Bachelor's degree required; 5–8 years in software development.
• Experience in large, complex application development and integration.
• Experience with Terraform scripting for IaC.
• Hands-on GCP Dataflow and Apache Beam experience.
• Proficiency with core GCP services (Pub/Sub, BigQuery, Cloud Storage, Cloud IAM).
• Strong backend with Java 17+ and Spring Boot ecosystem.
• RESTful API design and documentation.
• Angular frontend development and API integration.
• Strong SQL / relational database skills.
• Git, build tools, and CI/CD pipelines.
• Vector store ingestion & real-time streaming for agents.
• Declarative pipeline specification.

Responsibilities

• Develop and integrate IT solutions using agile methods considering architecture and security.
• Plan integrations for Webservices, APIs, ETLs.
• Prepare production builds and verify releases.
• Lead data migration/conversion activities.
• Design and optimize data pipelines with Apache Beam on GCP.
• Architect and maintain GCP infrastructure (Pub/Sub, BigQuery, Cloud Storage, IAM).
• Develop RESTful APIs with Java/Spring Boot.
• Build responsive Angular dashboards for admin use.
• Integrate frontend with backend services securely.
• Design SQL schemas and optimize queries.
• Participate in DevOps, CI/CD pipelines and code reviews.
• Develop data ingestion pipelines for AI agents and real-time grounding.
• Mentor other developers.

Skills

Agile/Scrum

Data pipeline design

GCP (Dataflow, Pub/Sub, BigQuery)

Java & Spring Boot

Angular (TypeScript)

RESTful APIs

CI/CD

SQL & relational DB design

Terraform IaC

Mentoring / leadership

Education

Bachelor's degree in Information Systems/CS/Engineering

Tools

Git

Maven/Gradle

npm

Google Cloud Build

Tekton

Apache Beam

Cloud IAM

Job description

Responsibilities

• Development and integration of IT solutions using agile methodology considering architecture patterns, critical performance characteristics, security measures and customer requirements.
• Integration planning and integration deliverables (Webservices, API, ETLs, etc.)
• Prepare and stage production builds and verify production releases that meet technical and business expectations
• Lead data migration/conversion activities
• Data Pipeline Development: Design, develop, and optimize scalable batch and stream data processing pipelines (Dataflows) using Apache Beam and Google Cloud Dataflow.
• GCP Infrastructure: Architect, configure, and maintain cloud solutions utilizing core GCP services (including Pub/Sub, Big Query, Cloud Storage, and Cloud IAM).
• Backend API Development: Design, build, and maintain secure, high-performance RESTful APIs and microservices using Java and the Spring Boot framework.
• Frontend Screen Development: Create responsive, user-friendly frontend screens and dashboards using Angular (TypeScript, HTML5, CSS) to visualize data and provide administrative interfaces.
• Full-Stack Integration: Seamlessly integrate frontend Angular components with backend Spring Boot REST APIs to ensure secure and efficient end-to-end functionality.
• Database Management: Design schemas, write optimized SQL queries, and manage relational database systems (e.g., PostgreSQL, MySQL, Cloud SQL).
• Collaboration & DevOps: Participate in Agile/Scrum ceremonies, perform code reviews, and configure CI/CD pipelines to support automated testing and deployment.
• Builds pipelines delivering fresh, accurate, and correctly formatted data to AI agents and models.
• Manages vector store ingestion pipelines — the knowledge bases grounding agent decisions in real data.
• Architects real-time streaming pipelines for agents requiring live information.
• Providing technical leadership and mentoring to other developers.

Requirements

• Bachelor's degree in Information Systems, Computer Science/Engineering, or related field and a minimum of 5 to 8 years of software development experience.
• Experience in large, complex application development including integration within multiple applications.
• Experience in Terraform scripting for IaC.
• GCP Dataflow: Strong, hands‑on experience building production‑grade data pipelines using GCP Dataflow and Apache Beam.
• GCP Cloud Services: Proficiency in leveraging core GCP services, including Pub/Sub, Big Query, Cloud Storage, and Cloud IAM.
• Java & Spring Boot: Solid experience in backend development using Java (Java 17 or higher) and the Spring Boot ecosystem (Spring Boot, Spring Security, Spring Data).
• API Design: Proven track record of designing, developing, and documenting clean, secure, and performant RESTful APIs.
• Angular: Hands‑on experience building user interfaces and integrating frontend screens with backend APIs using Angular (TypeScript).
• Relational Databases: Strong expertise in relational databases (SQL), database design, and query optimization.
• Tools & DevOps: Experience with Git version control, build tools (Maven/Gradle, npm), and CI/CD pipelines (e.g., GitHub Actions, Tekton, or Google Cloud Build).
• Vector store ingestion & embedding pipelines
• Real‑time streaming for agent grounding
• Declarative pipeline specification