Senior Data Engineer

Primesoft Inc; Chennai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading IT services company is seeking a Principal Software Engineer - Data to lead the design and development of enterprise-grade data systems. This role requires a deep understanding of data engineering and cloud-native technologies. Applicants should have 10-20 years of experience, excellent communication skills, and a commitment to quality and scalability in system design. The opportunity offers a collaborative environment with a focus on mentorship and cross-functional teamwork.

Qualifications

• Proven ability to communicate effectively with both technical and non-technical audiences.
• Experience tracking and clearly reporting project progress, milestones, and blockers.
• Technical depth to contribute to codebases and architecture discussions.
• A proactive and collaborative mindset focus on transparency and shared ownership.
• Commitment to quality, scalability, and maintainability of systems.

Responsibilities

• Drive development efforts by contributing high-quality, maintainable code.
• Own communication of project deliverables and timelines.
• Understand customer needs and translate them into technical solutions.
• Design and deliver robust data architectures.
• Lead technical execution of key projects.

Skills

Python

Golang

SQL

Cloud data platforms (e.g., Databricks, BigQuery, Snowflake)

Data pipelines

APIs

Data architecture

Cloud-native ecosystems (GCP, AWS, Azure)

CI/CD pipelines

Education

10-20 years of development experience in data engineering

Tools

Docker

Kubernetes

Airflow

Tableau

Job description

Direct message the job poster from Primesoft Inc

Strategic Recruitment Manager | Expert in IT Hiring | Client Coordination | Team Handling at Primesoft Inc specializing in Recruitment.

About the role--

As a Principal Software Engineer - Data, you will play a hands-on technical leader and a key communicator with stakeholders as part of the Data Products team. You will contribute directly to the design and development of enterprise-grade data systems and act as a bridge between engineering teams and business partners.

Primarily Focused on:

• Driving development efforts by contributing high-quality, scalable, and maintainable code across data pipelines, APIs, and platform components.
• Owning the communication of project deliverables, timelines, and risks to internal and external stakeholders, ensuring alignment at every step.
• Understanding customer needs and translating them into technical solutions, partnering closely with product, analytics, and engineering teams to deliver end-to-end value.
• Designing and delivering robust and future-proof data architectures that support analytics, APIs, and machine learning initiatives.
• Leading the technical execution of key projects, ensuring progress is clearly communicated and roadblocks are proactively addressed.
• Partnering cross-functionally to co-develop architectural roadmaps, implementation plans, and go-live strategies that meet business requirements.
• Participating in stakeholder reviews and providing clear, actionable updates on technical progress, dependencies, and constraints.
• Guide platform-level optimization, including cost efficiency, performance, reliability, and maintainability.
• Set best practices for data governance, lineage, quality, and security in a distributed data environment.
• Mentor engineers, fostering a strong technical culture and continuous learning environment.

Success in this role requires:

• Proven ability to communicate effectively with both technical and non-technical audiences, including customers, executives, and cross-functional teams.
• Experience tracking and clearly reporting project progress, milestones, and blockers to internal stakeholders and external partners.
• Technical depth to personally contribute to codebases and architecture discussions, while helping set standards across teams.
• A proactive and collaborative mindset focused on transparency, stakeholder engagement, and shared ownership of outcomes.
• Commitment to quality, scalability, and maintainability of systems through thoughtful design and testing.

About You--

Experience & Technical Requirements:

• 10-20 years of development experience in data engineering, including direct contribution to 24x7 production systems.
• Advanced skills in Python and/or Golang, SQL, and current cloud data platforms (e.g., Databricks, BigQuery, Snowflake, or other).
• Strong experience in communicating complex project plans and deliverables to both technical and business audiences.
• Track record of developing and operating scalable data pipelines, APIs, and data platform components in real-world environments.
• Experience working directly with external stakeholders or customers, either in consulting, enterprise data delivery, or technical leadership roles.
• Deep understanding of batch and real-time data architectures, data modeling, and data warehousing.
• Hands-on experience with cloud-native ecosystems (GCP, AWS, or Azure), CI/CD pipelines, and infrastructure as code.
• Experience with a broad range of cloud technologies, including:
  • Containerization & deployment: Docker, Kubernetes, Cloud Run, Cloud Functions, GKE, ECS
  • Data integration and orchestration: n8n, Cloud Scheduler, Airflow, Cloud Composer, Step Functions, dbt, Dataform
  • Messaging: Kafka, Pub/Sub
  • Analytics & BI: Looker, Tableau
  • Proficiency in setting up data observability, quality frameworks, and governance controls in distributed systems.
• Strong ability to translate ambiguous business needs into scoped, deliverable projects.
• Demonstrated success in stakeholder engagement, influencing outcomes, and building long-term trust.
• Technical leadership in prior roles with clear individual contributions to architecture, development, and delivery.
• Mentoring experience and a passion for helping others grow technically and professionally.

Highly Favorable Skills:

• Exceptional communication skills with the ability to articulate technical ideas and project updates clearly to both internal teams and customer stakeholders.
• Ability to distill complex data and architecture challenges into simple, actionable plans that align with stakeholder goals.
• Experience in client-facing roles, technical consulting, or enterprise delivery where direct communication with business or product partners was essential.
• A strong personal track record of hands-on coding and technical design, including ownership of critical systems and services.
• Demonstrated ability to build trust and alignment across teams, especially in fast-moving, high-stakes environments.
• Familiarity with cross-functional planning, scoping, and milestone delivery in agile or hybrid development environments.
• A commitment to mentoring and knowledge sharing, helping level up peers while continuing to grow as an individual contributor.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at Primesoft Inc by 2x

Sign in to set job alerts for “Senior Data Engineer” roles.

Associate Data Architect I or Senior Data Engineer

Digital S/W Eng Sr Analyst - C12 - CHENNAI

Informatica BDM Data Engineer - for a leading UAE bank

Senior Data Analyst, Marketing Innovation (Bangkok-based, relocation provided)

Senior Software Engineer/Lead Analyst-Security Testing (Penetration testing, DAST, SAST)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.