68803 AI Data Engineer

Cephas Consultancy Services Private Limited; Pune District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Cephas Consultancy Services Private Limited in Pune invites an experienced Data Engineer to help design, build, and operate scalable data pipelines and AI-ready data platforms. The role emphasizes end-to-end ownership of production pipelines and collaboration with engineers, architects, product owners, and stakeholder teams.

The candidate should have 5–10 years of data engineering experience, strong Python and SQL skills, PySpark expertise, and familiarity with knowledge base and RAG solutions

Qualifications

• Must hold a Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5–10 years of experience in data engineering or cloud-scale analytics.
• Proven ownership of production pipelines and platform components.

Responsibilities

• Lead technical discussions with engineers, architects, product owners and data teams to translate requirements into secure, maintainable data platforms.
• Design, build, and operate production-grade batch or streaming data pipelines with observability and error handling.
• Implement knowledge base and RAG solutions for agentic AI use cases.

Skills

Data pipelines

Python

SQL

PySpark

RAG solutions

Education

Bachelor’s degree in CS/Engineering

Tools

Apache Spark

Job description

About this position

Positions:2 Full Time
Experience
5 - 10 Years

Job Description

Category
Essential for this role

Education and Qualifications
Bachelor’s degree in Computer Science, Engineering, or a related field

Work Experience
1. 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with demonstrated ownership of production pipelines and platform components.

Technical / Professional Skills

Please provide at least 3

• 1. Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
• 2. Hands‑on experience with Python and SQL for data transformation and validation
• 3. Familiarity with Apache Spark (especially PySpark) and large‑scale data processing concepts
• 4. Experience with implementing knowledge base and RAG solutions for agentic AI use cases

Non-Technical / Soft Skills

• 1. Self‑starter with strong problem‑solving skills and a keen attention to detail
• 2. Able to work independently and lead technical discussions with engineers, architects, product owners, source‑system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
• 3. Strong documentation and communication skills

Other Task‑Specific Knowledge

• 1. Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.

Share this Job: