Data Engineer

DNEG

Bengaluru

On-site

INR 1,200,000 - 1,800,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A leading enterprise AI company in Bengaluru seeks a Data Engineer to architect and maintain data pipelines for innovative products. You will work with machine learning, media processing, and infrastructure, addressing complex technical challenges. Ideal candidates have over 3 years of experience and strong Python programming skills. This full-time role offers opportunities to work with modern tools and cloud environments.

Qualifications

3+ years in data engineering or related backend/infrastructure role.
Experience with software development lifecycle (SDLC) and CI/CD pipelines.
Proven experience building and testing data pipelines in production.

Responsibilities

Design and maintain scalable pipelines for ingesting, processing, and validating datasets.
Work with other teams to identify workflow optimisation potential.
Build and maintain observability tooling in collaboration with other engineers.

Skills

Strong programming skills in Python or similar languages

Proficiency in Linux

Solid SQL knowledge

Experience with Docker or other containerization technologies

Proactive approach to solving complex technical challenges

Passion for system optimization and continuous learning

Ability to adapt solutions for multimedia data workflows

Tools

Kubernetes (k8s)

ETL tools or big data frameworks

AWS

GCP

Azure

Job description

Join to apply for the Data Engineer (Brahma) role at DNEG

Get AI-powered advice on this job and more exclusive features.

Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency. Part of the DNEG Group, Brahma brings together Hollywood’s leading creative technologists, innovators in AI and Generative AI, and thought leaders in the ethical creation of AI content.

Job Description As a Data Engineer, you’ll architect and maintain the pipelines that power our products and services. You’ll work at the intersection of ML, media processing, and infrastructure; owning the data tooling and automation layer that enables scalable, high-quality training and inference. If you’re a developer who loves solving tough problems and building efficient systems, we want you on our team.

Key Responsibilities

Design and maintain scalable pipelines for ingesting, processing, and validating datasets with main focus visual and voice data.
Work with other teams to identify workflow optimisation potential, design and develop automation tools, using AI-driven tools and custom model integrations and scripts.
Write and maintain tests for pipeline reliability.
Build and maintain observability tooling in collaboration with other engineers to track data pipeline health and system performance.
Collaborate with data scientists, operators, and product teams to deliver data solutions.
Debug and resolve complex data issues to ensure system performance.
Optimise storage, retrieval, and caching strategies for large media assets across environments.
Deploy scalable data infrastructure using cloud platforms as well as on-premise and containerization.
Deepen your knowledge of machine learning workflows to support AI projects.
Stay current with industry trends and integrate modern tools into our stack.

Must Haves