AI GCP Data Engineer

Lincoln Motor Company; Chennai District; On-site; INR 1,000,000 - 2,000,000; Full time

Job summary

Lincoln Motor Company in Chennai, India seeks a hands-on Data Engineer with 3+ years of experience to design and build scalable data pipelines, data products, and AI-ready data assets. You will work across structured and unstructured data, ensure data quality, and optimize costs using cloud-native tools to enable AI/ML and GenAI use cases.

You will collaborate with data scientists, product teams, and stakeholders to implement DataOps practices, maintain observability, and deliver

Qualifications

• 3+ years of hands-on data engineering experience in ETL/ELT and cloud data platforms.

Responsibilities

• Design, build, and maintain reliable batch and streaming data pipelines for ingestion, transformation, validation, and publishing.
• Develop curated, reusable data products supporting BI dashboards, analytics applications, ML models, and GenAI-enabled solutions.
• Implement strong data quality checks, observability, lineage, metadata management, and monitoring practices to improve trust in data assets.
• Write clean, modular code using Python and SQL, and utilize modern data engineering frameworks.
• Partner with data scientists, ML engineers, product owners, and stakeholders to support experimentation and production analytics.
• Apply DataOps practices including CI/CD, version control, automated testing, and release management.

Skills

SQL

Python

Data modeling

ETL/ELT

CI/CD

Education

Bachelor’s or Master’s degree in relevant field

Tools

BigQuery

Dataflow

Dataproc

Airflow/Cloud Composer

Dataform

DBT

Spark

Job description

Job Description:

We are looking for a hands-on Data Engineer with 3+ years of experience building production-grade data pipelines, cloud data platforms, and automated data workflows. You are comfortable working across structured, semi-structured, and unstructured data; you understand the importance of data quality, lineage, security, and cost optimization; and you are excited to build the data foundation required for modern AI, ML, and GenAI use cases.

• Understand business, analytics, and AI use cases and translate them into scalable data engineering solutions.
• Design, build, and maintain reliable batch and streaming data pipelines for ingestion, transformation, validation, and publishing.
• Develop curated, reusable, and well-documented data products that support BI dashboards, analytics applications, ML models, and GenAI-enabled solutions.
• Implement strong data quality checks, observability, lineage, metadata management, and monitoring practices to improve trust in enterprise data assets.
• Write clean, modular, and well-tested code using Python, SQL, and modern data engineering frameworks.
• Use cloud-native technologies such as BigQuery, Dataflow, Dataproc, Cloud Composer/Airflow, Dataform, DBT, Spark, or equivalent tools to deliver resilient data solutions.
• Enable AI/ML and GenAI teams by preparing high-quality feature datasets, vector-ready datasets, document corpora, and governed data access patterns.
• Partner with data scientists, ML engineers, product owners, and business stakeholders to support experimentation, model deployment, and production analytics.
• Apply DataOps practices including CI/CD, version control, automated testing, reusable templates, release management, and production support standards.
• Optimize pipeline performance, storage usage, compute cost, and reliability across cloud-based data platforms.
• Support data governance, privacy, access control, and compliance expectations for enterprise and AI-ready data assets.
• Stay current with advances in cloud data engineering, AI data infrastructure, orchestration, data quality, and GenAI-enabling technologies.

Qualifications

Minimum Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, Engineering, Statistics, Mathematics, or related technical field.
• 3+ years of hands-on experience in data engineering, ETL/ELT development, data warehousing, or cloud-based data platform delivery.
• Strong proficiency in SQL and Python for data extraction, transformation, automation, testing, and production support.
• Experience designing and operating scalable pipelines on cloud platforms such as Google Cloud Platform, AWS, Azure, or equivalent enterprise data ecosystems.
• Experience with modern data platforms and tools such as BigQuery, Spark, Dataflow, Dataproc, Airflow/Cloud Composer, Dataform, DBT, or similar technologies.
• Good understanding of data modeling, dimensional modeling, partitioning, clustering, performance tuning, and cost optimization.
• Working knowledge of data quality frameworks, monitoring, alerting, metadata, lineage, and production support practices.
• Familiarity with Git, CI/CD, agile delivery, code reviews, documentation, and reusable engineering standards.
• Strong communication skills with the ability to explain technical solutions clearly to engineering, analytics, and business stakeholders.

Preferred Qualifications

• 5+ years of experience delivering enterprise data engineering solutions in cloud-native environments.
• Experience building data products for AI/ML, GenAI, semantic search, retrieval-augmented generation, feature engineering, or model monitoring use cases.
• Experience working with unstructured data such as documents, logs, text, images, transcripts, or embeddings, and preparing them for downstream AI consumption.
• Hands-on experience with DataOps, MLOps enablement, pipeline observability, automated testing, and production incident resolution.
• Experience migrating legacy workflows from Hadoop, Alteryx, or on-premise platforms to modern cloud services.
• Experience with APIs, microservices, event-driven architectures, streaming data, or real-time analytics.
• Cloud certifications in Google Cloud Platform, AWS, Azure, or relevant data engineering technologies.
• Experience mentoring junior engineers, defining engineering standards, or contributing reusable platform accelerators.