Data Engineer, 10-15 years

Jobtailor; Chennai District; On-site; INR 3,000,000 - 5,000,000; Full time

Job summary

Jobtailor is seeking an experienced Data Engineer to design and deliver robust data solutions enabling AI and advanced analytics across the organization. You will own the end-to-end data lifecycle, ingest data into a centralized data lake and catalogue, and build scalable ETL/ELT processes.

With 8–10 years of hands-on experience, you will manipulate data using SQL, Python, and BI platforms such as Power BI or Tableau, while leading data requirement gatherings and lifecycle management.

Qualifications

• 8 to 10 years of hands-on experience in data engineering or closely related roles.
• Proven experience building high-performance data pipelines and end-to-end data solutions.
• Hands-on experience designing or operating a centralized data lake and data catalogue.
• Strong coding skills for data manipulation, automation scripts, and API integrations.
• Advanced skills in SQL for complex querying, data modeling, and performance tuning.
• Hands-on experience in data cleansing, mapping, metadata management, and data catalogues maintenance.
• Professional-level experience with Power BI or Tableau.

Responsibilities

• Design and deliver robust data solutions for AI and advanced analytics across the organization.
• Own end-to-end data lifecycle from requirement gathering to scalable pipelines.
• Ingest data from disparate tools into a single data lake and data catalogue.
• Clean and curate datasets; develop and maintain data catalogues and metadata documentation.
• Architect, implement, and optimize scalable ETL/ELT processes across sources.
• Use Python to automate data validation, monitoring, and workflows.
• Design and implement dashboards and reports using Power BI or Tableau for actionable insights.

Skills

Data Engineering

ETL/ELT

SQL

Python

API Integration

Data Pipeline Development

Data Lake Architecture

Data Cleansing

Data Mapping

Metadata Management

Data Catalogue Maintenance

Data Modeling

Performance Tuning

Complex Querying

Power BI

Tableau

Tools

Pandas

NumPy

Job description

• Design and deliver robust data solutions that enable AI and advanced analytics across the organization.
• Own the end-to-end data lifecycle: from requirement gathering and data mapping to implementing scalable pipelines.
• Ingest data from disparate engineering and business tools into a single, curated, well-structured data lake and data catalogue.
• Clean and curate complex datasets. Develop and maintain data catalogues, metadata, and data mapping documentation.
• Architect, implement, and optimize scalable ETL/ELT processes, moving data from diverse sources.
• Leverage Python to automate data validation, monitoring, and repetitive workflows.
• Design and implement dashboards and reports using platforms like Power BI or Tableau to provide actionable insights.

Requirements

• 8 to 10 years of hands‑on experience in data engineering or closely related roles.
• Proven experience building high‑performance data pipelines and implementing end‑to‑end data solutions in a production environment.
• Hands‑on experience designing or operating a centralized data lake and data catalogue.
• Strong coding skills for data manipulation (e.g., Pandas, NumPy), automation scripts, and API integrations.
• Advanced skills in SQL for complex querying, data modeling, and performance tuning.
• Hands‑on experience in data cleansing, mapping, metadata management, and the creation/maintenance of data catalogues.
• Professional‑level experience with Power BI, Tableau, or similar BI platforms.
• Demonstrated ability to lead requirement‑gathering sessions and manage the lifecycle of data initiatives.

Core Competencies

Demonstrates expertise in designing and delivering data solutions, managing the end-to-end data lifecycle, and implementing scalable ETL/ELT processes. Proficient in data manipulation, cleansing, and visualization using advanced tools and programming languages.

Highest‑signal resume keywords

• Data Engineering
• ETL/ELT Process Implementation
• SQL Proficiency
• Python Automation
• Power BI or Tableau Expertise

ATS Optimization Keywords

Hard Skills

• Data Pipeline Development
• Data Lake Architecture
• Data Cleansing
• Data Mapping
• Metadata Management
• Data Catalogue Maintenance
• Complex Querying
• Data Modeling
• Performance Tuning
• API Integration

Soft Skills

• Requirement Gathering
• Lifecycle Management

Industry Keywords

• Data Solutions
• Advanced Analytics
• Data Validation
• Data Monitoring

Tools & Technologies

• Power BI
• Tableau
• Pandas
• NumPy