Data Engineer

JMAN Group; Chennai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A consulting firm in Chennai is seeking a Mid-Senior Level Data Engineer to design data pipelines and manage storage solutions in a full-time role. Candidates should have over 5 years of experience with data platforms and multi-cloud environments. This position involves collaborating with various stakeholders to ensure data integrity, utilizing tools like AWS Glue and Azure Data Factory.

Qualifications

• 5+ years of experience in data platform builds.
• Familiarity with multi cloud data warehousing solutions.
• Experience with data visualization tools like Power BI or Tableau.

Responsibilities

• Design and implement data pipelines using ETL/ELT tools.
• Configure and manage data storage solutions.
• Collaborate with business stakeholders to translate needs into solutions.

Skills

Data platform builds

Multi cloud data warehousing solutions

Data visualization tools

Containerization technologies

CI/CD pipelines

Data governance frameworks

Data quality tools

Tools

AWS Glue

Azure Data Factory

Snowflake

Databricks

Docker

Kubernetes

Job description

Overview

Global Talent Acquisition Partner | People Lead | Recruitment SME

Company Description

JMAN Group is a fast-growing data engineering & data science consultancy. We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial Intelligence. In addition, we also work with growth businesses, large corporates, multinationals, and charities.

We are headquartered in London with Offices in New York, London and Chennai. Our team of over 450 people is a unique blend of individuals with skills across commercial consulting, data science and software engineering.

We were founded by cousins Anush Newman (Co-founder & CEO) and Leo Valan (Co-founder & CTO) and have grown rapidly since 2019. In May 2023 we took a minority investment from Baird Capital and in January 2024 we opened an office in New York with the ambition of growing our US business to be as large as, if not bigger than, our European business by 2027.

Technical specifications

• 5 + years of experience in data platform builds.
• Familiarity with multi cloud data warehousing solutions (Snowflake, Redshift, Databricks, Fabric, AWS Glue, Azure Data Factory, Synapse, Matillion, DBT).
• Good to have skills include Data visualization using Power BI, Tableau, or Looker, and familiarity with full-stack technologies.
• Experience with containerization technologies (e.g., Docker, Kubernetes)
• Experience with CI/CD pipelines and DevOps methodologies.
• Ability to work independently, adapt to changing priorities, and learn new technologies quickly.
• Experience in implementing or working with data governance frameworks and practices to ensure data integrity and regulatory compliance.
• Knowledge of data quality tools and practices.

Responsibilities

• Design and implement data pipelines using ETL/ELT tools and techniques.
• Configure and manage data storage solutions, including relational databases, data warehouses, and data lakes.
• Develop and implement data quality checks and monitoring processes.
• Automate data platform deployments and operations using scripting and DevOps tools (e.g., Git, CI/CD pipeline).
• Ensuring compliance with data governance and security standards throughout the data platform development process.
• Troubleshoot and resolve data platform issues promptly and effectively.
• Collaborate with the Data Architect to understand data platform requirements and design specifications.
• Assist with data modelling and optimization tasks.
• Work with business stakeholders to translate their needs into technical solutions.
• Document the data platform architecture, processes, and best practices.
• Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps.
• Proactively suggest improvements and innovations for the data platform.

Requirements

Note: The following skill areas are required.

ETL or ELT: AWS Glue/ Azure Data Factory/ Synapse/ Matillion/ dbt.

Data Warehousing: Azure SQL Server/Redshift/BigQuery/Databricks/Snowflake/fabric (Any - Mandatory).

SQL and Apache Spark / Python programming languages

Scripting and DevOps tools (e.g., Git, CI/CD pipeline)

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology
• Industries
• Business Consulting and Services and IT Services and IT Consulting

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.