Data Engineering Architect

JMAN Group; Chennai District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

JMAN Group, a fast-growing data engineering and data science consultancy, seeks experienced data platform professionals to design and implement end-to-end pipelines across cloud environments. Based in Chennai with global offices, you will work with Azure Data Factory, Databricks, and Snowflake to deliver reliable data solutions for PE funds and portfolio companies.

You will ensure data governance, write clean SQL and Python, and collaborate with data architects and stakeholders to translate

Qualifications

• 8+ years of experience in data platform build or related field.
• Proficient in SQL and Apache Spark / Python programming languages.
• Experience with cloud platforms like Azure.
• Experience in data pipelines and ETL/ELT tools, including AWS Glue/Azure Data Factory/ Synapse/Matillion/DBT
• Experience in implementing or working with data governance frameworks and practices to ensure data integrity and regulatory compliance.
• Knowledge of data quality tools and practices.
• Good to have skills include: Data visualization using Power BI, Tableau, or Looker, and familiarity with full-stack technologies.
• Experience with containerization technologies (e.g., Docker, Kubernetes)
• Experience with CI/CD pipelines and DevOps methodologies.
• Excellent communication, collaboration, and problem-solving skills.

Responsibilities

• Design and implement data pipelines using ETL/ELT tools and techniques.
• Configure and manage data storage solutions, including relational databases, data warehouses, and data lakes.
• Develop and implement data quality checks and monitoring processes.
• Automate data platform deployments and operations using scripting and DevOps tools (e.g., Git, CI/CD pipeline). Ensuring compliance with data governance and security standards throughout the data platform development process.
• Troubleshoot and resolve data platform issues promptly and effectively.
• Collaborate with the Data Architect to understand data platform requirements and design specifications.
• Assist with data modelling and optimization tasks.
• Work with business stakeholders to translate their needs into technical solutions. Document the data platform architecture, processes, and best practices.
• Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps.
• Proactively suggest improvements and innovations for the data platform.

Skills

Data storytelling

Analytical thinking

Team collaboration

Tools

SQL

Python

Apache Spark

Azure

Databricks

Snowflake

Airflow

Power BI

Tableau

Job description

JMAN Group is a fast-growing data engineering & data science consultancy. We work primarily with Private Equity Funds and their Portfolio Companies to create commercial value using Data & Artificial Intelligence. In addition, we also work with growth businesses, large corporates, multinationals, and charities.

We are headquartered in London with Offices in New York, London and Chennai. Our team of over 450 people is a unique blend of individuals with skills across commercial consulting, data science and software engineering.

We were founded by cousins Anush Newman (Co-founder & CEO) and Leo Valan (Co-founder & CTO) and have grown rapidly since 2019. In May 2023 we took a minority investment from Baird Capital and in January 2024 we opened an office in New York with the ambition of growing our US business to be as large as, if not bigger than, our European business by 2027.

Technical Specifications:

• 8+ years of experience in data platform build or any related field.
• Familiarity and has worked with cloud-based data warehousing solutions (e.g., Fabric,Snowflake, Redshift, Databricks) and principles
• Proficient in SQL and Apache Spark / Python programming languages.
• Experience with cloud platforms like Azure.
• Experience in data pipelines and ETL/ELT tools, including AWS Glue/Azure Data Factory/ Synapse/Matillion/DBT
• Experience in implementing or working with data governance frameworks and practices to ensure data integrity and regulatory compliance.
• Knowledge of data quality tools and practices.
• Good to have skills include: Data visualization using Power BI, Tableau, or Looker, and familiarity with full-stack technologies.
• Experience with containerization technologies (e.g., Docker, Kubernetes)
• Experience with CI/CD pipelines and DevOps methodologies.
• Excellent communication, collaboration, and problem-solving skills.

Qualifications

• ETL or ELT: Azure Data Factory, Databricks, Synapse, dbt (any two – Mandatory).
• Data Warehousing: Azure SQL Server/Redshift/Big Query/Databricks/Snowflake (Anyone - Mandatory).
• Data Visualization: Looker, Power BI, Tableau (Basic understanding to support stakeholder queries).
• Cloud: Azure (Mandatory), AWS or GCP (Good to have).
• SQL and Scripting: Ability to read/debug SQL and Python scripts.
• Monitoring: Azure Monitor, Log Analytics, Datadog, or equivalent tools.
• Ticketing & Workflow Tools: Freshdesk, Jira, ServiceNow, or similar.

Responsibilities:

• Design and implement data pipelines using ETL/ELT tools and techniques.
• Configure and manage data storage solutions, including relational databases, data warehouses, and data lakes.
• Develop and implement data quality checks and monitoring processes.
• Automate data platform deployments and operations using scripting and DevOps tools (e.g., Git, CI/CD pipeline). Ensuring compliance with data governance and security standards throughout the data platform development process.
• Troubleshoot and resolve data platform issues promptly and effectively.
• Collaborate with the Data Architect to understand data platform requirements and design specifications.
• Assist with data modelling and optimization tasks.
• Work with business stakeholders to translate their needs into technical solutions. Document the data platform architecture, processes, and best practices.
• Stay up to date with the latest trends and technologies in full stack development, data engineering, and DevOps.
• Proactively suggest improvements and innovations for the data platform.