Senior - Data Engineer

Chapter247; Indore; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Chapter247 is looking for an experienced Data Engineer in Indore, India, with 4-6 years of experience in data analytics, engineering, or business intelligence. Responsibilities include designing ETL pipelines, optimizing SQL queries, and utilizing technologies like PySpark and Databricks. The ideal candidate should have a strong analytical skill set, proven team leadership experience, and expertise in connecting to various data sources. A good understanding of Microsoft Fabric is mandatory.

Qualifications

• 4-6 years of experience in data analytics, data engineering, or business intelligence.
• Strong expertise in SQL (writing, optimizing, and managing complex queries).
• Hands-on experience in ETL processes and building/maintaining data pipelines.
• Experience working with Big Data technologies (Hadoop, Spark, PySpark, Databricks, etc.).
• Proficiency in Python for data analysis (Pandas, NumPy, etc.).
• Experience of working on Fabric.
• Experience of working on Databricks.
• Experience in connecting to and processing data from multiple data sources (databases, APIs, cloud platforms).
• Strong analytical and problem-solving skills.

Responsibilities

• Extract and process data from multiple databases, APIs, and cloud platforms.
• Design, develop, and maintain ETL pipelines for data transformation.
• Write and optimize complex SQL queries for data extraction and reporting.
• Utilize PySpark and Big Data technologies to process and analyze datasets.
• Perform data analysis using Python to uncover trends and insights.
• Develop and maintain dashboards and reports in Power BI.
• Work with cross-functional teams to translate business requirements into solutions.
• Ensure data accuracy, security, and compliance with policies.

Skills

Data analytics

Data engineering

Business intelligence

SQL

ETL processes

Big Data technologies

Python

Data warehousing

Analytical skills

Tools

Microsoft Fabric

Databricks

Power BI

PySpark

Hadoop

Spark

Job description

• Extract and process data from multiple databases, APIs, and cloud platforms by establishing strong source connections.
• Design, develop, and maintain ETL pipelines for efficient data transformation and ingestion.
• Write and optimize complex SQL queries for data extraction, validation, and reporting.
• Utilize PySpark and Big Data technologies (Hadoop, Spark, Databricks, etc.) to process and analyze large datasets.
• Perform data analysis using Python (Pandas, NumPy, etc.) to uncover trends, patterns, and insights.
• Develop and maintain interactive dashboards and reports in Power BI (good to have).
• Work with cross-functional teams to understand business requirements and translate them into data-driven solutions.
• Experience in Data warehouse schema creation and optimization
• Ensure data accuracy, security, and compliance with company policies.
• Present analytical findings and recommendations to stakeholders in a clear and actionable manner.
• Must have senior-level experience
• Proven team-handling/leadership experience
• Strong portfolio of diverse certifications and projects
• Mandatory: Hands-on experience or certification in Microsoft Fabric or Databricks

Required Skills & Qualifications:

• 4-6 years of experience in data analytics, data engineering, or business intelligence.
• Strong expertise in SQL (writing, optimizing, and managing complex queries).
• Hands-on experience in ETL processes and building/maintaining data pipelines.
• Experience working with Big Data technologies (Hadoop, Spark, PySpark, Databricks, etc.).
• Proficiency in Python for data analysis (Pandas, NumPy, etc.).
• Experience of working on Fabric
• Experience of working on Databrick
• Experience in connecting to and processing data from multiple data sources (databases, APIs, cloud platforms).
• Strong analytical and problem-solving skills.