Data Engineer

FetchJobs.co; India; On-site; INR 2,400,000 - 4,000,000; Full time

Benefits offered by this job

Competitive compensation

Health benefits

Career advancement

Flexible work arrangements

Job summary

GyanSys is seeking experienced Senior Data Engineers / Consultants to join our expanding Data & Analytics practice. The ideal candidate will design, develop, and optimize enterprise‑scale data engineering solutions within modern cloud environments, utilizing Fabric, Azure Data Factory, Databricks, PySpark, and Spark SQL to build scalable data pipelines and analytics platforms.

The role involves collaborating with architects, data scientists, and BI teams to deliver end‑to‑end data platforms,

Qualifications

• Bachelor's or master's degree in CS/IT/Engineering or related field.
• Minimum four years of data engineering experience.
• Certifications such as Fabric Data Engineer, Azure Data Engineer, or Databricks preferred.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines for enterprise data platforms.
• Develop data engineering solutions utilizing Microsoft Fabric, Azure Data Factory, Databricks, PySpark, Spark SQL, and Python to support business analytics and reporting needs.
• Build data pipelines capable of processing structured, semi-structured, and unstructured data from diverse sources such as SQL Server, Oracle, PostgreSQL, APIs, cloud storage, ERP systems, and SaaS applications.
• Leverage Microsoft Fabric components, including Fabric Data Factory, Lakehouse, Warehouse, Dataflows, and Notebooks, to create integrated data solutions.
• Develop and optimize Databricks notebooks, Spark jobs, Delta Lake pipelines, and Databricks workflows to ensure high performance and cost efficiency.
• Implement Medallion Architecture and modern Lakehouse/Data Platform architectures to support scalable and flexible data solutions.
• Design and implement data models, data warehouses, data lakes, and Lakehouse solutions aligned with enterprise requirements.
• Optimize data pipelines, Spark jobs, SQL queries, clusters, and storage for performance, scalability, and cost management.
• Ensure adherence to data governance, security, validation, and compliance standards, including data lineage and access controls.
• Develop and maintain CI/CD pipelines using Azure DevOps, GitHub, and related tools to automate deployment and testing processes.
• Troubleshoot production issues, conduct root cause analysis, and implement performance improvements to ensure system reliability.
• Collaborate with solution architects, business analysts, data scientists, and BI teams to deliver comprehensive data solutions.
• Participate in technical design discussions, code reviews, documentation, and knowledge-sharing initiatives to foster best practices.
• Mentor junior engineers, contribute to team skill development, and promote innovative approaches within the data engineering domain.

Skills

Data engineering

Cloud data platforms

ETL/ELT pipelines

Team mentorship

Education

Bachelor's or Master's degree in Computer Science/IT/Engineering

Tools

Microsoft Fabric

Azure Data Factory

Databricks

PySpark

Spark SQL

Python

Job description

About The Company

GyanSys Inc. is a leading global systems integrator and technology consulting firm dedicated to accelerating digital transformation for enterprises worldwide. With a focus on innovative solutions, GyanSys specializes in SAP, Cloud, Data & Analytics, AI, and Intelligent Automation. The company partners with top-tier technology providers to deliver scalable, business-driven solutions tailored to diverse industry needs. GyanSys prides itself on its commitment to excellence, fostering a collaborative environment that encourages continuous learning, innovation, and the development of cutting‑edge technology solutions. Its global presence and extensive expertise enable it to serve clients across various sectors, helping them leverage the latest digital tools to achieve strategic objectives and operational efficiencies.

About The Company

GyanSys Inc. is a leading global systems integrator and technology consulting firm dedicated to accelerating digital transformation for enterprises worldwide. With a focus on innovative solutions, GyanSys specializes in SAP, Cloud, Data & Analytics, AI, and Intelligent Automation. The company partners with top-tier technology providers to deliver scalable, business-driven solutions tailored to diverse industry needs. GyanSys prides itself on its commitment to excellence, fostering a collaborative environment that encourages continuous learning, innovation, and the development of cutting‑edge technology solutions. Its global presence and extensive expertise enable it to serve clients across various sectors, helping them leverage the latest digital tools to achieve strategic objectives and operational efficiencies.

About The Role

GyanSys is seeking experienced Senior Data Engineers / Consultants to join our expanding Data & Analytics practice. The ideal candidate will have a proven track record in designing, developing, and optimizing enterprise‑scale data engineering solutions within modern cloud environments. This role offers an exciting opportunity to work on complex data projects, utilizing the latest technologies such as Microsoft Fabric, Azure Data Engineering, Databricks, PySpark, and Apache Spark. The Senior Data Engineer / Consultant will collaborate closely with architects, business stakeholders, data scientists, and cross‑functional teams to build scalable data pipelines, data warehouses, and analytics solutions that drive business insights and operational efficiencies.

The position involves engaging in end‑to‑end data platform development, implementing best practices for data quality, security, and governance, and contributing to the technical growth of the team. The role is suited for individuals who are passionate about data engineering, eager to work on innovative projects, and capable of translating complex data requirements into effective technical solutions. The position is available in Bengaluru, Pune, and Hyderabad, with immediate joiners preferred for a full‑time engagement.

Qualifications

The ideal candidate should possess a bachelor's or master's degree in Computer Science, Information Technology, Engineering, or a related field. A minimum of four years of professional experience in data engineering or related roles is required. Certifications such as Microsoft Certified: Fabric Data Engineer Associate, Azure Data Engineer Associate, or Databricks Certified Data Engineer are highly preferred. Candidates with experience working on enterprise data platforms, cloud migrations, and real‑time data pipelines will have a distinct advantage.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines for enterprise data platforms, ensuring data quality and integrity.
• Develop data engineering solutions utilizing Microsoft Fabric, Azure Data Factory, Databricks, PySpark, Spark SQL, and Python to support business analytics and reporting needs.
• Build data pipelines capable of processing structured, semi‑structured, and unstructured data from diverse sources such as SQL Server, Oracle, PostgreSQL, APIs, cloud storage, ERP systems, and SaaS applications.
• Leverage Microsoft Fabric components, including Fabric Data Factory, Lakehouse, Warehouse, Dataflows, and Notebooks, to create integrated data solutions.
• Develop and optimize Databricks notebooks, Spark jobs, Delta Lake pipelines, and Databricks workflows to ensure high performance and cost efficiency.
• Implement Medallion Architecture and modern Lakehouse/Data Platform architectures to support scalable and flexible data solutions.
• Design and implement data models, data warehouses, data lakes, and Lakehouse solutions aligned with enterprise requirements.
• Optimize data pipelines, Spark jobs, SQL queries, clusters, and storage for performance, scalability, and cost management.
• Ensure adherence to data governance, security, validation, and compliance standards, including data lineage and access controls.
• Develop and maintain CI/CD pipelines using Azure DevOps, GitHub, and related tools to automate deployment and testing processes.
• Troubleshoot production issues, conduct root cause analysis, and implement performance improvements to ensure system reliability.
• Collaborate with solution architects, business analysts, data scientists, and BI teams to deliver comprehensive data solutions.
• Participate in technical design discussions, code reviews, documentation, and knowledge‑sharing initiatives to foster best practices.
• Mentor junior engineers, contribute to team skill development, and promote innovative approaches within the data engineering domain.

Benefits

Joining GyanSys offers the opportunity to work on high‑impact enterprise projects utilizing the latest cloud and data technologies. Employees benefit from a collaborative and innovative work environment that encourages continuous learning and professional development. GyanSys provides competitive compensation packages, comprehensive health benefits, and opportunities for career advancement. The company also promotes work‑life balance and flexible working arrangements to support employee well‑being. Additionally, employees gain exposure to global clients and diverse industry challenges, enhancing their technical expertise and industry knowledge.

Equal Opportunity

GyanSys Inc. is an equal opportunity employer committed to fostering an inclusive environment for all employees. We do not discriminate based on race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, disability, or any other protected characteristic. We believe diversity enriches our workplace and drives innovation, and we are dedicated to providing a workplace free from discrimination and harassment. All qualified applicants will receive consideration for employment without regard to any protected status, and we encourage individuals from diverse backgrounds to apply. ...