Senior Data Engineer

Calfus; Pune District; On-site; Full time

Job description

At Calfus, we are known for delivering cutting-edge AI agents and products that transform businesses in ways previously unimaginable. We empower companies to harness the full potential of AI, unlocking opportunities they never imagined possible before the AI era. Our software engineering teams are highly valued by customers, whether start-ups or established enterprises, because we consistently deliver solutions that drive revenue growth. Our ERP solution teams have successfully implemented cloud solutions and developed tools that seamlessly integrate with ERP systems, reducing manual work so teams can focus on high impact tasks.

None of this would be possible without talent like you! Our global teams thrive on collaboration, and we're actively looking for skilled professionals to strengthen our in-house expertise and help us deliver exceptional AI, software engineering, and solutions using enterprise applications. As one of the fastest-growing companies in our industry, we take pride in fostering a culture of innovation where new ideas are always welcomed—without hesitation. We are driven and expect the same dedication from our team members. Our speed, agility, and dedication set us apart, and we perform best when surrounded by high-energy, driven individuals.

To continue our rapid growth and deliver an even greater impact, we invite you to apply for our open positions and become part of our journey!

About the Role

As a Data Engineer – BI Analytics & DWH, you will play a pivotal role in designing and implementing comprehensive business intelligence solutions that empower our organization to make data-driven decisions. You will leverage your expertise in Power BI, Tableau, and ETL processes to create scalable architectures and interactive visualizations. This position requires a strategic thinker with strong technical skills and the ability to collaborate effectively with stakeholders at all levels.

What You'll Do

• BI Architecture & DWH Solution Design: Develop and design scalable BI Analytical & DWH Solution that meets business requirements, leveraging tools such as Power BI and Tableau.
• Data Integration: Oversee the ETL processes using SSIS to ensure efficient data extraction, transformation, and loading into data warehouses.
• Data Modelling: Create and maintain data models that support analytical reporting and data visualization initiatives.
• Database Management: Utilize SQL to write complex queries, stored procedures, and manage data transformations using joins and cursors.
• Visualization Development: Lead the design of interactive dashboards and reports in Power BI and Tableau, adhering to best practices in data visualization.
• Collaboration: Work closely with stakeholders to gather requirements and translate them into technical specifications and architecture designs.
• Performance Optimization: Analyse and optimize BI solutions for performance, scalability, and reliability.
• Data Governance: Implement best practices for data quality and governance to ensure accurate reporting and compliance.
• Team Leadership: Mentor and guide junior BI developers and analysts, fostering a culture of continuous learning and improvement.
• Azure Databricks: Leverage Azure Databricks for data processing and analytics, ensuring seamless integration with existing BI solutions.

What We're Looking For

On your first day, we'll expect you to have:

• 6-12 years of experience in BI architecture and development, with a strong focus on Power BI and Tableau.
• Proven experience with ETL processes and tools, especially SSIS. Strong proficiency in SQL Server, including advanced query writing and database management.
• Exploratory data analysis with Python.
• Familiarity with the CRISP-DM model.
• Ability to work with different data models.
• Familiarity with databases like Snowflake, Postgres, Redshift & MongoDB.
• Experience with visualization tools such as Power BI, QuickSight and Plotly and/or Dash.
• Strong programming foundation with Python with versatility to handle:
  • Data Manipulation and Analysis: using Pandas, NumPy & PySpark
  • Data serialization & formats like JSON, CSV and Parquet & Pickle
  • Database interaction to query cloud-based data warehouses
  • Data Pipeline and ETL tools like Airflow for orchestrating workflows and managing ETL pipelines: Scripting and automation
  • Cloud services & tools such as S3, AWS Lambda to manage cloud infrastructure
• Code quality and management using version control and collaboration in data engineering projects.
• Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field.

We'd be super excited if you have:

• Ability to interact with REST APIs and perform web scraping tasks.

At Calfus, we value our employees and offer a strong benefits package. This includes medical, group, and parental insurance, coupled with gratuity and provident fund options. Further, we support employee wellness and provide birthday leave as a valued benefit.

Calfus is an Equal Opportunity Employer. We believe diversity drives innovation. We're committed to creating an inclusive workplace where everyone—regardless of background, identity, or experience—has the opportunity to thrive. We welcome all applicants!

Required Skills