Data Engineer with Databricks and Power BI

Acesoft Labs; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Sony India Software Centre in Bengaluru is seeking a Senior Data Engineer to design, develop, and maintain robust data pipelines and architectures supporting analytics and reporting.

You will work with data scientists and analysts, applying Databricks and Power BI (DAX) to optimize workflows and visualize complex datasets. Proficiency in Python or Scala, SQL, and Azure cloud is essential, with mentoring duties across teams.

Qualifications

• 5 to 6 years of experience in data engineering.
• Experience with Databricks and Power BI (DAX).
• Strong Python/Scala for data pipelines.
• Knowledge of SQL and data warehousing concepts.
• Azure cloud experience for storage and processing.

Responsibilities

• Design scalable data processing solutions using Databricks and ETL processes.
• Develop interactive dashboards and reports using Power BI (DAX).
• Collaborate with cross-functional teams to meet business requirements.
• Optimize data storage and retrieval to reduce latency.
• Ensure data quality and governance across pipelines.
• Mentor junior data engineers and share knowledge.

Skills

Databricks

Power BI

SQL

DAX

SQL Server

Data Warehousing

Education

B Tech

MS/ MSc in CS/Data Science

Tools

Databricks

Spark

Python

Scala

Azure

Azure DevOps

Power BI

Job description

Role & responsibilities

Mandatory Skills
Databricks Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing

Skill to Evaluate
Databricks Engineer, Power Bi Developer, SQL, Dax Queries, SQL Server, Data Warehousing

Experience
5 to 6 Years

Location
Bengaluru

Job Title: Data Engineer with Databricks and Power BI (DAX) Experience

Company: Sony India Software Centre

Job Description:

As a Senior Data Engineer at Sony India Software Centre, you will be responsible for designing, developing, and maintaining robust data pipelines and data architectures to support advanced analytics and reporting initiatives. You will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that empower the organization to make data-driven decisions. Your expertise in Databricks and Power BI (DAX) will be critical in optimizing data workflows and visualizing complex datasets.

Key Responsibilities

• Design and implement scalable data processing solutions using Databricks, including ETL processes that efficiently handle large data volumes.
• Develop interactive dashboards and reports using Power BI to facilitate real-time data visualization and insights for stakeholders.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs and objectives.
• Optimize data storage and retrieval processes to enhance performance and reduce latency.
• Ensure data quality and integrity by implementing best practices for data governance and validation.
• Mentor junior data engineers and contribute to knowledge sharing within the team.
• Stay updated with the latest trends and technologies in data engineering, and evaluate their applicability to the organization's needs.

Skills and Tools Required

• Proficiency in Databricks and experience with Spark for big data processing.
• Strong experience with Power BI, particularly in building reports and dashboards using DAX.
• Solid programming skills in Python or Scala for developing data pipelines.
• Knowledge of SQL and experience with relational databases and data warehousing concepts.
• Familiarity with cloud platforms - Azure, particularly in relation to data storage and processing.
• Understanding of data modeling, ETL processes, and data integration methodologies.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration abilities to work effectively in a team-oriented environment.

Skill Area Tools & Technologies

• Data Engineering Databricks, Apache Spark, Delta Lake
• Programming Python, SQL, PySpark
• BI & Visualization Power BI, DAX, Power Query
• Cloud Platforms Azure
• DevOps & CI/CD Git, Azure DevOps
• Data Governance Unity Catalog, Data Lake Security

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or a related field.
• Previous experience in a similar data engineering role, particularly within a corporate environment.
• Knowledge of additional BI tools and data visualization platforms is a plus.

Sony India Software Centre offers a dynamic work environment and opportunities for professional growth and development. Join us in our mission to innovate and deliver exceptional data solutions that drive business excellence.

Education Qualificaiton

B Tech