Azure Databricks Data Engineer| 5 to 8 Years| Gyansys | Hybrid

PradeepIt Global Consulting Pvt Ltd.; Bengaluru; On-site; INR 1,300,000 - 1,700,000; Full time

Job summary

A technology consulting firm in Bengaluru is looking for a Data Engineer with 5 to 8 years of experience. Responsibilities include designing big data solutions and collaborating with teams to ensure data consistency. The ideal candidate should be proficient in Azure Databricks, PySpark, and have strong skills in Python and SQL. This hybrid role offers a competitive salary in the range of 13 to 17 lacs.

Qualifications

• 5 to 8 years of data engineering experience.
• Hands-on experience in Databricks stack.
• Proficiency in Python and SQL.

Responsibilities

• Design and implement big data solutions.
• Partner with business to understand requirements.
• Research and incubate new technologies.

Skills

Azure Databricks

PySpark

SQL

Data Engineering technologies

Python

Streaming technologies

ETL tools

Tools

Databricks

AWS

Azure

GCP

Bitbucket

Jira

Confluence

Job description

Azure Databricks Data Engineer| 5 to 8 Years| Gyansys | Hybrid

Job Openings Azure Databricks Data Engineer| 5 to 8 Years| Gyansys | Hybrid

About the job Azure Databricks Data Engineer| 5 to 8 Years| Gyansys | Hybrid

Position: Data Engineer
Experience: 5 to 8 years
Primary Skills: Azure Databricks, PySpark, SQL (M)
Secondary Skills: ADF (Azure Data Factory) (M)
Project Exposure: Cloud migration (M)
Location: Bengaluru/Hyderabad
Mode of Work: Hybrid
Salary: 13 lac to 17 lac
Notice Period: 15 to 30 Days (M)

Responsibilities:

• Work as part of a global distribution team to design and implement Hadoop big data solutions in alignment with business needs and project schedules.
• 5+ years of data warehousing/engineering, software solutions design, and development experience.
• Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
• Work with other Big Data developers to make sure that all data solutions are consistent.
• Partner with the business community to understand requirements, determine training needs, and deliver user training sessions.
• Perform technology and product research to better define requirements, resolve important issues, and improve the overall capability of the analytics technology stack.
• Evaluate and provide feedback on future technologies and new releases/upgrades.
• Support Big Data and batch/real-time analytical solutions leveraging transformational technologies.
• Work on multiple projects as a technical team member or drive:
  • User requirement analysis and elaboration
  • Design and development of software applications
  • Testing and build automation tools
• Research and incubate new technologies and frameworks.
• Experience with agile or other rapid application development methodologies and tools like Bitbucket, Jira, and Confluence.
• Have built solutions with public cloud providers such as AWS, Azure, or GCP.
• Hands-on experience in Databricks stack
• Data Engineering technologies (Ex: Spark, Hadoop, Kafka, etc.)
• Proficiency in Streaming technologies
• Hands-on experience in Python and SQL
• Expertise in implementing Data Warehousing solutions
• Expertise in any ETL tool (e.g., SSIS, Redwood)
• Good understanding of submitting jobs using Workflows, API & CLI