Senior Data Engineer- Databricks

InfoCepts; Pune District; On-site; INR 800,000 - 1,500,000; Full time

Job summary

InfoCepts is seeking a Full-time Data Engineer located in Maharashtra, India to develop, support, and steer business intelligence using Databricks. The ideal candidate will have over 5 years of experience in Data Engineering, proficiency in Python and SQL, and experience in the Retail domain. The responsibilities include translating technical requirements, maintaining python code, and building scalable applications for data analytics. This role requires effective communication and collaboration skills across different time zones.

Qualifications

• 5+ years of relevant experience in Data Engineering.
• Demonstrated continued learning through one or more technical certifications or related methods.
• Relevant experience in the Retail domain.

Responsibilities

• Work with business analysts and data architects to translate requirements into technical implementations.
• Develop, implement, and maintain python code through Databricks UI that enables data and analytics use cases for the client.
• Code, test, and ss robust and scalable applications for data analytics.

Skills

Databricks

Python

SQL

Data warehousing concepts

Google Pub/Sub/Kafka/MongoDB

Education

Bachelor's degree in computer science, engineering, or related field

Tools

Snowflake

Google Cloud

Job description

Type of Employment

Full-time

Purpose of the Position

Develop, support and steer end-to-end business intelligence using Databricks.

Key Responsibilities

• Work with business analysts and data architects to translate requirements into technical implementations.
• Develop, implement, and maintain python code through Databricks UI that enables data and analytics use cases for the client
• Code, test, and ss robust and scalable applications for data analytics.

Essential Skills

• 3+ Hands on Experience with Databricks and Python.
• Proficiency in SQL and data manipulation skills.
• Understanding of data warehousing concepts and technologies.
• Understanding of Google Pub sub/Kafka/Mongo DB.
• Familiarity with ETL processes and tools for data extraction, transformation, and loading.
• Knowledge of cloud platforms like Snowflake, Google Cloud.
• Familiarity with data governance and data quality best practices.

Qualifications

• 5+ years of relevant experience in Data Engineering.
• Bachelor's degree in computer science, engineering, or related field
• Demonstrated continued learning through one or more technical certifications or related methods.
• Relevant experience in Retail domain.

Qualities

• Self-motivated and focused on delivering outcomes for a fast-growing team and firm.
• Able to communicate persuasively through speaking, writing, and client presentations.
• Able to consult, write, and present persuasively.
• Able to work in a self-organized and cross-functional team.
• Able to iterate based on new information, peer reviews, and feedback.
• Able to work with teams and clients in different time zones.