Data Engineer PostGres and DataBricks

Digital Biz Solutions; Ernakulam; On-site; INR 8,00,000 - 12,00,000; Full time

Job summary

A forward-thinking product and engineering firm in Ernakulam, India is seeking an Experienced Data Engineer skilled in DataBricks or PostgreSQL. Responsibilities include designing scalable data systems and collaborating with diverse teams. Ideal candidates should have at least 3 years of experience, proficiency in Python or Azure, and strong skills in data management and ETL processes. Join a dynamic team and engage with cutting-edge technologies.

Benefits

Competitive salary

Attractive benefits

Opportunities for personal growth

Qualifications

• Minimum of 3 years of experience in a Data Engineering role.
• Proficiency in DataBricks or PostgreSQL.
• Proficiency in Python or Azure cloud data engineering.
• Strong experience in data modeling and ETL development.
• Experience supporting cross-functional teams.

Responsibilities

• Design and maintain scalable data management systems.
• Develop scalable data pipelines and manage API integrations.
• Collaborate with teams to support data infrastructure needs.
• Create custom software components and analytics applications.

Skills

DataBricks

PostgreSQL

Python

Azure Cloud Data Engineering

Data Management

ETL Processes

Tools

Hadoop

Spark

Kafka

Job description

Dbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways.

We are looking for an Experienced Data Engineer with a strong background in DataBricks or PostgreSQL, and proficiency in Python or Azure cloud data engineering. The ideal candidate will have at least 3 years of experience in a Data Engineering role and possess a deep understanding of data management and ETL processes.

Responsibilities:

• Design, construct, install, test, and maintain highly scalable data management systems.
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Collaborate with stakeholders including the Executive, Product, Data, and Design teams to address data-related technical issues and support their data infrastructure needs.
• Develop processes for data mining, data modeling, and data production.
• Work closely with data scientists and architects on multiple projects.
• Ensure systems meet business requirements and adhere to industry practices.
• Integrate new data management technologies and software engineering tools into existing structures.
• Create custom software components and analytics applications.

Requirements:

• Minimum of 3 years of experience in a Data Engineering role.
• Proficiency in DataBricks or PostgreSQL.
• Proficiency in Python or experience with Azure cloud data engineering.
• Proven experience in building and optimizing big data pipelines, architectures, and data sets.
• Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong experience in data modeling, ETL development, and data warehousing, or similar skills.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Nice to Have:

• Experience with AWS or other cloud services.
• Experience with big data tools such as Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases.
• Familiarity with Salesforce.

Why Join Us:

• Be part of a dynamic team that is shaping the future of data engineering
• Engage with cutting-edge technologies and innovative projects.
• Opportunity to collaborate with a diverse group of professionals in a fast-paced environment.

Life at Dbiz

• Competitive salary and attractive benefits.
• Dynamic and innovative work environment.
• Opportunities for personal growth and development.
• Engaging and collaborative company culture.