Data Engineer

Bitwise Inc.; Pune District; Hybrid; INR 600,000 - 1,000,000; Full time

Benefits offered by this job

Long Service awards

Retirement Benefits

Opportunity to work on cutting-edge technologies

Unlimited career progression pathways

Job summary

Bitwise Inc. is seeking a skilled professional in Pune for enhancing performance using PySpark and maintaining complex SQL queries. The ideal candidate will have extensive experience in ETL processes, strong analytical skills, and expertise in Azure technologies. This role offers competitive salaries, long service awards, and significant career progression opportunities. Excellent communication and leadership abilities are vital for interacting with both technical and non-technical stakeholders in a hybrid work environment.

Qualifications

• Extensive experience with PySpark specializing in optimizing jobs for performance and scalability.
• Experience in redesigning and maintaining complex SQL queries and stored procedures.
• Strong knowledge of ETL concepts and tools.
• Excellent analytical and troubleshooting skills.
• Strong proficiency in SQL with relational databases.
• Excellent verbal and written communication skills.
• Expertise in ADF or Azure Synapse Data flows and pipelines.

Responsibilities

• Lead and mentor a team of developers, providing technical guidance and support.
• Utilize basic Unix commands and shell scripting.
• Work on Pyspark applications on Azure.

Skills

PySpark optimization

SQL query design and maintenance

ETL concepts

Analytical skills

SQL proficiency

Communication skills

ADF or Azure Synapse expertise

Tools

SQL Server

MySQL

Azure

Job description

1)Extensive experience with PySpark specializing in optimizing PySpark jobs for enhanced performance and scalability.

3)Experience on redesigning and maintaining complex SQL queries and stored procedures

4)Strong knowledge of ETL concepts and tools.

5)Excellent analytical skills, troubleshooting skills

6)Strong proficiency in SQL and experience with SQL Server, MySQL, or other relational databases.

7)Excellent verbal and written communication skills for effectively interacting with both technical and non-technical stakeholders.

8)Expertise on ADF or Azure Synapse Data flows and pipelines.

Good to have skills

1)Basic Unix commands, Shell scripting

2)Ability to lead and mentor a team of developers, providing technical guidance and support.

3)Experience of Pyspark on Azure

Competitive salary on par with industry benchmarks

Long Service awards and Retirement Benefits

Opportunity to work on cutting-edge technologies

Unlimited career progression pathways with continual performance management

Salary: Best in the industry

Compensation and Benefits

• Best in the industry

Salary: Best in the industry

Location: Pune/Hybrid