Sr. Developer

Cognizant; Hyderabad; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading technology services company is seeking a highly skilled Sr. Developer to join their team in Hyderabad. The ideal candidate will have 8 to 12 years of experience and strong expertise in Delta Sharing, Databricks Unity Catalog Admin, and various data technologies. Responsibilities include developing and optimizing data solutions, managing workflows, and ensuring data integrity. This role operates in a hybrid model with day shifts, emphasizing innovation in data solutions to support risk management and operational efficiency.

Qualifications

• 8 to 12 years of experience in software development.
• Strong experience in Delta Sharing and Databricks Unity Catalog Admin.
• Proficiency in Python and PySpark for data processing.

Responsibilities

• Develop and optimize data solutions using Delta Sharing and Databricks Unity Catalog Admin.
• Implement and manage Databricks CLI and Delta Live Pipelines.
• Utilize Structured Streaming for real-time data processing.
• Apply risk management strategies to ensure data integrity.
• Integrate Apache Airflow to enhance data workflow automation.
• Leverage Amazon S3 and Amazon Redshift for data storage.
• Write Python scripts for automating data processing tasks.
• Use Databricks SQL for advanced data querying.
• Design Databricks Workflows to manage data pipelines.
• Develop PySpark applications for processing large datasets.

Skills

Delta Sharing

Databricks Unity Catalog Admin

Databricks CLI

Delta Live Pipelines

Structured Streaming

Risk Management

Apache Airflow

Amazon S3

Amazon Redshift

Python

Databricks SQL

Databricks Delta Lake

Databricks Workflows

PySpark

Job description

Overview

Job Title: Sr. Developer

Job Summary: We are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our dynamic team. The ideal candidate will have expertise in Delta Sharing, Databricks Unity Catalog Admin, and other key technologies. This role involves working in a hybrid model during day shifts focusing on developing and optimizing data solutions. The candidate will contribute to our company's mission by enhancing data management processes, ensuring efficient data flow and supporting risk management strategies.

Experience

8 - 12 years

Required Skills

• Technical Skills: Delta Sharing, Databricks Unity Catalog Admin, Databricks CLI, Delta Live Pipelines, Structured Streaming, Risk Management, Apache Airflow, Amazon S3, Amazon Redshift, Python, Databricks SQL, Databricks Delta Lake, Databricks Workflows, PySpark
• Domain Skills: (as listed in original)

Nice to have skills

• Domain Skills:

Responsibilities

• Develop and optimize data solutions using Delta Sharing and Databricks Unity Catalog Admin to enhance data accessibility and security.
• Implement and manage Databricks CLI and Delta Live Pipelines to streamline data processing workflows.
• Utilize Structured Streaming to ensure real-time data processing and analysis improving decision-making capabilities.
• Apply risk management strategies to identify and mitigate potential data-related risks ensuring data integrity and compliance.
• Integrate Apache Airflow for orchestrating complex data workflows enhancing automation and efficiency.
• Leverage Amazon S3 and Amazon Redshift for scalable data storage and retrieval supporting large-scale data operations.
• Write and maintain Python scripts to automate data processing tasks improving operational efficiency.
• Utilize Databricks SQL and Databricks Delta Lake for advanced data querying and storage solutions optimizing data performance.
• Design and implement Databricks Workflows to automate and manage data pipelines ensuring seamless data flow.
• Develop PySpark applications to process large datasets enhancing data processing capabilities.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
• Monitor and troubleshoot data workflows to ensure smooth operations and timely issue resolution.
• Stay updated with the latest industry trends and technologies to continuously improve data solutions.

Qualifications

• Possess strong experience in Delta Sharing and Databricks Unity Catalog Admin essential for data management.
• Demonstrate proficiency in Databricks CLI and Delta Live Pipelines crucial for workflow optimization.
• Have a solid understanding of Structured Streaming and risk management important for data integrity.
• Experience with Apache Airflow, Amazon S3, and Amazon Redshift valuable for data orchestration and storage.
• Proficient in Python and PySpark necessary for scripting and data processing tasks.

Job Location

Primary Location: INTSHYDA15 (ITIND GAR - Tower – 5 HYD - GAR STD)

Alternate Location: NA

Job Type

Sr. Associate - Projects [60PM00]

Demand Requires Travel?

No

Certifications Required

NA