DGS India - Pune - Indiqube Orchid / Technology

Merkle Inc.; Pune District; On-site; INR 2,600,000 - 3,800,000; Full time

Job summary

Merkle Inc. in Pune seeks a senior data engineer to oversee development of database marketing solutions using Azure Synapse, Databricks, and Data Factory. You will design, develop, troubleshoot, and optimize data pipelines while collaborating with clients to understand business needs.

The role requires CI/CD, streaming experience (Kafka/Kinesis), and mentoring junior team members. You will communicate complex tech to non-technical stakeholders and deliver robust designs and documentation.

Qualifications

• Bachelor’s or Master Degree or equivalent Degree.
• Strong SQL and Spark SQL.
• Experience with Azure Synapse, Databricks and Data Factory.
• Hands-on with Snowflake and Oracle; relational/non-relational databases.
• Proficiency in Python or UNIX shell; PySpark.
• Experience with streaming tech like Kafka/Kinesis and Spark Streaming or Flink.
• Strong debugging and performance optimization skills.
• Excellent client-facing communication and collaboration.
• Proficiency with version control (SVN) and project tools (JIRA).

Responsibilities

• Design and implement scalable, high‑quality data engineering solutions for clients.
• Translate business requirements into technical designs and deliver within timelines.
• Develop, optimize, and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, and other tools.
• Create and maintain HLD/LLD documentation and explain architectural decisions.
• Troubleshoot production issues with root‑cause analysis.
• Lead and participate in code reviews and ensure standards.
• Independently handle mid‑to complex development tasks and mentor team members.
• Collaborate with cross‑functional teams and clients to ensure delivery.
• Manage 1–2 projects with small teams (2–3 members).
• Ensure efficient Workflow using Tivoli/Tidal/Stonebranch.
• Maintain documentation and project clarity for stakeholders.

Skills

SQL and Spark SQL

Client-facing communication

Mentoring/leadership

ETL/ELT

CI/CD

Data modeling

Debugging/Performance

Education

Bachelor’s or Master Degree

Tools

Azure Synapse

Azure Databricks

Azure Data Factory

Azure Data Lake Storage/Blob Storage

Azure SQL Database

Snowflake

Oracle

PySpark

Python/UNIX shell

Kafka/Kinesis

Spark Streaming/Flink

JIRA/SVN

Job description

The purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design, development, troubleshooting, and issue resolution.

The role involves upgrading, enhancing, and optimizing the technical solution. It involves continuous integration and continuous deployment of various requirements changes in the business logic implementation. Interactions with internal stakeholders and/or clients to explain technology solutions and a clear understanding of client’s business requirements through which to guide optimal design/solution to meet their needs.

The ability to communicate to both technical and non-technical audiences is key.

Must have skills

• Demonstrated expertise in Microsoft Azure, including Synapse, Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Blob Storage, and Azure SQL Database.
• Strong understanding of data warehousing, data marts, data modeling, data structures, and database design.
• Proficiency in ETL processes, data ingestion, transformation, and orchestration.
• Strong command of SQL and Spark SQL.
• Hands‑on experience with Snowflake, Azure Synapse (mandatory), Oracle, and relational databases.
• Practical experience with PySpark and scripting in Python or UNIX shell.
• Experience with streaming technologies such as Kafka or Kinesis.
• Familiarity with real‑time data processing frameworks like Spark Streaming or Flink.
• Strong debugging and performance optimization skills.
• Ability to independently deliver mid‑ to complex‑level tasks.
• Strong communication and client‑facing experience.
• Proficiency with version control systems (e.g., SVN) and project management tools (e.g., JIRA).
• Comprehensive understanding of both relational and non‑relational databases.

Good to have skills

• Experience with data marketing platforms and campaign management systems.
• Familiarity with SSIS and Informatica in addition to Azure Data Factory.
• Knowledge of enterprise data workflow schedulers (Tivoli, Tidal, Stonebranch).
• Strong understanding of modern development methodologies and SDLC principles.
• Ability to mentor team members and contribute to solution design discussions.Should have an experience in Technical Lead/ team management experience.Understanding of Generative AI.

Key responsibiltes

• Design and implement scalable, high‑quality data engineering solutions for clients.
• Translate documented business requirements into technical designs and deliver solutions within defined timelines.
• Develop, optimize, and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, and other enterprise tools.
• Create and maintain HLD (High-Level Design) and LLD (Low-Level Design) documentation and explain architectural decisions to internal teams.
• Troubleshoot and resolve production issues quickly with effective root‑cause analysis.
• Lead and participate in code reviews, ensuring adherence to development standards and best practices.
• Independently handle medium to complex development and data engineering tasks.
• Collaborate closely with cross‑functional internal teams and external clients to ensure successful delivery.
• Manage or contribute to 1–2 projects simultaneously, typically involving small teams (2–3 members).
• Ensure efficient workflow execution using orchestration/scheduling tools like Tivoli, Tidal, or Stonebranch.
• Maintain strong documentation and ensure project clarity for stakeholders.

Education Qulification

1. Bachelor’s or Master Degree or equivalent Degree

Certification If Any

12 PM to 9 PM and / or 2 PM to 11 PM - IST time zone