Data Engineer - Snowflake and DBT

Quarks Technosoft Pvt. Ltd.; Bengaluru; Sur place; INR 1 800 000 - 3 000 000; Plein temps

Résumé du poste

Sony Interactive Entertainment is seeking a Senior Data Engineer to design, build, and operate trusted enterprise data products. You will turn complex, high-volume source data into secure, well-modeled, analytics-ready datasets and services that enable timely business decisions.

You will collaborate with analysts, stakeholders and platform teams, combining hands-on delivery with pragmatic leadership. You will work across data architecture, pipeline development, data quality, release automation

Qualifications

• Bachelor's or master's degree in computer science, engineering, mathematics or a related discipline, or equivalent practical experience.
• Substantial experience designing and operating enterprise data pipelines and data warehouses in production.
• Advanced SQL skills and hands-on experience with Python and/or PySpark for data processing and automation.
• Deep experience with Snowflake, including performance optimization, security, workload management and scalable data modeling.
• Experience building ETL/ELT solutions with dbt, Informatica PowerCenter or comparable transformation and integration tools.
• Hands-on experience implementing CI/CD pipelines for data engineering workloads using Git-based workflows and automated testing/deployment tools.
• Experience building automated data quality systems with measurable rules, alerting, lineage and issue-resolution workflows.
• Strong grounding in data profiling, cleansing, standardization, reconciliation and production data validation.
• Ability to gather ambiguous requirements, make sound design decisions and communicate effectively with technical and non-technical partners.

Responsabilités

• Turn complex, high-volume source data into secure, well-modeled analytics-ready datasets and services.
• Design, build and operate enterprise data products across architecture, pipelines, data quality, release automation and production operations.
• Partner with analysts, business stakeholders and platform teams to deliver timely business insights.
• Lead through engineering practice, set coding and testing standards, review designs and coordinate delivery across teams.

Connaissances

Snowflake

SQL

Python

PySpark

dbt

ETL/ELT

Formation

Bachelor's or master's degree in computer science / engineering / mathematics or related discipline

Outils

Informatica PowerCenter

dbt

Great Expectations

Soda

Deequ

Description du poste

Please find the detailed job description below;

Mandatory Skills: Snowflake,SQL,Python,PySpark,dbt,ETL/ELT

Job Description

Required qualifications

• Bachelor's or master's degree in computer science, engineering, mathematics or a related discipline, or equivalent practical experience.
• Substantial professional experience designing and operating enterprise data pipelines and data warehouses in production.
• Advanced SQL skills and strong hands-on experience with Python and/or PySpark for data processing and automation.
• Deep experience with Snowflake, including performance optimization, security, workload management and scalable data modeling.
• Experience building ETL/ELT solutions with dbt, Informatica PowerCenter or comparable transformation and integration tools.
• Hands-on experience implementing CI/CD pipelines for data engineering workloads using Git-based workflows and automated testing/deployment tools.
• Experience building automated data quality systems with measurable rules, alerting, lineage and issue-resolution workflows.
• Strong grounding in data profiling, cleansing, standardization, reconciliation and production data validation.
• Ability to gather ambiguous requirements, make sound design decisions and communicate effectively with technical and non-technical partners.

Preferred qualifications

• Snowflake SnowPro Core or comparable cloud data certification.
• Experience with REST API, event and/or streaming data, and high-volume security or operational datasets.
• Familiarity with data observability and quality frameworks such as dbt tests, Great Expectations, Soda or Deequ.
• Experience delivering data solutions in regulated, security-sensitive, healthcare, telecommunications or audit-oriented environments.
• Demonstrated technical leadership, mentoring or delivery coordination across a small engineering team.
• Design and deliver scalable pipelines. Build batch and near-real-time ETL/ELT pipelines using SQL, Python and PySpark, with Snowflake as a primary cloud data platform.
• Engineer reliable data models. Create dimensional, normalized and analytical models that support efficient querying, traceability and reuse across enterprise reporting and analytics.
• Own data quality by design. Implement automated profiling, schema checks, reconciliation, completeness, freshness, uniqueness and business-rule validation; publish quality results and route failures for action.
• Build CI/CD for data products. Create and maintain automated build, test and deployment pipelines for SQL, dbt, orchestration code and infrastructure configuration, including version control, peer review, environment promotion and safe rollback.
• Strengthen observability and operations. Monitor pipeline health, lineage, cost, performance and service-level objectives; troubleshoot incidents, perform root-cause analysis and eliminate recurring manual support.
• Integrate diverse sources. Ingest and standardize data from databases, APIs, files and event sources, applying secure access patterns and appropriate handling for sensitive information.
• Modernize legacy workflows. Migrate or refactor Informatica PowerCenter and other legacy ETL processes into maintainable cloud-native patterns using tools such as dbt and modern orchestration platforms.
• Partner from requirement to adoption. Translate stakeholder needs into technical designs, validate production outcomes and communicate tradeoffs, risks and delivery progress clearly.
• Lead through engineering practice. Set coding and testing standards, review designs and pull requests, mentor engineers and coordinate delivery across cross-functional teams.

Sony Interactive Entertainment is seeking a Senior Data Engineer to design, build, and operate trusted enterprise data products. This role turns complex, high-volume source data into secure, well-modeled, analytics-ready datasets and services that enable timely business decisions. The engineer will work across data architecture, pipeline development, data quality, release automation, and production operations while partnering closely with analysts, business stakeholders, and platform teams. The ideal candidate combines hands-on delivery with clear thinking, pragmatic leadership and strong ownership.