Db2 Senior Engineer

Tata Consultancy Services; Oregon; Hybrid; USD 100,000 - 130,000; Full time

Benefits offered by this job

Discretionary annual incentive

Comprehensive medical coverage

Dental & Vision coverage

Parental leave

Job summary

Tata Consultancy Services Limited seeks a DB2 Senior Engineer to drive migration of IBM DB2 data and workloads to the Databricks Lakehouse. You will analyze DB2 objects, modernize SQL and ETL workflows, validate migrated data, and optimize high-volume Databricks workloads.

The role requires 10+ years of experience with IBM DB2, Databricks, and data-engineering in a property and casualty insurance context. Remote work option with collaboration across enterprise teams.

Qualifications

• 10+ years of DB2 data-engineering experience with migration to Databricks.
• Proficient in Python and PySpark for ETL/ELT tasks.
• Experience modernizing SQL, stored procedures, and legacy workflows.
• Familiar with Databricks Unity Catalog and data governance tools.
• Strong data-quality validation and reconciliation capabilities.
• Knowledge of insurance domain helpful.

Responsibilities

• Analyze DB2 databases and migrate objects to Databricks Lakehouse.
• Design scalable ETL/ELT pipelines between DB2 and Databricks.
• Validate migrated data and ensure data quality.
• Translate security grants to Unity Catalog controls.
• Optimize Spark jobs and Databricks workloads.
• Collaborate with business, cloud, and architecture teams.

Skills

Databricks

DB2 migration

ETL/ELT pipelines

SQL/Stored procedures

Python/PySpark

Data quality

AI and GenAI in data eng

Prompt engineering

Data migration tooling

DB2 LUW

Mainframe TSO/ISPF

DB2 Catalog SQL

Tools

Databricks Unity Catalog

DBeaver

Data Studio

Lakebridge Analyzer

DB2 LUW tools

Job description

Role - DB2 Senior Engineer

Location - Remote

Experience Required - 10+ years

Job Summary

Design and develop scalable data-engineering solutions supporting the migration of IBM DB2 data and workloads to the Databricks Lakehouse. Analyze DB2 database objects and dependencies, modernize SQL and legacy ETL workflows, validate migrated data, and optimize high-volume Databricks workloads. Collaborate with business, data engineering, cloud, and architecture teams on enterprise data-modernization initiatives.

Must Have Technical/Functional Skills

• IBM DB2 and AS400
• Databricks
• DB2-to-Databricks data migration
• ETL and ELT pipeline development
• DB2 schemas, tables, views, aliases, stored procedures, functions, triggers, and sequences
• DB2 Catalog SQL
• DB2 LUW command-line and SQL clients, including DBeaver and Data Studio
• Mainframe TSO/ISPF
• Lakebridge Analyzer
• Databricks Unity Catalog
• SQL and stored-procedure modernization
• Data-quality validation and reconciliation
• Python and PySpark
• Property and casualty insurance domain knowledge
• AI and generative AI capabilities for data engineering and migration, as an added advantage

Roles & Responsibilities

• Analyze and extract data from IBM DB2 databases for migration to the Databricks Lakehouse.
• Design and develop scalable ETL and ELT pipelines connecting DB2 and Databricks.
• Extract inventories of DB2 schemas, tables, views, aliases, stored procedures, functions, triggers, and sequences.
• Perform database-object and dependency validations.
• Convert DB2 SQL, stored procedures, and legacy ETL workflows into scalable Databricks solutions.
• Translate DB2 security grants and sensitive-data access controls into corresponding controls using Databricks Unity Catalog.
• Apply knowledge of DB2 structures and data models supporting property and casualty insurance products.
• Validate data quality, reconciliation, completeness, and migration accuracy between source and target platforms.
• Optimize high-volume data ingestion, transformations, Spark jobs, and Databricks workloads.
• Collaborate with business, data engineering, cloud, and architecture teams supporting data-modernization programs.
• Use Databricks AI and machine-learning capabilities to support AI-enabled data-engineering and migration solutions.
• Use generative AI or AI coding assistants to accelerate code analysis, conversion, documentation, and modernization.
• Apply large language models and prompt engineering to SQL transformation, code explanation, dependency analysis, and migration-artifact generation.
• Build or use AI-assisted data-quality and reconciliation frameworks to identify anomalies, schema mismatches, transformation discrepancies, and migration defects.
• Apply retrieval-augmented generation patterns to database metadata, data dictionaries, mapping documents, and migration knowledge bases.
• Develop Python- or PySpark-based automation utilities for metadata discovery, schema mapping, code conversion, test-case generation, and migration validation.
• Integrate AI-assisted development into CI/CD and data-engineering workflows.

Base Salary Range :

$100,000 to $130,000 Per Annum

TCS Employee Benefits Summary:

"Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. Family Support: Maternal & Parental Leaves. Insurance Options: Auto & Home Insurance, Identity Theft Protection. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement. Time Off: Vacation, Time Off, Sick Leave & Holidays. Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing."