Data Engineer: AI-Driven Pipelines in Azure Databricks

Cognizant; Irvine (CA); In loco; USD 64.000 - 95.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical/Dental/Vision/Life Insurance

Paid holidays plus PTO

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Descrizione del lavoro

Cognizant is seeking an experienced data/ETL engineer to develop and optimize data pipelines, APIs, and BI data models in an on-site Irvine environment. You will leverage AI-assisted tools to accelerate coding while ensuring quality before production.

Responsibilities include enhancing SQL Server jobs, integrating with external systems, tuning performance, and providing production support for hundreds of data integration jobs. Strong English communication is essential.

Competenze

• 5+ years of hands-on Microsoft SQL Server and T-SQL development experience.
• Advanced set-based T-SQL with window functions and CTEs; deduplication and up-to-date-key patterns.
• SQL Server Agent – building, scheduling, monitoring and troubleshooting job chains.
• SSIS – developing and maintaining packages and debugging failures.
• Azure Databricks – Notebooks, jobs/workflows, Spark SQL/PySpark, Delta Lake.
• MuleSoft – API integrations development and production monitoring.
• AI-assisted development tools usage with review, testing and validation before production.
• Performance tuning through execution plans, indexes and statistics; production support discipline.
• Strong written and spoken English; on-site Irvine, CA work requirement.

Mansioni

• Experience with AI-assisted development tools to accelerate coding, troubleshooting, and documentation while reviewing AI output before production.
• Develop new data pipelines in Azure Databricks and contribute to the enterprise data lakehouse.
• Enhance and extend SQL Server Agent jobs, stored procedures, views and SSIS packages with required schema changes.
• Develop and extend data integrations with external systems and APIs using MuleSoft.
• Write and tune complex T-SQL against large data volumes; analyze execution plans and apply indexing and statistics strategies.
• Build and maintain data models and datasets for Power BI reporting, including publishing, scheduled refresh and gateway configuration.
• Perform data validation, reconciliation and data-quality checks across source and target systems.
• Provide production support for ~300 data integration jobs: monitor, triage, diagnose and resolve failures; root-cause analysis.

Conoscenze

AI-assisted tools

Azure Databricks

SQL / T-SQL

Power BI data modeling

Data integration

MuleSoft

Data quality checks

Production support

Strumenti

Azure Databricks

SQL Server Agent

SSIS

MuleSoft

Databricks Genie

Claude Code

Cursor

OpenRouter

Descrizione del lavoro

Cognizant is seeking an experienced data/ETL engineer to develop and optimize data pipelines, APIs, and BI data models in an on-site Irvine environment. You will leverage AI-assisted tools to accelerate coding while ensuring quality before production.

Responsibilities include enhancing SQL Server jobs, integrating with external systems, tuning performance, and providing production support for hundreds of data integration jobs. Strong English communication is essential.