AI-Driven Data Engineer for Enterprise Pipelines

Socket.dev; Leawood (KS); On-site; USD 100,000 - 150,000; Full time

Job summary

SCOR is seeking a Data Engineer to design, build, and operate reliable data pipelines and analytics-ready datasets powering reporting and decision-making. You will develop ETL/ELT processes using Python, Azure Databricks, and SQL, integrating data across Microsoft SQL Server and PostgreSQL.

You will partner with analysts, data consumers, and engineering teams to translate business requirements into scalable, well-governed data products with strong testing, monitoring, performance, and data

Qualifications

• Experience designing, building, and operating reliable data pipelines and analytics-ready datasets.
• Proficient in Python, Azure Databricks, and SQL for ETL/ELT processes.
• Ability to integrate data across MS SQL Server and PostgreSQL with governance.

Responsibilities

• Design, build, and operate data pipelines and analytics-ready datasets.
• Optimize ETL/ELT processes and ensure data quality and governance.
• Collaborate with analysts, data consumers, and engineering teams to deliver scalable data products.
• Apply testing, monitoring, and performance enhancements to data workflows.
• Explore AI-assisted tools to enhance productivity and solution quality and ensure responsible AI principles.

Skills

Python

ETL/ELT design

SQL

Data pipelines

Data governance

Testing & monitoring

Data quality

AI integration

Tools

Azure Databricks

Microsoft SQL Server

PostgreSQL

Job description

SCOR is seeking a Data Engineer to design, build, and operate reliable data pipelines and analytics-ready datasets powering reporting and decision-making. You will develop ETL/ELT processes using Python, Azure Databricks, and SQL, integrating data across Microsoft SQL Server and PostgreSQL.

You will partner with analysts, data consumers, and engineering teams to translate business requirements into scalable, well-governed data products with strong testing, monitoring, performance, and data