https:/www.cdwjobs.com/jobs/11855463-sr-software-engineer-ii-cloud-azure-data

CDW; Illinois City (IL); On-site; USD 120,000 - 170,000; Full time

Job summary

CDW is seeking a Senior Software Engineer II - Data to design and operationalize scalable data pipelines for enterprise analytics. The role focuses on building robust data flows, enabling business analysts and data scientists to access curated data for insights and decisions.

You will work across teams to implement modern data architectures, improve data models for BI consumption, and mentor peers while ensuring governance and data quality.

Qualifications

• BS or MS degree in Computer Science or related field.
• 7+ years data application development experience.
• Experience with Data Warehouse, Data Lake or Data Hub architectures.
• Strong SQL, PL/SQL and Python skills for relational and NoSQL databases.
• Ability to build rapport and collaborate cross‑functionally with stakeholders.
• Ability to coach and mentor others.
• Excellent written and verbal communication skills with stakeholders.

Responsibilities

• Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using big data technologies and SQL.
• Collaborates with business teams to improve data models that feed BI tools and enable data-driven decisions.
• Collaborate with data science teams to create datasets for analytics, ML, clustering and predictions.
• Automate repetitive data preparation and integration tasks to improve productivity.
• Train data scientists and analysts in data pipelines and data preparation techniques.
• Ensure compliance and governance during data use.
• Be curious and apply new data management techniques to solve problems.

Skills

Data pipelines

SQL

Python

Data governance

Cross-functional collaboration

Mentoring

Communication

Education

BS or MS in Computer Science

Tools

Azure Data Factory

Databricks

Microsoft SQL Server

SSIS

Informatica

Job description

Overview

The Senior Software Engineer II - Data will play a pivotal role in building and operationalizing the minimally inclusive data necessary for the enterprise data and analytics initiatives following best practices. The bulk of the data engineer's work would be in building, managing and optimizing data pipelines and then moving these data pipelines effectively into production for key data and analytics consumers like business/data analysts, data scientists or any persona that needs curated data for data and analytics use cases across the enterprise.

Key Areas of Responsibility

• Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
• Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using big data technologies and SQL.
• Collaborates with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Collaborate with other technology teams to help engineer data sets that data science teams uses to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning.
• Responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
• Train counterparts such as data scientists, data analysts, data consumers in data pipelines and preparation techniques, which make it easier for them to integrate and consume the data they need for their own use cases.
• Helps ensure compliance and governance during use of data.
• Be curious and knowledgeable about new data management techniques and how to apply them to solve business problems.

Education and/or Experience Qualifications

• BS or MS degree in Computer Science or a related technical field.
• 7+ years data application development experience

Required Qualifications

• Strong experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management.
• Extensive experience with popular data processing languages including SQL, PL/SQL, Python, others for relational databases and on NoSQL/Hadoop oriented databases like MongoDB, Cassandra, others for nonrelational databases.
• Demonstrated ability to build rapport and maintain productive working relationships cross-departmentally and cross-functionally.
• Demonstrated ability to coach and mentor others.
• Excellent written and verbal communication skills with the ability to effectively interact with and present to all stakeholders including senior leadership.
• Strong organizational, planning and creative problem solving-skills with critical attention to detail.
• Demonstrated success of facilitation and solutions implementation.
• History of balancing competing priorities with the ability to adapt to the changing needs of the business while meeting deadlines.

Preferred Qualifications

• Extensive experience with Azure Data Factory
• Extensive experience working with cloud platform (at least one of Azure, AWS, GCP)
• Experience with ETL Tools (SSIS, Informatica, Ab Initio, Talend), Python, Databricks, Microsoft SQL Server Platform (version 2012 or later), and/or working in an Agile environment