Senior Data Engineer: Real-Time Data Pipelines Lead

Save A Lot; St. Ann (MO); On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

401K match

Paid Time Off

Medical insurance

Vision insurance

Dental insurance

Employee assistance programs

Tuition reimbursement

Wellbeing program

Career development

Job summary

Save A Lot is seeking an IT Engineer Senior Data to design and develop interfaces for the Data Platforms and Data Insights teams, enabling data ingestion into the Cloud environment, landing zone and Enterprise Data Warehouse.

You will build ETL jobs, data models, and pipelines, use SQL, Python, Informatica, Azure Data Factory and SSIS, and collaborate with business, security and risk teams to deliver reliable, scalable data solutions.

Qualifications

• Bachelor's degree in computer science, engineering or related field of study.
• 3 years IT experience
• 3 years delivering high-profile projects in a complex enterprise environment
• 3 years developing and delivering data engineering solutions in data warehousing
• 3 years developing with data-specific coding languages like SQL
• 1-3 years developing and optimizing Multi-Parallel Processing databases like Teradata, Azure SQL DW, Big Query, or Snowflake
• 1-3 years developing and optimizing integration tools like Informatica, Azure Data Factory, or SSIS
• Proficient in integrating data in diverse technical environments
• Strong planning and organizational skillsExperience in measuring and communicating the value of data platforms and tools
• Experience in multiple enterprise environments, industries and development methodologies

Responsibilities

• Act as an expert in the areas of data engineering, architecture, advanced analytics, or data science
• Create data interfaces and scripts to load the enterprise data warehouse, data lake, data marts and other analytics environments to support enterprise-wide data consumption
• Build an enterprise data pipeline to improve access to real/near-real-time data across the enterprise
• Design and develop ETL (Extract, Transform, and Load) jobs within the data warehouse and other data platforms
• Create templates and engineering patterns to reduce the time-to-deploy new data assets or changes to an existing data model or analytics solution
• Act as a technical expert on the different data interface solutions (expertise in SQL, Python, Informatica, Azure Data Factory, and SQL Server Integration Services recommended)
• Assist in optimizing and tuning data interfaces, jobs, and workflows and look for ways to improve efficiencies and effectiveness of existing solutions
• Partner with key business teams to understand their data needs and assist them in building the appropriate data interfaces to meet their business needs
• Partner with the security and risk teams to build appropriate security and compliance into the data platforms
• Partner with the enterprise technology function to ensure effective and efficient operation of all data environments
• Foster continuous process improvement within the data & insights organization and functions
• Cultivate strong relationships with all stakeholders of the data & insights team

Skills

Data engineering

Data architecture

Analytical thinking

Enterprise project delivery

Education

Bachelor's degree in CS/Engineering

Tools

SQL

Python

Informatica

Azure Data Factory

SSIS

Job description

Save A Lot is seeking an IT Engineer Senior Data to design and develop interfaces for the Data Platforms and Data Insights teams, enabling data ingestion into the Cloud environment, landing zone and Enterprise Data Warehouse.

You will build ETL jobs, data models, and pipelines, use SQL, Python, Informatica, Azure Data Factory and SSIS, and collaborate with business, security and risk teams to deliver reliable, scalable data solutions.