Data Engineering Manager: Build Scalable Data Pipelines

Jobtailor; California (MO); On-site; USD 120,000 - 160,000; Full time

Job summary

Jobtailor seeks a senior data engineer to design and build scalable data infrastructure and pipelines, enabling efficient processing and analytics for business insights.

The role emphasizes data architecture, security, and mentoring, with focus on Azure Data Factory and Databricks to support growth and compliant data practices across teams.

Qualifications

• At least a Bachelor's degree is required.
• At least 4 years of experience is required.
• Preference for MIS, CS, Systems Engineering, Electrical/Industrial Engineering, Math or Statistics.
• Strong data architecture development and data integration skills.
• Experience with Azure Data Factory and Microsoft Azure Databricks.
• Developing and optimizing data pipelines and data warehouses.
• Implementing data anonymization and data security best practices.
• Leading teams in agile scalability and strategic questioning.
• Mentoring others in data engineering platforms and tools.

Responsibilities

• Designing and developing data infrastructure and systems to facilitate efficient data processing and analysis.
• Implementing data pipelines, integration, and transformation solutions to convert raw data into actionable insights.
• Utilizing Azure Data Factory and Databricks Unified Data Analytics Platform for scalable data engineering solutions.
• Developing data architecture and modeling strategies to support business growth and informed decision-making.
• Managing database administration and optimization to enhance data quality and performance.
• Applying database security best practices to safeguard data integrity and compliance.
• Leading teams in strategic planning and execution of data-driven initiatives.
• Coaching and mentoring team members to leverage their strengths and deliver quality outcomes.
• Analyzing system components to identify linkages and interactions for improved data solutions.
• Encouraging innovation and embracing technology to enhance delivery and client service expectations.

Skills

data infrastructure design

data processing

data analysis

data pipelines

data integration

data transformation

data architecture

data modeling

database administration

data optimization

Education

Bachelor's degree

4+ years of experience

fields: MIS, CS, Systems/Industrial/Engineering, Math/Stats

Tools

Azure Data Factory

Azure Databricks

data warehouses

Job description

• Designing and developing data infrastructure and systems to facilitate efficient data processing and analysis
• Implementing data pipelines, integration, and transformation solutions to convert raw data into actionable insights
• Utilizing Azure Data Factory and Databricks Unified Data Analytics Platform for scalable data engineering solutions
• Developing data architecture and modeling strategies to support business growth and informed decision-making
• Managing database administration and optimization to enhance data quality and performance
• Applying database security best practices to safeguard data integrity and compliance
• Leading teams in strategic planning and execution of data-driven initiatives
• Coaching and mentoring team members to leverage their strengths and deliver quality outcomes
• Analyzing system components to identify linkages and interactions for improved data solutions
• Encouraging innovation and embracing technology to enhance delivery and client service expectations

Requirements

• At least a Bachelor's degree
• At least 4 years of experience
• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Excelling in data architecture development and data integration
• Utilizing Azure Data Factory and Microsoft Azure Databricks
• Developing and optimizing data pipelines and data warehouses
• Implementing data anonymization and data security best practices
• Leading teams in agile scalability and strategic questioning
• Mentoring others in data engineering platforms and tools

🔍 ATS Optimization Keywords
Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively — a feature exclusive to JobTailor job listings.

Hard Skills

• data infrastructure design
• data processing
• data analysis
• data pipelines
• data integration
• data transformation
• data architecture
• data modeling
• database administration
• data optimization

Soft Skills

• leadership
• coaching
• mentoring
• strategic planning
• execution
• innovation
• team management
• communication
• problem-solving
• collaboration

Certifications & Qualifications

• Bachelor's degree