Senior Data Engineer

Allied Solutions, LLC; Carmel, Northern (IN, KY); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401k match

Paid time off

Career growth

Job summary

Allied Solutions, LLC is seeking a Senior Data Engineer to lead data acquisition, curation, and transformation into usable assets. You will help design and deploy modern data architecture and end-to-end data flows for BI and analytics, collaborating with teams across the enterprise.

The role focuses on data models, schemas, and roadmaps for Data Management and Data Strategy, with opportunities to mentor peers and influence cloud-based data solutions.

Qualifications

• Bachelor’s degree or equivalent in a related field.
• 5+ years in data warehousing, databases (MS SQL Server, Snowflake) and dimensional modeling.
• 5+ years in end-to-end data analysis and development.
• 3-5 years of experience with AWS cloud services.
• 3-5 years with Snowflake (preferred).
• Strong SQL and data modeling expertise.
• Experience with Python or R is a plus.
• Familiarity with Git and CI/CD and SDLC concepts.
• Excellent communication and collaboration skills.

Responsibilities

• Create and maintain detailed documentation of data warehouse, data stores, and end-to-end data flows.
• Troubleshoot data and processing errors in existing solutions.
• Collaborate with technical teams and users to design solutions.
• Develop and refine BI-focused data architecture.
• Understand data and reporting requirements from customers and support back-end data work.
• Perform gap analyses against enterprise data warehouse to support BI.
• Develop and maintain data sets and standardize collection/process methods.
• Provide technical guidance on cross-functional decisions and architecture.
• Attend architecture meetings to define scope, timelines, and costs.
• Design data extraction/integration paths with third-party providers.
• Maintain enterprise data solutions including ETL, warehouse models, upgrades, security, governance.
• Understand data warehouse/mart models and business information held.
• Identify process improvements and new technologies to accelerate value delivery.
• Collaborate with developers/SMEs to align vision and performance needs.
• Mentor other ETL Developers and Data Engineers.

Skills

Data modeling

Data architecture

ETL development

SQL proficiency

Analytical skills

Team collaboration

SDLC knowledge

Communication

Education

Bachelor’s Degree or equivalent

Tools

AWS

Snowflake

SQL

Git & CI/CD

Snowpipe / Snowpark

Python/R

Cloud services (SaaS, PaaS, IaaS)

Job description

The Senior Data Engineer plays a critical role in the successful execution of Allied’s Data Strategy. This role will be focused on data acquisition, curation, and transformation of data into a useable asset. They will work cross-functionally to develop and deploy optimized data models and modern data architecture in support of strategic data and business initiatives. This role will serve as a subject matter expert for data domain knowledge, SQL, data design, and data processes across the enterprise. This individual will collaborate with teams across the organization to design and build end to end data flows for optimal business intelligence, advanced analytics, and data monetization efforts. Lastly, this role will contribute to core design of data architecture, data models, schemas, and inform future state Data Management and Data Strategy roadmaps.

Job Duties and Responsibilities

• Creates detailed documentation of data warehouse, data stores, and end-to-end data flows
• Troubleshoots and corrects data and data processing errors in existing solutions
• Works with other technical teams as well as with internal and external users to develop technical designs
• Develops and continually refines the BI-focused data architecture
• Works closely with the Data Intelligence department to understand the data and reporting requirements from internal and external customers and the steps to take on the back-end data side to achieve the expected results
• Conducts gap analysis on source system databases against Allied’s enterprise data warehouse in support of Business Intelligence efforts
• Develops and maintains data sets and standardizes data collection and processing methodologies
• Provides technical advice and weighs in on technical decisions that impact cross-functional teams
• Attends and contributes to architecture meetings to determine project scope, time frame, and cost estimates
• Works on plan and technical architecture to extract, integrate, and/or push data to or from third-party providers
• Provides enterprise data solutions for Allied, including ETL maintenance, warehouse data models, periodic upgrades, security, governance, and performance optimization
• Understands the data warehouse and data mart models as well as being familiar with the business information contained in each
• Locates and defines new process improvement opportunities or alternative technologies that will enhance speed to business value delivery with our data
• Collaborates with developers and subject matter experts to establish the technical vision and analyze tradeoffs between usability and performance needs
• Mentors other ETL Developers and Data Engineers

Qualifications (Education, Experience, Certifications & KSA)

• Bachelor’s Degree required, or equivalent education/work experience
• 5+ years of experience with data warehousing, databases (MS SQL Server, Snowflake), and dimensional modeling
• 5+ years of experience in end-to-end data analysis and development
• 3-5 years of experience in AWS cloud services (AWS Glue, Lambda, S3, etc.)
• 3-5 years of experience with Snowflake (Snowpipe, Snowpark, Streamlit, Streams/Tasks) (preferred)
• Extensive Experience with SQL required
• Experience with R or Python (preferred)
• Experience with Git and CI/CD (preferred)
• Strong attention to detail
• Familiarity with Object Oriented Analysis, Project Management, Business Analysis Methodology, and the SDLC
• Ability to collaborate effectively and work as part of a team
• Customer-oriented, with a desire to resolve problems to the customer's satisfaction while maintaining focus on productivity, efficiency, and quality
• Effective communicator to clients, management, and project partners
• Experience with cloud-based technologies and services (SaaS, PaaS, IaaS) (preferred)
• Experience with Master Data Management (preferred)
• Strong analytical and product management skills required, including a thorough understanding of how to interpret customer business needs and translate them into application and operational requirements.

We offer our employees a robust compensation package! Our comprehensive benefits include:

• medical, dental and vision insurance coverage; 100% company-paid life and disability coverage, 401k options with company match, three weeks PTO by the end of the first year and much more.

Allied proudly promotes from within as part of a strong commitment to providing career growth opportunities for employees of all levels. Our diverse business portfolio allows employees broad career options with the advantage of staying with the same organization.

All qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.

When you join Allied Solutions, you are part of a company that’s been recognized for its commitment to making an impact. Allied has been ranked by Forbes as one of America's Best Midsize Employers. Allied's customer service team has received the Center of Excellence certification by BenchmarkPortal for eight consecutive years. And in 2022, Allied was honored with a Spirit United award, acknowledging our 13-year relationship with United Way of Central Indiana. As Allied continues to expand into new markets and reach new clients, opportunities to join the company and advance your career grow as well. Allied continually invests in learning and development resources to help you build new skills and advance your career. Come grow with us!

If you don't see a role that fits your profile, Introduce Yourself to stay informed about news, events and opportunities.

To view our privacy statement click here

To view our terms and conditions click here