We are seeking a Senior Data Engineer with strong expertise in Databricks, Python, ETL, SQL, and Data/Financial Modeling to design, build, and operate scalable data pipelines and lakehouse data products. The role will support data-driven capabilities across device supply chain, reverse logistics, procurement, network supply chain, and real-time control tower initiatives.
The ideal candidate will have hands‑on experience building production‑grade data solutions in large enterprise environments and working across data ingestion, transformation, modeling, validation, and delivery
Primary Skills: Databricks, Python
Secondary Skills: Data Engineering, ETL, SQL, Azure Data Factory, Salesforce, Data/Financial Modeling
Key Responsibilities
- Design, develop, and maintain production‑grade data pipelines covering source ingestion, Bronze landing, Silver transformation, and Gold‑layer data products.
- Implement Medallion Architecture (Bronze, Silver, Gold) and follow established data product development and certification standards.
- Develop scalable data engineering solutions using Databricks, Python, SQL, Azure Data Factory, and related Azure data technologies.
- Collaborate with System Analysts, Data Scientists, Product Managers, and business stakeholders to translate requirements into robust data solutions.
- Implement field‑level transformations, business rules, data validation, and data quality checks based on product requirements.
- Perform data wrangling, profiling, cleansing, and transformation to create reliable datasets for analytics and downstream applications.
- Develop and maintain data and financial models that support business reporting, analytics, forecasting, and decision‑making.
- Analyze source systems and perform ad‑hoc SQL queries to validate data and troubleshoot pipeline issues.
- Build and optimize ETL/ELT processes for performance, scalability, reliability, and cost efficiency.
- Collaborate with cross‑functional teams to understand business objectives and deliver data solutions that provide measurable business value.
- Support data product releases, testing, deployment, and production operations.
- Document data pipelines, transformation logic, data models, business rules, and other technical artifacts.
- Identify opportunities to improve data quality, pipeline performance, automation, and overall engineering efficiency.
Required Qualifications
- 5–10 years of experience in Data Engineering with a strong track record of delivering production‑grade data solutions.
- 5+ years of IT experience with Python, including data processing, automation, and pipeline development.
- Strong hands‑on experience with Databricks and modern data engineering practices.
- Strong expertise in ETL/ELT and SQL, including data transformation, validation, troubleshooting, and source‑system analysis.
- 7+ years of experience with Azure Data Factory or comparable pipeline orchestration technologies.
- Experience working with Salesforce data and integrating Salesforce with enterprise data platforms.
- Strong understanding of Data Modeling, including dimensional modeling and data structures supporting analytics and financial use cases.
- Experience with Microsoft Fabric or Azure Synapse Analytics is highly desirable.
- Familiarity with Microsoft Fabric, OneLake, and Fabric IQ is a plus.
- Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, or Apache Airflow.
- Strong understanding of data warehousing, lakehouse architecture, data quality, and data governance.
- Experience working in large enterprise environments with cross‑functional business and technology teams.
Preferred Qualifications
- Experience with Microsoft Fabric and OneLake.
- Knowledge of Fabric IQ certification standards and enterprise data product practices.
- Experience supporting supply chain, procurement, logistics, finance, or related business domains.
- Exposure to Machine Learning/AI data pipelines and collaboration with Data Scientists or ML Engineers.
- Experience optimizing large‑scale data pipelines for performance and cost.
- Experience with cloud‑based data platforms and modern lakehouse architectures.
Education & Certifications
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, Data Science, or a related field preferred.
- Certifications: Not required.
ABOUT BRICKRED SYSTEMS
BrickRed Systems is a global leader in next‑generation technology consulting and workforce solutions, specializing in delivering high‑quality talent across digital, engineering, marketing, analytics, finance, operations, and business transformation domains. With a strong emphasis on innovation, scalability, and client success, BrickRed Systems helps organizations solve complex business challenges by providing skilled professionals across strategy, technology, creative, and operational functions. BrickRed fosters a culture of continuous learning, collaboration, and excellence, enabling professionals to contribute to high‑impact global initiatives while advancing their careers.