Azure Data Lakehouse Engineer

Batchelor & Kimball, Inc.; Conyers (GA); On-site; USD 90,000 - 130,000; Full time

Job summary

Batchelor & Kimball, Inc. is seeking a Database Analyst to design, build, and establish an Azure-based data lakehouse platform that supports business analytics, reporting, and AI/ML initiatives.

You will develop scalable data pipelines and curated datasets while partnering with business and technical teams to deliver reliable insights. The role requires hands-on data engineering, experience with Azure data services, Spark/PySpark, Delta Lake, and Power BI readiness.

Qualifications

• Bachelor’s degree or equivalent technical experience in data science/analytics, CS, CE, information systems.
• 3+ years hands-on data engineering or cloud data platform experience.
• Experience designing or contributing to a new data platform or analytics environment (greenfield preferred).
• Strong knowledge of Microsoft Fabric OneLake, Data Factory, Data Engineering, Data Warehousing, Data Science, Real-Time Analytics, and Power BI.
• Experience with Azure data services (Data Lake Storage, Data Factory, SQL, Synapse, Databricks, Key Vault, RBAC, governance).
• Hands-on experience with Spark, PySpark, SQL, Python, Delta Lake, and lakehouse architecture.
• Ability to design ingestion patterns from various data sources with incremental loads and error handling.
• Experience preparing governed datasets for AI/ML training and analytics.
• Understanding of data governance, security, privacy, lineage, metadata, and responsible AI data boundaries.
• Experience building curated datasets and Power BI-ready data products.
• Familiarity with DevOps for data platforms (CI/CD, IaC, monitoring, cost management).
• Strong communication to translate business needs into scalable data solutions.

Responsibilities

• Design, build, and implement a new Azure-based data lakehouse platform for reporting, analytics, and AI/ML use cases.
• Develop and maintain scalable ETL/ELT processes for ingestion, transformation, cleansing, enrichment, and delivery across data sources.
• Implement lakehouse patterns (bronze/silver/gold), Delta Lake design, and curated data products.
• Design and optimize data models for Power BI reporting and AI training workflows.
• Manage data storage solutions including OneLake, Data Lake Storage, relational databases, lakes, warehouses, and other Azure services.
• Ensure data quality, lineage, governance, security, privacy, and retention across components.
• Collaborate with stakeholders to understand data requirements and validate business logic.
• Prepare AI-ready datasets and support feature engineering for AI development teams.
• Configure data guardrails, access controls, and filtering to ensure secure, approved data usage.
• Monitor and optimize pipelines, compute resources, and cloud services for performance and cost efficiency.
• Automate data processes using CI/CD, version control, reusable pipelines, and runbooks.
• Partner to establish data platform standards and long-term support practices for a new enterprise environment.

Skills

Strong communication skills

Education

Bachelor’s degree in Data Science/Analytics or related field

Tools

Azure Data Lake Storage

Azure Data Factory

Azure SQL

Synapse

Azure Databricks

Delta Lake

Power BI

Microsoft Fabric OneLake

PySpark

SQL

Python

Data Warehousing

Job description

Batchelor & Kimball, Inc. is seeking a Database Analyst to design, build, and establish an Azure-based data lakehouse platform that supports business analytics, reporting, and AI/ML initiatives.

You will develop scalable data pipelines and curated datasets while partnering with business and technical teams to deliver reliable insights. The role requires hands-on data engineering, experience with Azure data services, Spark/PySpark, Delta Lake, and Power BI readiness.