Data Engineer

Hallmark Global Solutions Ltd; Birmingham (AL); On-site; USD 90,000 - 115,000; Full time

Job summary

A leading IT consulting company seeks a Data Engineer with extensive experience in data engineering, particularly in building ETL pipelines using IBM DataStage and Azure services. This mid-senior level position requires proficiency in SQL, Python, and experience with cloud-based platforms, to lead development teams and ensure data quality and governance.

Qualifications

• 8+ years of experience in data engineering.
• 4+ years with IBM DataStage and Azure Data Factory.
• Strong SQL and Python skills.

Responsibilities

• Develop and optimize complex ETL workflows.
• Lead and coordinate offshore development teams.
• Implement data quality and governance practices.

Skills

Data engineering

ETL

Azure Data Factory

SQL

Python

Databricks

Data governance

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Hallmark Global Solutions Ltd

Talent Alchemist | Ex-Wipro, TCS, Accenture | MBA in HR | Creating Career Magic

Key Responsibilities:

• 8+ years of experience in data engineering with a balanced focus on traditional ETL and modern cloud-based integration.
• 4+ years of hands-on experience with IBM DataStage, including development, optimization, and support of complex ETL workflows.
• 4+ years of experience with Azure Data Factory, Azure SQL Database, and other Azure-native services for data ingestion and transformation.
• Experience in ETL migration projects, particularly transitioning DataStage workloads to ADF or equivalent cloud pipelines.
• Ability to design, develop, and maintain ETL pipelines in both on-premise (DataStage) and cloud (ADF) ecosystems.
• Proven ability to lead and coordinate offshore development teams, ensuring alignment with timelines, quality standards, and delivery goals.
• Expertise in building and managing data pipelines using Databricks, implementing data quality, lineage, and governance practices.
• Proficient in SQL and Python, including writing scripts for data manipulation and orchestration logic.
• Experience in Azure-based data warehouse platforms like Azure Synapse Analytics, Azure Data Lake, and associated data services.
• Familiar with CI/CD practices using Azure DevOps, including automation of pipeline deployment and version control.
• Knowledge of data governance, security, and compliance best practices in the Azure cloud environment.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Hallmark Global Solutions Ltd by 2x

Sign in to set job alerts for “Data Engineer” roles.

Birmingham, AL $90,000.00-$115,000.00 2 weeks ago

Software Developer, Finance Applications

Birmingham, AL $83,241.00-$129,147.00 2 weeks ago

Senior Software Engineer – Python / .NET

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.