We Are Hiring: Lead Data Engineer 8–10 Years | Hyderabad (Hybrid) | Full-Time | Immediate Joiner

Strive4X Infotech Private Limited; Hyderabad; Sur place; INR 2 400 000 - 4 200 000; Plein temps

Résumé du poste

Strive4X Infotech Private Limited is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines on Azure-based data platforms. The role requires strong Python, SQL, and data ecosystem skills, including Airflow, Spark, and Snowflake-like tooling.

The ideal candidate has 7+ years of experience, with 5+ years in data engineering, and hands-on Azure cloud expertise. ERP/CRM integrations and AI-driven workflow improvements are valued.

Qualifications

• Bachelor’s level degree in engineering is required.
• 7+ years of overall experience with 5+ years in Data Engineering.
• Strong Python experience with Pandas and PySpark.
• Hands-on Azure cloud experience (ADF, Storage, and services).
• Experience with ERP/CRM integrations via APIs or connectors.

Responsabilités

• Design, build, and optimize scalable data pipelines and cloud-based platforms.
• Collaborate with BI and Data teams for seamless data flow.
• Develop data ingestion frameworks from SAP/Oracle ERP and Salesforce/Workday CRM.
• Optimize pipelines for performance and cost efficiency.
• Apply AI-driven solutions for workflow automation and optimization.

Connaissances

Advanced SQL

Python

Data governance

AI/ML integration

Java basics

Formation

B.E./B.Tech

Outils

Apache Airflow

Apache Spark

Databricks

Unity Catalog

Delta Live Tables

Kafka Streams

Flink

Docker

Kubernetes

SQLAlchemy

Description du poste

Mandatory Qualification: B.E./B.Tech required

Please note, this role has a restricted budget range—kindly apply accordingly.

About the Role

We are looking for our reputed client who highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, and Azure-based data ecosystems.

• Advanced SQL (Joins, Window Functions, Optimization)
• AWS
• Snowflake
• Basic Java knowledge
• ServiceNow experience
• Tools: Airflow / Spark
• Develop data ingestion frameworks from ERP (SAP, Oracle) & CRM (Salesforce, Workday)
• Optimize pipelines for performance & cost efficiency
• Collaborate with BI & Data teams for seamless data flow
• 7+ year s of overall experience wit h 5+ years of hands‑on experience in Data Engineering
• Strong experience in Python for Data Engineering using Pandas, PySpark, SQLAlchemy, and data processing libraries
• Expertise in advanced SQL, including query optimization, performance tuning, complex joins, and window functions
• Hands-on experience with Azure cloud is Mandatory (ADF, Storage Accounts, and Azure-native services)
• Familiarity with orchestration and distributed processing tools such as Apache Airflow, Apache Spark, and similar technologies
• Experience with Databricks, including Unity Catalog and Delta Live Tables (DLT)
• Knowledge of ERP/CRM integrations such as SAP, Oracle, Salesforce, and Workday using APIs, connectors, or direct database access
• Strong understanding of data quality, validation frameworks, testing methodologies, and data governance practices
• Experience in applying AI-driven solutions for workflow automation, process optimization, and decision-making improvements
• Experience with AI-powered productivity tools (Cursor, Windsurf, Claude, GitHub Copilot) for accelerated development
• Hands-on Java experience and understanding of enterprise application design patterns
• Knowledge of AWS along with Snowflake
• Experience working with ServiceNow platform or similar enterprise workflow platform
• Knowledge of real-time streaming architectures (Kafka Streams, Flink) for industrial/IoT analytics
• Experience with containerization (Docker, Kubernetes) and modern CI/CD practices
• Familiarity with AI/ML pipeline integration, feature engineering, and model serving infrastructure