A leading technology firm is seeking a Data Platform Engineer to design and build scalable data pipelines and platforms in cloud environments. The ideal candidate will have 3–5 years of experience in data engineering, proficiency in languages like Python and SQL, and hands-on knowledge of big data technologies. The role involves developing data workflows, implementing CI/CD pipelines, and ensuring data governance across platforms. This position offers flexibility to work remote or on-site.
Qualifications
3–5 years of experience in enterprise technology, data engineering, or platform operations.
Hands-on experience with CI/CD pipelines, DevOps practices, and Infrastructure-as-Code.
Experience with big data technologies such as Apache Spark, Hadoop, Kafka, or Flink.
Responsibilities
Design, build, and maintain scalable data pipelines and data platforms.
Develop and optimize data ingestion, transformation, and processing workflows.
Implement CI/CD pipelines, DevOps practices, and Infrastructure-as-Code for deployment.
Skills
TypeScript
C#
Python
SQL
Scala
CI/CD pipelines
DevOps practices
Apache Spark
Hadoop
Kafka
Flink
.NET
Education
Bachelor’s degree in Technology, Engineering, or a related field
Tools
AWS CDK
Azure Bicep
BigQuery
Redshift
Snowflake
Databricks
Job description
Overview
Job Role: Data Platform Engineer
Job Location: India/Remote
Experience: 3-5 Years
Roles & Responsibilities
Design, build, and maintain scalable data pipelines and data platforms in cloud environments.
Develop and optimize data ingestion, transformation, and processing workflows for large-scale datasets.
Implement CI/CD pipelines, DevOps practices, and Infrastructure-as-Code for data platform deployment and management.
Work with big data frameworks to process and analyze high-volume data efficiently.
Ensure data governance, security, and compliance across data platforms.
Optimize data performance, indexing, and query execution in distributed environments.
Support real-time and batch data streaming architectures for analytics and operational workloads.
Collaborate with cross-functional teams to deliver data-driven solutions and platform improvements.
Skills & Requirements
Bachelor’s degree in Technology, Engineering, or a related field.
3–5 years of experience in enterprise technology, data engineering, or platform operations.
Proficiency in TypeScript, C#, Python, SQL, or Scala.
Hands-on experience with CI/CD pipelines, DevOps practices, and Infrastructure-as-Code (AWS CDK, Azure Bicep).
Experience with big data technologies such as Apache Spark, Hadoop, Kafka, or Flink.
Knowledge of cloud platforms including AWS, Azure, or GCP and cloud-native data solutions such as BigQuery, Redshift, Snowflake, or Databricks.
Understanding of data modeling, data warehousing, distributed systems, and data platform architecture.
Experience with data ingestion pipelines, governance frameworks, and data security practices.
Familiarity with multi-cloud environments, performance tuning, and distributed query optimization.
Exposure to real-time and batch data processing architectures.