Data Platform Engineer

Compunnel, Inc.; Pennsylvania; On-site; USD 100,000 - 130,000; Full time

Job summary

A data solutions firm is seeking a Data Platform Engineer to design and implement scalable data solutions. Candidates should have 4+ years of experience in software or data engineering and a strong technical background in cloud platforms including AWS and Snowflake. The role involves hands-on development, collaboration across diverse teams, and creating technical documentation. Candidates must also demonstrate strong problem-solving skills and the ability to travel up to 25%. This is a full-time position based in Pennsylvania.

Qualifications

• 4+ years of experience in software, data engineering, or analytics.
• 2+ years leading teams on data-related projects.
• Ability to travel up to 25%.

Responsibilities

• Design and implement data solutions based on customer needs.
• Recommend technologies and end-to-end solutions.
• Develop production-grade data solutions focusing on performance and scalability.
• Collaborate across various technical platforms like Cloudera and AWS.
• Create detailed solution documentation.

Skills

Python

Java

Scala

Cloud platforms

Data integration tools

Agile methodologies

Tools

Snowflake

Databricks

AWS

Hadoop

Kafka

Job description

The Data Platform Engineer will be responsible for designing, implementing, and deploying scalable data solutions across diverse technical environments.

The role involves working across streaming, data lakes, analytics, and cloud platforms while ensuring strong performance, security, scalability, and robust data integration.

The position requires hands-on coding skills, collaboration across multiple data technologies, and the ability to create clear technical documentation and presentations.

Key Responsibilities

• Design and implement data solutions based on customer needs, covering streaming, data lakes, analytics, and other data platform requirements.
• Recommend appropriate technologies and end-to-end solutions across application, data, and infrastructure layers.
• Develop production-grade data solutions using Python, Java, and Scala with a focus on performance, security, and scalability.
• Collaborate across various technical platforms, including Cloudera, Databricks, Snowflake, and AWS.
• Deliver presentations that explain complex technical concepts clearly and effectively.
• Create detailed solution documentation such as sequence diagrams, logical system views, and class hierarchies.
• Follow Agile methodologies throughout the solution lifecycle.
• Design, build, and deploy databases and data stores to meet organizational and project requirements.

Required Qualifications

• 4+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
• 2+ years of experience leading teams on data-related projects and delivering end-to-end technical solutions.
• Ability to travel up to 25%.

Preferred Qualifications

• Production experience with core data platforms such as Snowflake, Databricks, AWS, Azure, GCP, or Hadoop.
• Hands-on experience with cloud and distributed storage technologies, including HDFS, S3, ADLS, GCS, Kudu, Elasticsearch/Solr, Cassandra, or other NoSQL systems.
• Strong understanding of data integration tools and technologies such as Spark, Kafka, event/streaming frameworks, StreamSets, NiFi, AWS Data Migration Services, Azure Data Factory, and Google DataProc.
• Strong written and verbal communication skills for conveying complex technical concepts.