Remote Senior Data Engineer - Big Data Platforms

Placements24; Roanoke (VA); Hybrid; USD 130,000 - 170,000; Full time

Benefits offered by this job

Remote work

Competitive salary

Health, dental, and vision insurance

Stock options

Professional development budget

Home office stipend

Job summary

Placements24 is seeking a Remote Senior Data Engineer to design, build, and maintain scalable data pipelines and infrastructure for advanced analytics and ML initiatives. You will collaborate with data scientists, analysts, and software engineers to ensure reliable data flow across the organization.

The role requires 5+ years in data engineering, strong skills in Spark, SQL, Python/Scala, and experience with cloud platforms (AWS/Azure/GCP).

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience as a Data Engineer with a focus on big data technologies.
• Proven experience with cloud platforms (AWS, Azure, or GCP).
• Proficiency in SQL and Python or Scala.
• Experience with ETL/ELT, data warehousing, and data modeling.
• Knowledge of data governance, security, and compliance best practices.
• Strong collaboration skills in a remote team environment.

Responsibilities

• Design, build, and maintain scalable data pipelines and infrastructure.
• Develop ETL/ELT processes to ingest, transform, and load data from multiple sources.
• Architect data warehouses and optimize performance for BI/analytics.
• Work with large datasets ensuring data quality, integrity, and availability.
• Implement data modeling techniques to support analytics and ML goals.
• Collaborate with data scientists, analysts, and engineers to meet data needs.
• Optimize query performance and database systems; ensure data governance and security.
• Stay current with emerging big data technologies and best practices.
• Troubleshoot data issues in production environments.

Skills

Big data technologies

Cloud platforms (AWS/Azure/GCP)

SQL

Python/Scala

ETL/ELT design

Data governance & security

Remote collaboration

Education

Bachelor's or Master's in CS/Engineering

Tools

Airflow

Luigi

Apache Spark

Hadoop

Flink

Redshift

BigQuery

Job description

About the Role

Our client, a cutting-edge data analytics company operating with a fully remote workforce, is seeking a highly skilled Remote Senior Data Engineer to join their expanding team. This position is pivotal in designing, building, and maintaining scalable data pipelines and infrastructure that support the company's advanced analytics and machine learning initiatives. The ideal candidate possesses extensive experience with big data technologies, cloud platforms, and data warehousing solutions. You will collaborate with data scientists, analysts, and software engineers to ensure the efficient and reliable flow of data across the organization. This is an exceptional opportunity to work on complex data challenges, contribute to architectural decisions, and leverage the latest technologies in a fully remote, flexible, and innovative environment. The role is based conceptually around East London but is entirely remote.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and implement ETL/ELT processes to ingest, transform, and load data from various sources.
• Build and optimize data architectures and data warehouses for performance and efficiency.
• Work with large datasets, ensuring data quality, integrity, and availability.
• Implement data modeling techniques to support business intelligence and analytical requirements.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Optimize data query performance and database performance.
• Ensure adherence to data governance, security, and compliance standards.
• Stay current with emerging big data technologies and best practices.
• Troubleshoot and resolve data-related issues in production environments.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience as a Data Engineer, with a strong focus on big data technologies.
• Proven experience with cloud platforms such as AWS (S3, Redshift, EMR), Azure (Data Lake, Synapse), or GCP (BigQuery, Dataflow).
• Proficiency in SQL and experience with NoSQL databases.
• Hands-on experience with distributed data processing frameworks like Apache Spark, Hadoop, or Flink.
• Expertise in programming languages such as Python or Scala for data engineering tasks.
• Experience with data warehousing concepts and tools.
• Strong understanding of ETL/ELT processes and data pipeline orchestration tools (e.g., Airflow, Luigi).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and effectively in a remote team environment.

Benefits

• Fully remote work arrangement with flexible hours.
• Highly competitive salary and performance bonus.
• Comprehensive health, dental, and vision insurance.
• Stock options plan.
• Generous budget for professional development, including conferences and training.
• Opportunity to work with cutting-edge big data technologies.
• Collaborative and innovative company culture.
• Home office stipend and necessary equipment provided.