Sr Software Engineer (Data)-3817

Comcast; New York (NY); Remote; USD 156,000 - 175,000; Full time

Job summary

An established industry player is seeking a talented software engineer to lead the development of large-scale Big Data systems. In this dynamic role, you will design, develop, and maintain software solutions that transform large volumes of data, leveraging cutting-edge technologies like AWS, Kubernetes, and various programming languages. You will collaborate with global teams, mentor junior engineers, and ensure the scalability and performance of critical systems. This position offers the flexibility of remote work within commuting distance, allowing you to balance your professional and personal life while contributing to innovative projects in the digital landscape.

Qualifications

• 5+ years of software development experience in Agile environments.
• Experience with AWS, Kubernetes, and data processing frameworks.

Responsibilities

• Lead a team in developing large-scale Big Data systems.
• Design and maintain software for data extraction and transformation.

Skills

Python

Golang

Presto

SQL

Spark

Datadog

Terraform

Jenkins

Snowflake

Databricks

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Kubernetes

MySQL

Postgres

Apache Hadoop

Job description

FreeWheel, a Comcast company, provides comprehensive ad platforms for publishers, advertisers, and media buyers. Powered by premium video content, robust data, and advanced technology, we’re making it easier for buyers and sellers to transact across all screens, data types, and sales channels. As a global company, we have offices in nine countries and can insert advertisements around the world.

Job Summary

Job Description

DUTIES:

1. Provide technical leadership to a team responsible for creating and maintaining large scale Big Data systems and Data Environments.
2. Design, develop, test, and maintain software that extracts, transforms, and loads large volumes of data.
3. Develop software systems in an Agile development environment and on Kubernetes within AWS cloud-based platform using SQL, Golang, Python, Presto, Datadog, Terraform, Jenkins, Scala, Apache Hadoop, Spark, Snowflake, Databricks, and AWS Elastic MapReduce.
4. Deploy software on AWS using Terraform.
5. Develop Microservices API systems to support overall product development.
6. Store relational data in MySQL to support API and data processing applications.
7. Concurrently execute data processing software using multithreading.
8. Write code and scripts to extract MRM ad logs from FreeWheel Big Data platforms, and load MRM ad logs and campaign data.
9. Perform audience targeting; ingest audience, identity, and segment data.
10. Create dashboards and monitors on Datadog to ensure 24x7 availability of critical software deployments.
11. Build new software products and web frontend frameworks.
12. Analyze product specifications, write technical specs, create monitoring dashboards, develop test suites, design workflows, and setup database schemas and tables.
13. Interface with global engineering, operations, services, and business operations teams to execute proof of concepts and incorporate new requirements.
14. Improve system performance and ensure availability and scalability of services.
15. Provide production support for data processing systems running on AWS cloud and Snowflake.
16. Troubleshoot data processing problems running on distributed systems, and functional and performance issues on software modules.
17. Debug functional and performance issues on software modules running on Snowflake, Databricks, and Spark.
18. Guide and mentor junior-level engineers.

Position is eligible to work remotely within normal commuting distance of the worksite.

REQUIREMENTS:

Bachelor’s degree, or foreign equivalent, in Computer Science, any Engineering, or related technical field, and five (5) years of experience developing software in an Agile development environment using SQL, Golang, or Python on Kubernetes within AWS; of which three (3) years of experience include using Presto or Spark, Datadog or similar observability tool, Terraform, and Jenkins; and of which one (1) year of experience includes using Snowflake and Databricks; storing relational data in MySQL or Postgres to support API and data processing applications; and debugging functional and performance issues on software modules.

BENEFITS:

For detailed benefits information, please visit this link.

SALARY: $156,483.00 to $175,000.00 per year

Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Comcast is proud to be an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.

Skills:

Python (Programming Language); Presto; Go Programming Language

Salary:

Base Pay: $156,483.00

The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

Base pay is one part of the Total Rewards that Comcast provides to compensate and recognize employees for their work. Most sales positions are eligible for a Commission under the terms of an applicable plan, while most non-sales positions are eligible for a Bonus. Additionally, Comcast provides best-in-class Benefits to eligible employees. We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That’s why we provide an array of options, expert guidance and always-on tools, that are personalized to meet the needs of your reality – to help support you physically, financially and emotionally through the big milestones and in your everyday life. Please visit the compensation and benefits summary on our careers site for more details.