Job Title: Data Engineer Job ID: 78873 Location: California, USA – Remote
Overview: As a Sr. Software Engineer, you will play a key role in managing and optimizing the data pipelines that fuel our Athena DB, ensuring seamless data integration and accessibility. In this role, you’ll collaborate closely with both our cloud and data science teams to deliver robust, scalable data solutions.
What you will be doing:
ETL Pipeline Development: Write and maintain transform code in Python to ensure efficient and reliable data flows within our ETL pipeline.
Infrastructure Maintenance: Troubleshoot and fix infrastructure code related to AWS Lambda functions, ensuring smooth operation of cloud services.
Cross-Team Data Modeling: Lead complex data modeling efforts across multiple teams and domains, identifying and resolving data inconsistencies.
Report Generation & Debugging: Develop code to generate complex reports, and assist team members in debugging and optimizing their report-generating processes.
What you must have:
Education: Bachelor’s Degree Required, Advanced degrees (Master’s or Ph.D.) are highly preferred.
Experience: 5-7+ years of proven experience in: Data science, Data processing, & Insight generation.
Practical Experience: Hands-on experience with machines, manufacturing, or other industrial processes, applying data-driven insights in real-world scenarios.
Exceptional Logical Thinking: Strong problem-solving abilities with a focus on clear, structured logic.
Proficient in Python: Strong expertise in Python development, with a focus on data engineering applications.
Platform/Infrastructure Expertise: Comfortable working with cloud infrastructure, and eager to contribute to Terraform code for infrastructure as code (IaC) initiatives.
SQL & Data Modeling: Skilled in SQL, with experience in data modeling and analytics engineering to ensure clean, structured, and scalable data systems.
Systems Thinking: Comprehensive understanding of complex systems, ensuring effective integration and functionality across platforms.
Communication Skills: Exceptional ability to simplify and articulate complex concepts to customers, ensuring clarity and engagement.
Visual Presentation: Proficient in creating clear, impactful visuals and actionable takeaways that drive understanding and decision-making.