Data Engineer

Protagona; Dallas (TX); On-site; USD 115,000 - 130,000; Full time

Job summary

Protagona seeks a Data Engineer to join a talented team focused on deploying and configuring cloud resources in AWS for diverse client needs. You will build and optimize data pipelines, write SQL and Python, and leverage AWS services to support analytics and reporting.

Responsibilities include translating business requirements into technical specs, planning projects, and delivering scalable data solutions for batch and real-time processing in AWS.

Qualifications

• Data engineering experience focused on pipelines, analytics and reporting.
• Proficiency with SQL and data transformations; troubleshooting across databases.
• Python scripting experience.
• Familiarity with AWS services (EC2, S3, EMR, Lambda, Redshift, etc.).

Responsibilities

• Collaborate with team to evaluate business needs and coordinate with business partners.
• Translate requirements into technical specifications for apps and enhancements.
• Participate in project planning with milestones, deliverables and resources.
• Create design, test plans, and process flow charts for programming execution.
• Develop data pipelines/APIs using Python, SQL, Spark and AWS services.
• Apply data-driven analysis to understand fast-changing business needs.
• Build large-scale batch and real-time data pipelines in AWS.

Skills

Data pipelines

AWS Cloud

SQL

Data transformations

ETL pipelines

Python

AWS services

Job description

As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet individual client business needs in AWS. Client engagements cover a wide variety of business requirements and require our engineers to adapt quickly and stay on top of recent cloud technology trends. Candidates should be able to identify and remediate issues within cloud-based systems, based on their knowledge of industry standards and best practices.

Responsibilities

• Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management
• Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements
• Participate in project planning; identifying milestones, deliverables and resource requirements; tracks activities and task execution
• Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming
• Develop data pipelines / APIs using a variety of tools, including but not limited to Python, SQL, Spark and various AWS services
• Use an analytical, data-driven approach to drive a deep understanding of fast changing business
• Build large-scale batch and real-time data pipelines with data processing frameworks in AWS

Desired Skills & Experience

• Experience in data engineering with an emphasis on data pipelines, analytics and reporting
• Exposure to the AWS Cloud Platform
• Experience in SQL, data transformations, and troubleshooting across at least one database Platform (Redshift, Amazon RDS, Cassandra, Snowflake, PostgreSQL, Databricks, etc.)
• Experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
• Experience in a scripting languages such as Python
• Experience designing and building solutions utilizing various Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API gateway, etc.

Nice to Haves

• AWS Certification - Solutions Architect Pro or Data Specialty
• Machine Learning experience
• Advanced GenAI experience

Compensation

The expected base salary range for this position is$115,000 – $130,000 USD annually, plus eligibility for anannual performance bonus.

Actual compensation will depend on experience, skill set, and location.

Benefits

We offer a comprehensive benefits package that includesmedical, dental, and vision coverage, and paid time off.