Data Engineer

Overview

Data Engineer

Responsabilitites

• Support data science collecting and distributing necessary data, and presenting production predictive models for use in end-user products
• Implement and maintain key data flows in serverless frameworks
• ETL logic in frameworks such as Glue (AWS) and Data Works (Alibaba Cloud)
• Adaptors between systems in frameworks such as Lambda (AWS) or Function Compute (Alibaba Cloud)
• CI/CD in Cloud environments like AWS or Alibaba (with knowledge of CloudFormation or Terraform)
• Write and maintain SQL and Python data querying, aggregation and filtering code in SQL and Python
• Contribute to data schema structure and ensure adherence
• QA data as it comes into and out of our systems

• Excellent knowledge of serverless cloud architecture principles. Experience in at least one Cloud provider. Ideally AWS and Alibaba.
• 2+ years of experience writing test-drive Python in an agile environment
• 2+ years of experience implementing ETL flows using both file and API sources
• Prior experience with complex SQL queries, including sub-queries, case statements and UNION
• Prior experience implementing HTTP REST APIs
• Knowledge of data structuring and schema best practices and standards
• Ability to self-manage priorities in an environment with a constant mix of urgent and important
• Fluent written and spoken in English
• Thrilled to be part of a major worldwide sporting event
• Desirable familiarity with data science techniques in Python and/or R
• Desirable server-side Node JS experience