Data Engineer

  • Job Ref: 5657
  • Location: madrid, Spain
  • Type: Fixed-Term

Overview

Data Engineer

Responsabilitites

  • Support data science collecting and distributing necessary data, and presenting production predictive models for use in end-user products
  • Implement and maintain key data flows in serverless frameworks
  • ETL logic in frameworks such as Glue (AWS) and Data Works (Alibaba Cloud)
  • Adaptors between systems in frameworks such as Lambda (AWS) or Function Compute (Alibaba Cloud)
  • CI/CD in Cloud environments like AWS or Alibaba (with knowledge of CloudFormation or Terraform)
  • Write and maintain SQL and Python data querying, aggregation and filtering code in SQL and Python
  • Contribute to data schema structure and ensure adherence
  • QA data as it comes into and out of our systems
Experience:
  • Excellent knowledge of serverless cloud architecture principles. Experience in at least one Cloud provider. Ideally AWS and Alibaba.
  • 2+ years of experience writing test-drive Python in an agile environment
  • 2+ years of experience implementing ETL flows using both file and API sources
  • Prior experience with complex SQL queries, including sub-queries, case statements and UNION
  • Prior experience implementing HTTP REST APIs
  • Knowledge of data structuring and schema best practices and standards
  • Ability to self-manage priorities in an environment with a constant mix of urgent and important
  • Fluent written and spoken in English
  • Thrilled to be part of a major worldwide sporting event
  • Desirable familiarity with data science techniques in Python and/or R
  • Desirable server-side Node JS experience