Data Engineer

  • Job Ref: 5657
  • Location: madrid, Spain
  • Type: Fixed-Term

Overview

Data Engineer

Responsabilitites

  • Support data science collecting and distributing necessary data, and presenting production predictive models for use in end-user products
  • Implement and maintain key data flows in serverless frameworks
  • ETL logic in frameworks such as Glue (AWS) and Data Works (Alibaba Cloud)
  • Adaptors between systems in frameworks such as Lambda (AWS) or Function Compute (Alibaba Cloud)
  • CI/CD in Cloud environments like AWS or Alibaba (with knowledge of CloudFormation or Terraform)
  • Write and maintain SQL and Python data querying, aggregation and filtering code in SQL and Python
  • Contribute to data schema structure and ensure adherence
  • QA data as it comes into and out of our systems
Experience:
  • Excellent knowledge of serverless cloud architecture principles. Experience in at least one Cloud provider. Ideally AWS and Alibaba.
  • 2+ years of experience writing test-drive Python in an agile environment
  • 2+ years of experience implementing ETL flows using both file and API sources
  • Prior experience with complex SQL queries, including sub-queries, case statements and UNION
  • Prior experience implementing HTTP REST APIs
  • Knowledge of data structuring and schema best practices and standards
  • Ability to self-manage priorities in an environment with a constant mix of urgent and important
  • Fluent written and spoken in English
  • Thrilled to be part of a major worldwide sporting event
  • Desirable familiarity with data science techniques in Python and/or R
  • Desirable server-side Node JS experience

Virginia Dueñas, IT Recruitment Consultant - Your e-Frontiers consultant for this job

Virginia is an IT Recruitment Consultant with e-Frontiers. She is part of the Permanent IT Recruitment Team in Madrid where she is hiring Software Engineers, primarily in DevOps, QA and BI for our clients. Previous to joining e-Frontiers she was a Technical Recruiter with Walters People for C++, embedded software. Virginia holds a degree in Pedagogy from Complutense University and a degree in Human Resources and Labor Relationship in Carlos III University. She thinks that is really important the candidate feel comfortable during the interview. She loves her job because of meeting with people is the best way to grow in a personal way.

Specialises in: DevOps, Security, Data