Data Engineer
- Job Ref: 5657
- Location: madrid, Spain
- Type: Fixed-Term
Overview
Data Engineer
Responsabilitites
- Support data science collecting and distributing necessary data, and presenting production predictive models for use in end-user products
- Implement and maintain key data flows in serverless frameworks
- ETL logic in frameworks such as Glue (AWS) and Data Works (Alibaba Cloud)
- Adaptors between systems in frameworks such as Lambda (AWS) or Function Compute (Alibaba Cloud)
- CI/CD in Cloud environments like AWS or Alibaba (with knowledge of CloudFormation or Terraform)
- Write and maintain SQL and Python data querying, aggregation and filtering code in SQL and Python
- Contribute to data schema structure and ensure adherence
- QA data as it comes into and out of our systems
- Excellent knowledge of serverless cloud architecture principles. Experience in at least one Cloud provider. Ideally AWS and Alibaba.
- 2+ years of experience writing test-drive Python in an agile environment
- 2+ years of experience implementing ETL flows using both file and API sources
- Prior experience with complex SQL queries, including sub-queries, case statements and UNION
- Prior experience implementing HTTP REST APIs
- Knowledge of data structuring and schema best practices and standards
- Ability to self-manage priorities in an environment with a constant mix of urgent and important
- Fluent written and spoken in English
- Thrilled to be part of a major worldwide sporting event
- Desirable familiarity with data science techniques in Python and/or R
- Desirable server-side Node JS experience
Virginia Dueñas, IT Recruitment Consultant - Your e-Frontiers consultant for this job
Virginia is an IT Recruitment Consultant with e-Frontiers. She is part of the Permanent IT Recruitment Team in Madrid where she sources DevOps, SysAdmin, Data (Data Scientist, Data Engineer, BI...) candidates for our clients. Virginia holds a degree in Pedagogy from Complutense University and a degree in Human Resources and Labor Relationship in Carlos III University. She loves her job, loves meeting and talking with people and growing personally.
Specialises in: DevOps, Security, Data
[email protected]
+34 689 97 32 20