Data Engineer

  • Job Ref: 5155
  • Location: Madrid, Spain
  • Type: Permanent

Overview

Data Engineer

The Role

We are looking for a Senior Data Engineer to work in a multi-disciplined team, working alongside Developers, Designers and Product Owners, who will own their work from the initial idea to the final implementation. We are continually gathering information on travel related events and are looking for someone to help us make the most of a large-scale distributed data system. The role will allow for opportunities to work in a variety of areas such as digital, logistics, predictive maintenance, and anything else that you may think of, or that will come your way.

The Person

  • Big Data: Experience with technologies like Hadoop, Spark, Kafka, Cassandra, Mesos/YARN
  • Evidence of Data Processing at Scale – designing, developing and continually improving tools
  • Experience in any of the following areas is a bonus – APIs, Personalisation (classifiers, recommendation & prediction services), automation
  • Experience designing, developing, testing and continually improving tools which deliver scalable and effective data infrastructure systems
  • Evidence of delivering continual improvements in availability, scalability, monitoring, concurrency, fault tolerance, latency, automation and related areas
  • Cloud native system design
  • Familiar with Hadoop administration, monitoring, performance tuning, troubleshooting
  • Designing ETL/ Data Load architectures within the Hadoop Ecosystem
  • Streaming applications design with Storm and Spark Streaming

Required Skills:

  • Develop Spark applications in Java, Scala or Python
  • Solid experience in SQL and Java / Scala programming
  • Clear understanding of Hadoop stack, its architecture and configuration
  • Familiar with Hadoop administration, monitoring, performance tuning, troubleshooting
  • Experience with cloud architecture (AWS) would be a plus
  • Streaming applications design with Storm and Spark Streaming would be a plus

Fluent in English