Data Engineer

  • Job Ref: 5155
  • Location: Madrid, Spain
  • Type: Permanent

Overview

Data Engineer

The Role

We are looking for a Senior Data Engineer to work in a multi-disciplined team, working alongside Developers, Designers and Product Owners, who will own their work from the initial idea to the final implementation. We are continually gathering information on travel related events and are looking for someone to help us make the most of a large-scale distributed data system. The role will allow for opportunities to work in a variety of areas such as digital, logistics, predictive maintenance, and anything else that you may think of, or that will come your way.

The Person

  • Big Data: Experience with technologies like Hadoop, Spark, Kafka, Cassandra, Mesos/YARN
  • Evidence of Data Processing at Scale – designing, developing and continually improving tools
  • Experience in any of the following areas is a bonus – APIs, Personalisation (classifiers, recommendation & prediction services), automation
  • Experience designing, developing, testing and continually improving tools which deliver scalable and effective data infrastructure systems
  • Evidence of delivering continual improvements in availability, scalability, monitoring, concurrency, fault tolerance, latency, automation and related areas
  • Cloud native system design
  • Familiar with Hadoop administration, monitoring, performance tuning, troubleshooting
  • Designing ETL/ Data Load architectures within the Hadoop Ecosystem
  • Streaming applications design with Storm and Spark Streaming

Required Skills:

  • Develop Spark applications in Java, Scala or Python
  • Solid experience in SQL and Java / Scala programming
  • Clear understanding of Hadoop stack, its architecture and configuration
  • Familiar with Hadoop administration, monitoring, performance tuning, troubleshooting
  • Experience with cloud architecture (AWS) would be a plus
  • Streaming applications design with Storm and Spark Streaming would be a plus

Fluent in English

Virginia Dueñas, IT Recruitment Consultant - Your e-Frontiers consultant for this job

Virginia is an IT Recruitment Consultant with e-Frontiers. She is part of the Permanent IT Recruitment Team in Madrid where she is hiring Software Engineers, primarily in DevOps, QA and BI for our clients. Previous to joining e-Frontiers she was a Technical Recruiter with Walters People for C++, embedded software. Virginia holds a degree in Pedagogy from Complutense University and a degree in Human Resources and Labor Relationship in Carlos III University. She thinks that is really important the candidate feel comfortable during the interview. She loves her job because of meeting with people is the best way to grow in a personal way.

Specialises in: DevOps, QA, Security Consultants, BI, Data Science