Senior Big Data Engineer

PURPOSE OF THE JOB

As a Senior Big Data Engineer, you will work on one of the world largest marketplace, dealing with one billion events per day and contribute as part of R&D self-organized team working in a challenging, innovative environment for our Customer.

*Need to be able to travel at least for 3 months to USA/Berlin and potentially relocation to USA

MAIN TASKS AND RESPONSIBILITIES

Work proactively on the system architecture, choosing optimal solutions to build scalable and reliable systems to process key financial data.

Data processing system optimization and tuning

Establish a monitoring system

Ensure high-quality development standards (unit/integration tests, etc.)

Collaboration with the product management team to incorporate the needs of our customers.

Develop new generation big data pipelines, by migrating from batch processing into near-real-time architecture

EDUCATION, SKILLS AND EXPERIENCE

5+ years of commercial SW development experience at least with one of the following languages: Java/Clojure/Groovy/Kotlin/JRuby/Jython

1+ years of commercial Scala development (at least)

Several years of experience in big data technologies and tools.

ETL or Pipeline design/implementation with Large Distributed Databases (Hive/Spark/Scala preferred)

Hands-on experience with Spark, Kafka, HBase, NoSQL-Databases.

Pipeline stability and performance tuning

Working knowledge of relational databases and query authoring (SQL)

Familiarity with the AWS-Stack (AWS EMR).

Rigor in high code quality, automated testing, and other engineering best practices

Experience in data validation, sampling & regression tests

Good English (oral & written) and communication skills in general

WOULD BE A PLUS

Commercial experience with Real-time processing systems (Spark Streaming, Storm)

Design and development of robust distributed systems

Having experience working with AirFlow, Hive, Presto

Payment data processing or system design knowledge

LOHIKA BENEFITS

Friendly and highly professional teams

Modern office facilities (kitchens, gym, yoga, playroom, coffee and tea points etc.)

Regular (twice a year) performance reviews

Fully paid English classes with certified teachers and native speakers

Internal and external training

Paid sick-leaves

Premium health insurance (medication, massage, and doctor in the office etc.)

20 working days of annual paid vacation

Christmas and other state holidays

Corporate events (corporate parties, sports competitions, What? Where? When? Team etc.)

Incentives (marriage, childbirth gifts)