PROJECT INFORMATION:
Industry: Banking
Location: hybrid (visit the Warsaw office 1/week or 100% remote)
Remuneration: up to 180 PLN/h netto + VAT (B2B)
Start: ASAP
RESPONSIBILITIES:
Take in queries from the DROC team and understand the requests/requirements;
Be the first level of support;
If the case cannot be resolved by oneself, triage/classify the issues and identify which team to reach out to - dev team/platform team;
Track and report the progress to DROC and PO;
Execute ETL runs on DROC validation on Hadoop infrastructure;
Refresh UIs for DROC validation using elastic search;
Support DROC to write spark/hive queries if needed to analyze a dataset;
Support the dev and DROC teams for config changes if specified by the relevant team.
REQUIREMENTS:
Understand end-to-end ETL pipeline;
Competent in data engineering principles:
o Write Hive SQL (SPARK) queries (crucial)
o SCALA knowledge (crucial)
o Shell scripting (important)
o How to work on Cloudera distribution (Oozie) (important)
o Elasticsearch (basic knowledge)
o Quantexa (important)
Familiar with but not needed to be expert in:
o IntelliJ
o Zeppelin
o Bamboo, Jenkins, Nexus, Artifactory
o Kafka
WE OFFER:
Constant contact with the recruiter during the process and feedback regardless of the recruitment result;
Attractive remuneration in the B2B model depending on your competencies and experience;
Co-financing of private medical care (Medicover) and the Multisport card;
Occasional company integration meetings;
emagine mobile application - easy reporting of working time, quick access to new offers;
Transparently built relations based on trust and fair play.