High-load analytical platform. Our team works in an atmosphere of high tension and intense interaction, expecting full engagement from each employee.
Responsibilities
- Monitoring, maintaining the operability and stability of the Hadoop cluster (HDFS, YARN, Hive/Spark) and associated components.
- Support and administration of Apache Airflow: monitoring DAG execution, troubleshooting task failures, restarting, optimizing schedules.
- Support of the Jupyter environment (JupyterHub): managing access, kernels, resources, assisting analyst users.
- Handling incidents and service requests (1st/2nd level), logging and tracking requests in the ticket system, escalating to 3rd level/development.
- Diagnosing and resolving failures: analyzing logs, metrics, identifying root causes.
- Participation in updates, patching, and planned maintenance on the test environment; monitoring status after changes.
- Maintaining and updating operational documentation, instructions, runbooks.
- Interaction with development teams, DevOps, analysts, and system owners.
Requirements
- Understanding of the Hadoop ecosystem architecture (HDFS, YARN, Hive, Spark) and principles of distributed data processing.
- Experience with Apache Airflow: understanding DAG structure, operators, troubleshooting and restarting tasks.
- Basic administration skills for Jupyter / JupyterHub.
- Confident knowledge of SQL.
- Confident work in Linux (command line, basic administration, log analysis).
- Knowledge of Python at the level of reading and editing scripts (for analyzing pipelines and DAGs).
- Skills in working with monitoring systems (Grafana, Prometheus, Zabbix — as an advantage) and ticket systems (Jira, ServiceNow, etc.).
Conditions
- annual salary review, annual bonus
- corporate gym and recreation areas
- over 400 educational programs from SberUniversity for professional and career development
- extended voluntary medical insurance, preferential insurance for family and corporate pension program
- mortgage with interest rate up to 7% for every employee
- free SberPrime+ subscription, discounts on products from partner companies
- reward for recommending friends to the Sber team.
