DevOps/Security Engineer (Linux)
Company: DYN-IT
Employment type: CONTRACTOR
Project:
Deployment of a local AI server (LLM) based on Ollama/OpenWebUI, and development of a RAG assistant that answers user questions based on a knowledge base.
Responsibilities
- Initial setup, configuration and hardening of a Linux server (GPU) for local LLM deployment
- Firewall configuration, TLS 1.3, patch/vulnerability management
- Running services without root privileges (dedicated service account), minimal container privileges
- Reverse proxy/WAF configuration in front of the API and web interface
- Logging and monitoring setup (including syslog)
- Role-based access configuration and separation of users/environments (multi-tenancy)
Requirements
- Solid hands-on experience administering and hardening Linux servers
- Experience with containers (Docker/Podman) and network security
- English - B2 or above
Nice to have
- Experience building RAG agents/pipelines (retrieval, vector databases, embeddings) - the project has adjacent tasks in this area
- Experience with Ollama/OpenWebUI or similar LLM-serving tools
- Experience with SSO/MFA integration and role-based access models
- German language
Conditions
- Project-based work, fully remote
- Priority given to candidates based in Eastern Europe
- Compensation: negotiable
