Photo by Andi sabandi on Pexels

Facing complex system issues, system administrators are increasingly experimenting with Artificial Intelligence, specifically small language models (SLMs) integrated with Retrieval-Augmented Generation (RAG). The approach involves feeding system logs into an SLM, enriched by a knowledge base of internal documentation, to generate potential solutions. One administrator, currently leveraging Phi4-mini and local knowledge articles using RAG via Ollama, has shared their experience and sought advice on Reddit after facing initial challenges. The hope is that AI can streamline troubleshooting and improve efficiency within IT departments. The original discussion can be found on Reddit: [https://old.reddit.com/r/artificial/comments/1n8acpo/utilizing_small_language_model_coupled_with_rag/]