A new Large Language Model (LLM) routing system, called Arch-Router, promises to provide a more intuitive and adaptable approach to directing prompts. Developed in collaboration with Twilio and Atlassian, Arch-Router distinguishes itself from traditional embedding-based or performance-centric methods by utilizing plain language rules to map prompts to specific routing policies. This allows for easier customization and adaptation to shifting user intent. Key features include facilitated model swapping and continuous synchronization of routing logic with user quality judgments. The researchers have made the model and its associated code publicly available on GitHub and Hugging Face, encouraging community exploration and contributions.
Arch-Router Offers Subjective LLM Routing via Plain Language Rules
