Digital Lexicon Hub logo

Digital Lexicon Hub

THE TECHNICAL LANGUAGE OF DIGITAL B2B INFRASTRUCTURE

CONCEPT
INTELLIGENT AUTOMATION

Small Language Model (SLM)

A language model with far fewer parameters than a large language model, built to run efficiently on limited hardware or for narrow tasks.


BUSINESS RELEVANCE

SLMs can run on company servers, laptops or edge devices, which reduces cost and latency per request and keeps sensitive data in-house for tasks like classification, extraction and routing.


IMPLEMENTATION EXAMPLE

A law firm fine-tunes a 3.8-billion-parameter Phi model on 20,000 labeled emails to classify matters and extract deadlines, running it on an on-premises GPU so client data never leaves its network.


LIMITATIONS

SLMs have narrower knowledge and weaker reasoning on complex or open-ended tasks, and they can still hallucinate and inherit bias from teacher models. Results usually depend on task-specific Fine-Tuning and evaluation.


TECHNICAL EXPLANATION

SLMs use the same transformer architecture as a Large Language Model (LLM) but typically have from a few million to a few billion parameters, compared with hundreds of billions. They are built or reduced through knowledge distillation from a larger teacher model, pruning of weights or layers, quantization from 32-bit floats to 8-bit or lower integers, and low-rank factorization. Examples include Microsoft Phi, Google Gemma, IBM Granite and Ministral.


Secondary Topics

AI Governance, Systems Architecture

Sources

IBM — What are small language models? — https://www.ibm.com/think/topics/small-language-models; Microsoft Azure — Phi open models — https://azure.microsoft.com/en-us/products/phi

Related terms

Generative AI (GenAI)

CONCEPT
INTELLIGENT AUTOMATION

Generative AI covers models such as LLMs and diffusion models that create new content from prompts, used for drafting, summarizing, coding and design.

Lookalike Audience

CONCEPT
PERFORMANCE ADVERTISING

Lookalike audiences let Meta, Google and other ad platforms find new users who resemble a seed list of customers, site visitors or high-value buyers.

Crawl Budget

CONCEPT
SEARCH OPTIMIZATION

Crawl budget combines Googlebot's crawl capacity limit and crawl demand; it matters mainly for very large or fast-changing sites with many URLs.

Indexability

CONCEPT
SEARCH OPTIMIZATION

The technical state determining whether a search engine can add a crawled URL to its index, based on status codes, directives and canonicals.

Design System

CONCEPT
EXPERIENCE DESIGN

A unified collection of repeatable UI components, guidelines, tokens, and design standards ensuring digital product consistency.