Few-shot Learning
Few-shot Learning (Meta-learning with Limited Labeled Examples) · Also known as: FSL, low-shot learning, k-shot learning, meta-learning for few examples
Few-shot learning is a machine learning paradigm that trains models to recognize new classes or solve new tasks from only a handful of labeled examples — typically one to five — by leveraging prior knowledge acquired from a large, related training distribution. It is especially relevant in domains where labeling is expensive, scarce, or structurally limited.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
+17 more
When to use it
Use few-shot learning when labeled data for a target task is genuinely scarce — fewer than roughly 10 to 20 examples per class — but a large related dataset is available for pre-training or meta-training. Typical use cases include rare-disease classification, endangered-species recognition, low-resource language tasks, and personalized recommendation with cold-start users. Do not use it as a substitute for collecting more labeled data when labeling is feasible; with sufficient labels, fully supervised or fine-tuned transfer learning will nearly always outperform few-shot methods. Also avoid it if the meta-training distribution is very different from the target domain, as this invalidates the learned prior.
Strengths & limitations
- Enables practical learning from one to five labeled examples per class, dramatically reducing annotation cost.
- Episodic training explicitly prepares the model for the low-data deployment scenario it will face.
- Metric-based variants (Prototypical Networks, Matching Networks) are computationally lightweight at inference — no gradient steps required.
- Widely applicable across vision, NLP, audio, and structured data tasks.
- Naturally integrates with large pre-trained models, allowing powerful priors to be exploited without full fine-tuning.
- Requires a large, diverse meta-training set; performance degrades sharply when the meta-training and target distributions diverge significantly.
- Optimization-based methods (e.g., MAML) are computationally intensive during meta-training due to second-order gradients.
- Benchmark accuracy on standard datasets (miniImageNet, Omniglot) can overstate real-world performance if the test domain differs.
- Choosing the right architecture, embedding backbone, and episode sampling strategy involves non-trivial hyperparameter decisions.
- With more than about 20 labeled examples per class, standard transfer learning or fine-tuning typically offers better accuracy with less complexity.
Frequently asked
What is the difference between few-shot learning and transfer learning?
Transfer learning fine-tunes a pre-trained model on a new task and typically benefits from tens to thousands of labeled examples. Few-shot learning is specifically designed to adapt with only one to five examples per class, using episodic meta-training so the model learns how to generalize quickly rather than how to fit a specific domain.
What does k-shot n-way mean?
It describes the episode structure: n-way means n novel classes are presented simultaneously, and k-shot means k labeled examples are provided per class. A 5-way 1-shot task asks the model to classify query images into one of five categories given only a single labeled example for each.
Do I need a GPU to run few-shot learning?
Meta-training — especially optimization-based methods like MAML — requires substantial compute and is typically done on GPUs. However, metric-based inference (comparing query embeddings to support prototypes) is cheap and can run on CPU in production once the backbone is pre-trained.
How many meta-training tasks do I need?
This depends on diversity rather than absolute count. A few thousand episodically sampled tasks from a varied class pool is a common baseline. What matters most is that the meta-training classes are numerous and diverse enough to generalize to unseen target classes.
Is few-shot learning the same as zero-shot learning?
No. Zero-shot learning requires no labeled examples from novel classes at test time, relying entirely on semantic class descriptors or attributes. Few-shot learning always provides at least one labeled example per novel class in the support set.
Sources
- Vinyals, O., Blundell, C., Lillicrap, T., Wierstra, D., & Kavukcuoglu, K. (2016). Matching Networks for One Shot Learning. Advances in Neural Information Processing Systems (NeurIPS), 29. link ↗
- Finn, C., Abbeel, P., & Levine, S. (2017). Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. Proceedings of the 34th International Conference on Machine Learning (ICML), PMLR 70:1126–1135. link ↗
How to cite this page
ScholarGate. (2026, June 3). Few-shot Learning (Meta-learning with Limited Labeled Examples). ScholarGate. https://scholargate.app/en/machine-learning/few-shot-learning
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Metric LearningMachine learning↔ compare
- Self-supervised LearningMachine learning↔ compare
- Semi-supervised LearningMachine learning↔ compare
- Transfer LearningMachine learning↔ compare