Open-source AI models,
compared at a glance.

Distilled BERT model that encodes sentences into 384-dimensional vectors for measuring semantic similarity. Trained on over a billion sentence pairs spanning scientific papers, web QA, NLI datasets, and community forums. At 22M parameters and 6 transformer layers, it is fast enough for CPU inference while remaining competitive on standard sentence similarity benchmarks.

Google's original BERT base model in uncased form, pre-trained on BookCorpus and English Wikipedia via masked language modeling. Tokens are lowercased before processing, making it insensitive to capitalization. It remains a standard fine-tuning base for classification, NER, and extractive QA, though newer encoders outperform it on most benchmarks.

Cross-encoder reranker trained on the MS MARCO passage retrieval dataset, designed to score query-document pairs jointly rather than encoding them independently. Distilled from a 12-layer cross-encoder into 6 layers to reduce latency while retaining re-ranking accuracy. Used as a second-stage ranker on top of fast first-stage retrieval (BM25 or bi-encoder).

Small English dense embedding model from BAAI's BGE (BAAI General Embedding) series, producing 384-dimensional vectors via MIT license. Optimized for MTEB retrieval benchmarks through a retrieval-focused training strategy, it achieves competitive scores relative to its parameter count. Suited for embedding workflows where throughput and cost matter more than peak accuracy.

Multilingual sentence embedding model covering 50+ languages, built on a 12-layer distilled MiniLM architecture. Produces 384-dimensional vectors designed for semantic similarity and paraphrase detection across language boundaries. Trained on multilingual paraphrase data to align semantically equivalent sentences even when expressed in different languages.

ELECTRA base discriminator from Google, pre-trained using replaced token detection rather than masked language modeling. A small generator produces candidate replacements; this model learns to identify which tokens were swapped — a task that uses every token for training signal, making pre-training more efficient than BERT per compute dollar. Intended as a fine-tuning base for classification and token-level tasks.

UniDepth-v2 with ViT-L/14 backbone is a monocular metric depth estimation model that predicts absolute depth in meters from a single image without requiring depth sensors or camera calibration. It uses a ViT-L/14 image encoder and targets real-world deployment where accurate per-pixel depth maps from RGB images are needed. No standard pipeline_tag.

BAAI's BGE-M3 embedding model supporting over 100 languages with a unified architecture capable of dense, sparse (lexical), and late-interaction (ColBERT-style) retrieval modes from a single checkpoint. Built on XLM-RoBERTa with large-scale multilingual training, it targets multi-lingual and cross-lingual retrieval where a single model must handle diverse language inputs.

Qwen3-0.6B is the 0.6-billion-parameter instruction-tuned model from Alibaba Cloud's Qwen3 series, fine-tuned from the Qwen3-0.6B-Base for conversational and task-following use. It targets deployment in environments where even a 1B model is too large — edge hardware, mobile devices, or ultra-low-latency services. Apache 2.0 licensed.

Chronos-2 is Amazon's second-generation pretrained foundation model for zero-shot time-series forecasting. It frames forecasting as a language modeling problem over quantized time-series tokens using a T5 encoder-decoder architecture, enabling it to forecast across diverse domains without per-dataset training. Released under Apache 2.0.

Sentence embedding model based on the MPNet architecture, producing 768-dimensional vectors. Trained on over a billion sentence pairs from MS MARCO, NLI datasets, and community QA forums, it is frequently used when accuracy matters more than inference speed among English embedding models. The MPNet backbone enables masked and permuted prediction during pre-training for stronger representations.

T5-small is the 60M-parameter variant of Google's Text-to-Text Transfer Transformer, casting all NLP tasks as seq2seq problems. It was influential in establishing the unified text-to-text training paradigm but is outdated for production use.

OpenAI's CLIP model using a ViT-B/32 image encoder, the smaller of the two widely deployed CLIP variants. Trained contrastively on 400 million image-text pairs, it aligns image and text representations in a shared embedding space for zero-shot classification and retrieval. The B/32 variant sacrifices accuracy versus ViT-L/14 for faster inference.

XLM-RoBERTa base from Facebook AI, pre-trained on 2.5TB of filtered CommonCrawl text across 100 languages using the RoBERTa training procedure. Enables cross-lingual transfer — models fine-tuned on labeled English data can infer on other languages without parallel annotations. The standard starting point for multilingual classification and token-level tasks.

BGE-Reranker-v2-M3 is BAAI's multilingual cross-encoder reranker built on XLM-RoBERTa, designed for re-ranking retrieved passages in multilingual RAG or search pipelines. It jointly encodes query-passage pairs to produce relevance scores, providing higher accuracy than bi-encoder similarity for the same candidate set. Apache 2.0 licensed with text-embeddings-inference support.

OPT-125M is the smallest model in Meta's Open Pretrained Transformer series, a 125-million-parameter decoder-only LLM trained on a dataset comparable to GPT-3's training mix. Released as part of Meta's effort to make large language model weights accessible for research. At 125M parameters it is primarily used for prototyping, educational purposes, and compute-constrained environments.

MobileNetV3 small model at 100% width multiplier, trained on ImageNet-1k using the LAMB optimizer via the timm library. At under 3M parameters, it targets image classification on mobile and edge hardware where latency and memory are primary constraints. Part of timm's standardized pretrained model zoo with consistent preprocessing and inference APIs.

A minimal Qwen2-architecture causal LM created by the TRL (Transformer Reinforcement Learning) team for internal testing purposes. It is not intended for any production use or meaningful text generation — it exists to provide a tiny, fast-loading model compatible with Qwen2 tokenization for unit testing TRL training scripts.

Qwen3-8B is the 8-billion-parameter instruction-tuned model from Alibaba Cloud's Qwen3 family, positioned at the competitive midpoint between 4B and 14B+ tiers. It targets deployment on single consumer or workstation GPUs while providing strong reasoning and multilingual capabilities. Apache 2.0 licensed with text-generation-inference compatibility.

Nomic Embed Text v1.5 is a matryoshka-capable English embedding model from Nomic AI, built on a custom nomic-BERT architecture trained with contrastive learning on large-scale text pairs. Matryoshka Representation Learning allows truncating embeddings to shorter dimensions (e.g. 64, 128, 256) without retraining, enabling flexible precision-cost tradeoffs. The model is transformers.js-compatible for browser-side inference.

Multilingual-E5-Small is a compact multilingual embedding model from Microsoft Research supporting 100+ languages on a BERT-based backbone, smaller and faster than the E5-large variant. It uses the same instruction-prefix training approach as E5-large ('query:'/'passage:') for asymmetric retrieval. MIT licensed with ONNX and OpenVINO export.

Qwen2.5-1.5B-Instruct is a 1.5-billion-parameter instruction-tuned model from Alibaba Cloud's Qwen2.5 series, targeting edge and embedded deployment scenarios where even a 3B model is too large. Apache 2.0 licensed, it focuses on basic instruction following and short-context tasks at minimal compute cost.

OpenAI's original GPT-2 at 124M parameters, an autoregressive language model trained on WebText (over 8 million web documents filtered from Reddit outlinks). It generates English text continuation given a prompt using next-token prediction, trained without any instruction tuning or RLHF. MIT licensed and runnable on commodity CPU hardware.

Chronos-Bolt-Small is a small time-series foundation model from AutoGluon, using a T5-based encoder-decoder architecture for zero-shot forecasting. The 'Bolt' variant improves over original Chronos through training and architectural refinements for better speed and accuracy. Apache 2.0 licensed and part of the AutoGluon time-series forecasting ecosystem.