QWEN 3 Embedding Demo

View on GitHub | Discussion Article

Loading visualization...

Loading...

Select a task above to see how different instructions affect the embedding space.

About the Visualization

Each point represents a document from the 20 Newsgroups dataset. Colors indicate different categories. Hover over points to see the text preview. The UMAP projection shows how the task instruction reshapes the embedding space.

Task-Specific Embeddings: One model, different perspectives, no fine-tuning

This interactive visualization demonstrates how task instructions reshape QWEN-3 embedding models. Watch the same 800 documents (from 10 newsgroup categories) reorganize themselves four different ways—all through task instructions.

What are embeddings?

Embeddings are vector representations of text that capture semantic meaning. Similar texts have similar embeddings, enabling machines to understand and compare documents.

What makes task instructions powerful?

By providing an instruction like "Classify the sentiment..." or "Identify the topic...", you guide the model to reorganize the embedding space around task-relevant features. Same 800 documents, four completely different organizations.

The Four Tasks

The Dataset

10 categories from the 20 Newsgroups dataset (politics, science, sports, religion). Each point is one document, colored by category. The 2D projection uses UMAP dimensionality reduction.

How to Use

Technical Details

Model: QWEN-3-Embedding-0.6B (1024 dimensions)
Reduction: UMAP (n_neighbors=15, min_dist=0.1)
Documents: 800 (80 per category)
API: SiliconFlow