Autonomy Realms

Embeddings and Semantic Search


Embeddings are what make semantic search possible in Autonomy Realms. Instead of searching by exact keywords, you search by meaning — and the system finds content that is conceptually similar to your query.

What Are Vector Embeddings

A vector embedding is a list of numbers that represents the meaning of a piece of text. When you send text to an embedding model (Autonomy Realms uses OpenAI's text-embedding-3-small), it returns a high-dimensional vector — a point in mathematical space where similar meanings cluster together.

Two signals about "walking through a forest at dawn" and "hiking in the woods at sunrise" would produce vectors that are close together, even though they share almost no exact words. A signal about "quarterly revenue projections" would produce a vector far away from both.

How Semantic Search Works

When you search in Autonomy Realms, your query is converted into a vector using the same embedding model. The system then compares your query vector against every stored embedding and returns the closest matches — ranked by similarity.

This means you can search for:

  • A concept or feeling ("signals about loss and recovery")
  • A paraphrase of something you remember ("that time I talked about the river")
  • A thematic question ("what have I said about community?")

The search finds relevant results even when the exact words do not match.

Embedding Prompts

What gets embedded is not just the raw signal text. An embedding prompt defines how the signal's data is formatted before being sent to the embedding model. This prompt assembles fields like the title, summary, transcript, tags, and themes into a single text block optimized for embedding.

Each entity type — signal, cluster, shape — has its own embedding prompt. Clusters and shapes also include sub-templates that define how their children (signals or clusters) are rendered within the embedding text.

You can customize embedding prompts in Settings > Templates to control exactly what text is embedded and how it is structured.

Signals, Clusters, and Shapes

Embeddings are generated for all three entity types:

  • Signal embeddings — capture the meaning of an individual signal
  • Cluster embeddings — capture the combined meaning of all signals in the cluster
  • Shape embeddings — capture the meaning across all clusters in the shape

This means semantic search works at every level of your archive. You can find individual signals, thematic clusters, or broad patterns — all by meaning.

Regenerating Embeddings

Embeddings can be regenerated at any time. If you update a signal's content, change the embedding prompt template, or add new signals to a cluster, regenerating the embedding ensures the vector reflects the current state of the content.