Questions tagged [embeddings]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
17 votes
3 answers
8k views

Can an LLM be constrained to answer questions only about a specific dataset?

I've seen this, this, this, and this. But my question is different. Whether I use ChatGPT's API or any of the LLM's supported by GPT4All, when I deploy my GenAI app for people to use, I want it to ...
Nav's user avatar
  • 331
8 votes
2 answers
533 views

ChatGPT API Embedding Vectors - Are vectors standard across LLM's?

Can embeddings from one LLM's reused by others - any specific standardization exists on embeddings representation? reference - https://platform.openai.com/docs/guides/embeddings/what-are-embeddings
sumeet kumar's user avatar
4 votes
1 answer
1k views

How can text embeddings be used by LLMs like ChatGPT?

My understanding of embeddings is this: Given some text string an embedding function (API) generates an embedding (a fixed-length vector of floats). Semantically similar texts have nearby vectors. ...
Hans-Peter Stricker's user avatar
2 votes
2 answers
140 views

Embeddings: How can I find out, that I'm out-of-vocabulary?

I have a german dataset of financial/annual reports of companies. For example, I use the gensim package to embed my dataset with word2vec or use the huggingface package to embed. How can I find out, ...
Christian01's user avatar
2 votes
2 answers
189 views

What works better: An LLM trained on better texts or an LLM with better prompts?

Assume you have a very large corpus of high-quality documents related to a given topic, and assume you have a pretrained large language model (the foundation model) with training data not containing ...
Hans-Peter Stricker's user avatar
1 vote
1 answer
270 views

Best-Practice in word-embeddings

In my project I follow the retrieval augmented generation (RAG) approach. I want to create embeddings for my own dataset and use it in combination with llama-2. In the dataset are german annual ...
Christian01's user avatar
0 votes
0 answers
13 views

Interpretation of Evaluation Values of Augmented SBERT Training with EmbeddingSimilarityEvaluator()

I train a BI-Encoder to get an Augmented SBERT and I get a final training result. How can I interpret the following output of the final training result? EmbeddingSimilarityEvaluator: Evaluating the ...
Christian01's user avatar
0 votes
0 answers
24 views

The using of golden dataset in Augmented SBERT Training

I use the training strategy of Augmented SBERT (Domain-Transfer) to train an augmented SBERT. In the code example they use the golden-dataset (STSb) for the training evaluator. Here two code snippets ...
Christian01's user avatar