All Questions

Filter by
Sorted by
Tagged with
1 vote
0 answers
19 views

RAG: What is the advantage of using Llama Index with Langchain?

I'm creating a RAG (Retrieval-Augmented Generation) application and have a question about using LlamaIndex and Langchain. LlamaIndex is designed for document indexing, while Langchain supports ...
Gillespie's user avatar
  • 111
1 vote
1 answer
18 views

How can I increase the maximum number of images for a single request with GPT4o on Azure?

I use gpt-4o-2024-05-13 via Azure. By default, the current maximum number of images for a single request is 20, since I get that error otherwise: Error code: 400 - {'error': {'code': 'BadRequest', '...
Franck Dernoncourt's user avatar
-1 votes
0 answers
8 views

Having issues with RAG Application it's working but not providing me the most relevant answer from the documents i have provided there is no problems

Having issues with RAG Application it's working but not providing me the most relevant answer from the documents i have provided there is no problem to connect with LLm main problem is not getting ...
Zaid Ghaffar's user avatar
3 votes
1 answer
54 views

Does the image generator work in the free version of ChatGPT?

I am using the free version of ChatGPT. Recently, the image generator has appeared there. However, I couldn't generate even one image with it. I always get this result: Me: Generate image of a ...
Pavel_K's user avatar
  • 133
0 votes
1 answer
26 views

How do I anonymize the e-mails inside of code or text so that I do not need to share them with ChatGPT?

I need to anonymize a pile of code or text files that sometimes have e-mails with person names or other company or institution names that I do not want to share with ChatGPT. The aim is to get a ...
questionto42's user avatar
1 vote
1 answer
23 views

How to detect multiple tasks in a single command using LLM or any NLP model?

I am building a bot that takes inputs from users and performs action. Now I want it to differentiate between commands that contain single task and multiple tasks. How can I make this a reality? Should ...
Rishabh Tripathi's user avatar
4 votes
2 answers
81 views

How do people fine tune LLMs to only answer domain specific questions?

So I am new to LLMs and learning new things daily like RAG systems and stuff. I am right now trying to create a chatbot using OpenAI API that should answer questions specific to a particular format of ...
Yash Bajpai's user avatar
2 votes
2 answers
34 views

Efficiency of ReRanker in RAG system for private data retrieval

I'm building a Retrieval-Augmented Generation (RAG) system to process and answer queries on private data. I understand that the ReRanker component is crucial for filtering and ordering retrieved ...
CrazyCoder's user avatar
1 vote
0 answers
14 views

Separating information in prompt

I have multiple pieces of information to include in the prompt. There are various ways that I can separate them. I can separate them using XML tags, or putting the data in JSON format, or some ad-...
D.W.'s user avatar
  • 111
0 votes
1 answer
24 views

How do I merge scattered and intertwined projects from SSIS, stored procedures, and Access databases into one SSIS project with the help of a ChatGPT?

I want to merge some projects into one. The projects have grown over a long time, some have grown a lively life of their own so that there seem to be intertwined or repeating workflows among the ...
questionto42's user avatar
0 votes
1 answer
13 views

How do I shrink down an SSIS project of two million characters to a core size that chatgpt 4 omni can eat and digest to wrap it up in C# and UML?

I have an average sized SSIS project at hand that I want to feed to the GPT chat to get pure C# code for an SSIS Script component. I also want to ask the bot to show a range of UML workflows, and when ...
questionto42's user avatar
0 votes
1 answer
35 views

How do chatbots interface with LLMs?

I'm trying to understand how chatbots such as ChatGPT work on top of a LLM. I understand that at the basis chatbots have a LLM model that converts text to tokens and then continues the sequence of ...
jurez's user avatar
  • 101
3 votes
2 answers
78 views

Do LLMs “pause to think”?

Sometimes it seems like an LLM takes longer to respond, perhaps if the question is somehow more difficult. But maybe this is an illusion. Is there any reason that a response would take longer? Is ...
Julius Hamilton's user avatar
0 votes
1 answer
37 views

How to generate RWBY-style teams of characters using an LLM?

If you don't know what I mean by "RWBY-style character teams":. In this series (made/produced by Rooster Teeth) the teams are named like "RWBY" where the team's name are the ...
user56510's user avatar
-1 votes
1 answer
15 views

Do Azure OpenAI Service's content filters depend on the OpenAI GPT models? Or are they independent?

Do Azure OpenAI Service's content filters depend on the OpenAI GPT models? Or are they independent? In other word, does the moderation done by those content filters the same for any GPT model or does ...
Franck Dernoncourt's user avatar
-1 votes
1 answer
54 views

How do I count the number of characters (with any whitespaces) or words in a GPT Chat to find out the border of the chat size?

I chat in a local frontend of GPT 3.5 Turbo or GPT 4 omni. That means, I am not on the openAI website, the chat is in a frontend of the company so that the chat border for characters or words could be ...
questionto42's user avatar
0 votes
0 answers
27 views

Fast Mistral text generation

I would like to ask the general public about how fast they can get Mistral text generation going on basic hardware. Consider 2 mid-tier GPUs, 60 Gig ram and amnd 20 cores. How quickly can you get ...
mathlete42's user avatar
-1 votes
0 answers
52 views

What's are some of the best non-neural network based chat bots?

Neural network based chat bots are amazing, but it makes me wonder what the limit is in terms of chat bots that don't rely on neural networks (ik it's going to be absolutely horrendous compared to ...
RandomGamingDev's user avatar
-1 votes
0 answers
31 views

How do I save and use a fine-tuned LLM model

This may seem like a very basic question, but I've just started learning about LLM's and how to fine tune them for particular tasks. So, I found this google collab notebook by UnSloth (https://colab....
L lawliet's user avatar
2 votes
0 answers
24 views

Are there any differences between OpenAI models available on OpenAI.com and OpenAI models available on Azure?

I wonder whether there exist any difference between OpenAI models available on OpenAI.com and OpenAI models available on Azure.
Franck Dernoncourt's user avatar
1 vote
0 answers
40 views

Strange hallucination of Copilot on the simple question about ffmpeg

Did anyone encounter something like this? I am citing my dialogue with MS Copilot. Please generate a ffmpeg command to add the old analog camera effect to the video and slow it 5 times To add an old ...
Andrei Vukolov's user avatar
1 vote
0 answers
17 views

Which OpenAI GPT models, if any, allow specifying top_k?

I don't see top_k in the current doc but seems to be mentioned in the past. Which OpenAI GPT models, if any, allow specifying top_k?
Franck Dernoncourt's user avatar
1 vote
1 answer
37 views

Why isn't it generally recommended to alter both the temperature and `top_p` when calling GPT?

I read on platform.openai.com/docs/api-reference/chat/create: We generally recommend altering [the temperature] or top_p but not both. Why isn't it generally recommended to alter both the ...
Franck Dernoncourt's user avatar
-1 votes
1 answer
41 views

How Google's TextFX experiment works?

Link: https://textfx.withgoogle.com/ How can an LLM be trained to perform things like this experiment site does? (Visit the site and you will find out more about these tools.) This is different from ...
user56510's user avatar
2 votes
2 answers
54 views

How Can I Add Memory to My RAG-Based Chatbot for Better Responsiveness?

I have developed a chatbot utilizing the RAG methodology. However, there is an issue where it does not retain previous conversations. Does anyone suggest integrating memory into the chatbot to enhance ...
Kraftors Web Solutions Pvt Ltd's user avatar
-1 votes
0 answers
48 views

TypeError: ufunc 'isfinite' not supported for the input types, and the inputs could not be safely coerced to any supported types according to the

I'm trying to compute VIF for the dataFrame which consists features selected by rfe. however i get this error message when i run the line. vif['VIF'] = [variance_inflation_factor(X_train_rfe.values, ...
Reihane's user avatar
-1 votes
0 answers
17 views

Do you use any smart terminals?

Do you use any smart terminals such as Termius, Shell gpt, Interpreter or any other? Do you see any advantages or disadvantages? Do you manage your systems using those?
Flaflapoms's user avatar
2 votes
3 answers
119 views

What tasks are LLMs capable of doing?

Other than they being used to get answers when a question is prompted, and to write (source code, stories, etc), are there any tasks that they can do (specially when fine tuned)? Are there some ...
user56510's user avatar
2 votes
2 answers
130 views

It is possible to train a GPT model to imitate a fictional character?

It is possible to do so, in a way that it has the characteristics of a fictional character, including the name? For instance could I make the model behave like the goddess Hera?
user56510's user avatar
0 votes
0 answers
16 views

How do fine-tune llama3 based on documentation from a web site?

I'm able to scrape the content from the web site and put it in a json file. I was able to follow the steps laid out to me by chat-gpt but the results are terrible. It's not picking up on any of the ...
chovy's user avatar
  • 101
1 vote
1 answer
89 views

Prompting ChatGPT to restructure a given text

I want to prompt ChatGPT to restructure a given text according to a provided schema. The issue is that I can not seem to bring it to restructure everything that is contained in the document. It always ...
BJones's user avatar
  • 11
1 vote
2 answers
69 views

prompt llm to generate an email with well structured line breaks

I'm using the latest llms (mixtral/gemini/..) I'm generating emails and I'm satisfied with the results except that the sentences are without proper line breaks. The greeting and signature parts are ok ...
kambi's user avatar
  • 131
1 vote
0 answers
71 views

LLAMA2 system prompt for RAG

Working on LLAMA2 to make a Retrieval Augmented Generation system. I have been using the meta provided default prompt which was mentioned in their paper. But this prompt doesn't seem to work well on ...
hafiz031's user avatar
  • 171
4 votes
1 answer
203 views

LLMs, by their very nature, don't have a concept of "source" - is this true?

Summarize the problem LLMs, by their very nature, don't have a concept of "source". Attribution is pretty much impossible. Attribution only really works if you use language models as "...
user10186832's user avatar
2 votes
1 answer
29 views

How to find proper context in open book question answering?

I want to make an Open Book Question Answering / Retrieval Augmented Generation system. The major concern here is the proper context selection. There are some fundamental issues related to this. For ...
hafiz031's user avatar
  • 171
1 vote
1 answer
33 views

What's GPT-3.5-Turbo-0314? Same as GPT-3.5-Turbo-0301?

I see GPT-3.5-Turbo-0314 in https://chat.lmsys.org/?leaderboard: but I can't find GPT-3.5-Turbo-0314 in the OpenAI docs. The closest model (closest based on dates) I can see in https://platform....
Franck Dernoncourt's user avatar
3 votes
3 answers
84 views

Can GPT models be used for text prediction/autofill?

The title says it all. Can they be used in a way that is not for generation of text based on a prompt, but instead for word suggestions based on the context of previously written text?
user56510's user avatar
2 votes
0 answers
38 views

What are examples of statistically confirmed LLM functions?

I am looking for examples from research of highly statistically reliable LLM functions. So instead of using an LLM in a general purpose way, an exact, replicable LLM setup where it is guaranteed to do ...
Julius Hamilton's user avatar
1 vote
1 answer
83 views

How does Meta Llama-3 LLM compare against GPT 4, Claude Opus, and Mistral-Large on human evaluations?

https://ai.meta.com/blog/meta-llama-3 compared Meta Llama-3 LLM compare against GPT 3.5, Claude Sonnet and Mistral Medium on human evaluations: They conveniently avoided the state-of-art LLMs, namely ...
Franck Dernoncourt's user avatar
1 vote
1 answer
62 views

Why does RAG work?

Consider a corpus of answer sheets of History exam at high school level. Say it is 10 GiB in size. Case 1 Assume that these answer sheets were part of much larger corpus used to train an LLM such as ...
cogitoergosum's user avatar
1 vote
0 answers
90 views

Are there any alternatives to NVIDIA’s AI Chat with RTX?

I downloaded and attempted to install the NVIDIA AI chatbot from this link: https://www.nvidia.com/en-in/ai-on-rtx/chat-with-rtx-generative-ai/ However, it requires an RTX 30-40 series graphics card. ...
Kharuka's user avatar
  • 11
1 vote
1 answer
56 views

Is it feasible to use LLM for natural language detection?

Huge models are trained on data in multiple languages, so I would like to use such model to detect the language of the input. I would extract paragraphs from a webpage, then have the AI analyze the ...
tpimh's user avatar
  • 159
4 votes
1 answer
119 views

What is the environmental impact of using Github Copilot

This may be an unanswerable question, at least for anyone outside Microsoft, but is there any way of finding out the ballpark carbon footprint per query of using Github Copilot (or similar tools)? ...
headbanger's user avatar
3 votes
1 answer
133 views

Is it possible to have Llama-2's vocabulary file?

I am looking for Llama-2's vocabulary list to do preliminary research. I tried to search on Google, but couldn't find any results.
abbassix's user avatar
  • 135
5 votes
0 answers
99 views

How to fine-tune an LLM on a very small document

I am currently trying to fine-tune an LLM on a single document (about 1700 characters). I know that generally it is better to use prompt injection or something like a RAG system to provide specific ...
Roy Varon's user avatar
  • 151
1 vote
1 answer
66 views

Generalize knowledge across multiple documents

I created a chat via platform.openai.com. It uses GPT-4 turbo preview. I have uploaded multiple documents to it. The knowledge is scattered across different docs. The behavior I get is the assistant ...
Marcin's user avatar
  • 111
4 votes
1 answer
29 views

Is there a recommended format to store a large amount of text which is both human readable and organized and also usable by a RAG-LLM?

Use case: I have tons of text, files, and notes spread across various cloud storage accounts and devices. I want to find a format to store all my information and data in one place. I tend to delete ...
Julius Hamilton's user avatar
2 votes
2 answers
61 views

How to force the model to use different greeting in emails

I'm using llama2 model and I'm asking it to generate emails. it usually start the email with 'hi' or 'hey'. I would like it to be more creative and randomize the greeting. changing parameters like ...
kambi's user avatar
  • 131
0 votes
0 answers
17 views

Can I modify the weight of a particular section of text in an LLM training corpus?

I have a rather odd data format that I want to train a LLM on. I want it to focus on learning specific segments within one piece of training data. The problem is that I can't just delete the rest of ...
user avatar
0 votes
0 answers
19 views

How does Azure decide where they deploy OpenAI models?

From https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models#model-summary-table-and-region-availability: How does Azure decide where they deploy OpenAI models?
Franck Dernoncourt's user avatar

15 30 50 per page
1
2 3 4 5
7