Truncated answers when querying chatgpt with Matlab

10 views (last 30 days)
Some users (like here for example: https://www.mathworks.com/matlabcentral/answers/1894530-connecting-to-chatgpt-using-api ) have pointed out that we can ask chatgpt to write Matlab code.
I was curious and I have been playing with the code below a bit but I seem to get truncated annswers
import matlab.net.*
import matlab.net.http.*
% Define the API endpoint Davinci
api_endpoint = "https://api.openai.com/v1/engines/text-davinci-003/completions";
% Define the API key from https://beta.openai.com/account/api-keys
api_key = "your_api_key";
prompt = "Matlab code to replace string in multiple text files";
parameters = struct('prompt', prompt, 'max_tokens', 100);
% Define the headers for the API request
headers = matlab.net.http.HeaderField('Content-Type', 'application/json');
headers(2) = matlab.net.http.HeaderField('Authorization', ['Bearer ' + api_key]);
% Define the request message
request = matlab.net.http.RequestMessage('post', headers, parameters);
% Send the request and store the response
response = send(request, URI(api_endpoint));
% Extract the response text
response_text = response.Body.Data;
response_text = response_text.choices(1).text;
disp(response_text)
Its not immediately clear if the problem lies with the code above or with chatgpt. Has anyone experienced truncated answers from chatgpt ?

Answers (2)

Hans Scharler
Hans Scharler on 16 Sep 2023
The "max_tokens" parameter limits the response from OpenAI language models.
Try increasing it to 1000.
parameters = struct('prompt', prompt, 'max_tokens', 1000);

the cyclist
the cyclist on 24 Mar 2023
My impression from searching the same topic is that there is an unpublished token limit (which will roughly translate to a character limit) for both input and output to ChatGPT. (This is not MATLAB specific.)
  2 Comments
012786534
012786534 on 24 Mar 2023
Perhaps but I have read that chatgpt has a character limit of 2048 characters per response, which is far more than I get when querying with Matlab. In the example above, I get a complete answer when I ask the same question directly on Introducing ChatGPT (openai.com).
the cyclist
the cyclist on 24 Mar 2023
Looking at your code a bit more closely ...
Did you realize that this line
parameters = struct('prompt', prompt, 'max_tokens', 100);
is setting the maximum token value that your code is asking for? Set that higher.

Sign in to comment.

Tags

Products


Release

R2022b

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!