The Latent Space

Recent Notes

ChatGPT API (MultiQuery)

1 min read

If you want to use ChatGPT 1.0 and higher for python, you have to follow this documentation

You can also look at the default API reference, in the Text Generation section

Python syntax:

import os
from openai import OpenAI
 
client = OpenAI(
    api_key=os.environ.get("OPENAI_API_KEY"),  # This is the default and can be omitted
)
 
chat_completion = client.chat.completions.create(
    messages=[
        {
            "role": "user",
            "content": "Say this is a test",
        }
    ],
    model="gpt-4o",
)

Here is a list of all parameters available to client.create()

You should set model to gpt-4o-mini as it’s currently the cheapest model:
https://openai.com/api/pricing/

Tokens

You can think of tokens as pieces of words used for natural language processing. For English text, 1 token is approximately 4 characters or 0.75 words. As a point of reference, the collected works of Shakespeare are about 900,000 words or 1.2M tokens.

To learn more about how tokens work and estimate your usage…

  • Experiment with our interactive Tokenizer tool⁠(opens in a new window).
  • Log in to your account and enter text into the Playground. The counter in the footer will display how many tokens are in your text.

Graph View