Skip to main content

OpenAI

OpenAI is American artificial intelligence (AI) research laboratory consisting of the non-profit OpenAI Incorporated and its for-profit subsidiary corporation OpenAI Limited Partnership. OpenAI conducts AI research with the declared intention of promoting and developing a friendly AI. OpenAI systems run on an Azure-based supercomputing platform from Microsoft.

The OpenAI API is powered by a diverse set of models with different capabilities and price points.

ChatGPT is the Artificial Intelligence (AI) chatbot developed by OpenAI.

Installation and Setup​

  • Install the Python SDK with
pip install openai
  • Get an OpenAI api key and set it as an environment variable (OPENAI_API_KEY)
  • If you want to use OpenAI's tokenizer (only available for Python 3.9+), install it
pip install tiktoken

LLM​

from langchain.llms import OpenAI

API Reference:

If you are using a model hosted on Azure, you should use different wrapper for that:

from langchain.llms import AzureOpenAI

API Reference:

For a more detailed walkthrough of the Azure wrapper, see this notebook

Text Embedding Model​

from langchain.embeddings import OpenAIEmbeddings

API Reference:

For a more detailed walkthrough of this, see this notebook

Tokenizer​

There are several places you can use the tiktoken tokenizer. By default, it is used to count tokens for OpenAI LLMs.

You can also use it to count tokens when splitting documents with 

from langchain.text_splitter import CharacterTextSplitter
CharacterTextSplitter.from_tiktoken_encoder(...)

API Reference:

For a more detailed walkthrough of this, see this notebook

Chain​

See a usage example.

from langchain.chains import OpenAIModerationChain

API Reference:

Document Loader​

See a usage example.

from langchain.document_loaders.chatgpt import ChatGPTLoader

API Reference:

Retriever​

See a usage example.

from langchain.retrievers import ChatGPTPluginRetriever

API Reference: