Summary
In this special emergency podcast episode, Swyx dives into the June 2023 updates from OpenAI. Key highlights include:
The unveiling of OpenAI's new Functions API which was previously available only for ChatGPT Plus subscribers. This API allows developers to introduce a new 'function' role, making it easier to structure the output, particularly in formats like JSON.
The significant 75% price reduction for embeddings. This is especially noteworthy following a previous 90% reduction, marking OpenAI's push towards making AI more accessible. The cost to embed the entire internet has gone from $50 million to an impressive $12.5 million.
A 4x increase in context length for the GPT-3.5 model, moving from 4,000 to 16,000 tokens.
Observations on long context models indicating that they may not retain context as efficiently across the entire span.
The podcast also touches on discussions about embedding costs, potential use-cases, and comparisons of GPT versions.
Guests Alex Volkov and others express excitement about the price drops and new models but also share some reservations about the reliability of the API in certain applications.