Changelog · Workers AI

Meta Llama 3.1 now available on Workers AI

Tue, 23 Jul 2024 08:00:00 EST

Workers AI now suppoorts Meta Llama 3.1.

Thu, 11 Jul 2024 08:00:00 EST

Thu, 27 Jun 2024 08:00:00 EST

Wed, 19 Jun 2024 08:00:00 EST

Tue, 18 Jun 2024 08:00:00 EST

Workers AI now natively supports AI Gateway.

Tue, 11 Jun 2024 08:00:00 EST

We will be deprecating @cf/meta/llama-2-7b-chat-int8 on 2024-06-30.

Replace the model ID in your code with a new model of your choice:

@cf/meta/llama-3-8b-instruct is the newest model in the Llama family (and is currently free for a limited time on Workers AI).
@cf/meta/llama-3-8b-instruct-awq is the new Llama 3 in a similar precision to your currently selected model. This model is also currently free for a limited time.

If you do not switch to a different model by June 30th, we will automatically start returning inference from @cf/meta/llama-3-8b-instruct-awq.

Wed, 29 May 2024 08:00:00 EST

Added documentation on new public LoRAs.
Noted that you can now run LoRA inference with the base model rather than explicitly calling the -lora version

Fri, 17 May 2024 08:00:00 EST

Added OpenAI compatible API endpoints for /v1/chat/completions and /v1/embeddings. For more details, refer to Configurations.

Thu, 11 Apr 2024 08:00:00 EST

Added new AI native binding, you can now run models with const resp = await env.AI.run(modelName, inputs)
Deprecated @cloudflare/ai npm package. While existing solutions using the @cloudflare/ai package will continue to work, no new Workers AI features will be supported. Moving to native AI bindings is highly recommended