Skip to content

Conversation

xxxx3
Copy link

@xxxx3 xxxx3 commented May 16, 2025

add aws bedrock prompt-caching support.
aws url:https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

@markpollack markpollack added this to the 1.1.x milestone May 17, 2025
Signed-off-by: Brave Lin <45254095@qq.com>
@DEG-7
Copy link

DEG-7 commented May 30, 2025

Hey @xxxx3, could you also add the cachePoint in the tools definition as it's shown in the same AWS documentation page you shared?
Great work and thank in advance !!

... toolConfig={ "tools": [ { "toolSpec": { "name": "top_song", "description": "Get the most popular song played on a radio station.", "inputSchema": { "json": { "type": "object", "properties": { "sign": { "type": "string", "description": "The call sign for the radio station for which you want the most popular song. Example calls signs are WZPZ and WKRP." } }, "required": [ "sign" ] } } } }, { "cachePoint": { "type": "default" } } ] } ... 
@gpalacios-caylent
Copy link

Oh! This will be a great addition

@markpollack markpollack added the enhancement New feature or request label Jul 11, 2025
@markpollack markpollack modified the milestones: 1.1.0.M1, 1.1.0.M3 Sep 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bedrock enhancement New feature or request
6 participants