Use BedrockConverse to send image (or document) ChatMessages

[stadeltobi]

Hi,

I'm wondering how I could use BedrockConverse to send an image (or document), rather than a plain text, ChatMessage to the model (in my case, Anthropic Claude Sonnet 3.5). In other words, rather than sending this:

{
    "role": "user | assistant",
    "content": [
        {
            "text": "string"
        }
    ]
}

... I'd like to send this:

{
    "role": "user",
    "content": [
        {
            "image": {
                "format": "png | jpeg | gif | webp",
                "source": {
                    "bytes": "image in bytes"
                }
            }
        }
    ]
}

Both formats are taken from the respective AWS documentation page

From a quick look at the conversion code in bedrock_converse/utils.py it looks like this is currently not supported.

Or am I missing something?