Sophia Van’s Post

𝐏𝐫𝐨𝐠𝐫𝐞𝐬𝐬 𝐢𝐧 𝐌𝐮𝐥𝐭𝐢𝐦𝐨𝐝𝐚𝐥𝐢𝐭𝐲 𝐚𝐧𝐝 𝐇𝐮𝐦𝐚𝐧 𝐂𝐨𝐠𝐧𝐢𝐭𝐢𝐨𝐧: 𝐆𝐏𝐓-4𝐨. This is a deceptively simple video from OpenAI which exhibits the AI model's new capabilities in multimodality. The use case here is very simple - showing the use of audio/video perception cognition and text combined. The larger meta has to do with mimicking human cognition. Our human cognitive capabilities synthesize different tracks or senses together. They combine our: hearing capabilities (ears), vision capabilities (eyes) and brain, cognitive input meaning-making abilities (text to meaning, semiotic abilities signifier/signified, language, polyphonic) This is no small feat. Think of an orchestra conductor and their score of the entire symphony. All of the instruments play together and produce not a cacophony or 'noise' but 'music'. Each instrument plays in tune and differently. In concert, they play a larger melody together with the others. They watch the conductor for their cues to keep time. The conductor also conducts the 'score' of the orchestra. This can be thought of as a semiotic metaphor of cognition. This is meaning-making through the senses. Each of our senses is a different instrument at times sending or receiving information or emotion in different ways. Together, these 'modalities' in 'multi-modality' can be interpreted or created in an orchestration. We call this meaning, conversation or even a performance that incorporates many of these. Humans are intrinsically 'multimodal' because of our senses. Artificial intelligence, the new GPT4o, is progressively adding different modes to 'AI'. It is artificially 'mimicking' the human perceptual apparatus. GPT4o is exhibiting three of these together. All of the fuss around 'robots' relates to what is happening above. AI Robots will add another mode or layer. This is technically called 'the phatic' or 'physical embodied mode' more commonly as we know it touch or in computer/engineering terms (feedback or force feedback). As AI gets more powerful all of these different modes will be added and synthesized with our original 'LLM's' AI large language models. Text is just one of the 'languages' with grammar and 'words' that can be interpreted as a semiotic system. Images and their relationship and contours can be interpreted and 'tied' with different words and different language symbols like 'French' or 'Italian'. The 'image' can also be tied to the actual object itself which a human or robot can touch. We are in a very interesting time for multi-modality and AI and what the future currently holds for our world, very rapidly changing. These deep learning algorithms and methods are very powerful new tools and what they herald for our future.

GPT-4o is set to transform our interactions with AI. What do you think about the potential impacts of OpenAI's latest developments? #AI #Innovation #OpenAI #GPT4o #Education #ChatGPT

For everyone in the AI + Education world, I hope that you listened to some of us who have been begging you... ➡ Not to sign long-term enterprise-level deals with EdTech companies. ➡ Doing silly things like "trojan prompts" or other band-aids. ➡ Thinking that this will go away. Your students will soon have the most intelligent model *on the planet* on their phone and any non-school device FOR FREE before school is out this year. So what does this mean? 1️⃣ Schedule your professional development RIGHT NOW. The people who can help you navigate this space are going to be more in-demand than before and those who are slow to schedule will pay the price. 2️⃣ Understand that this is primarily a pedagogy and design challenge. AI changes the way we GET to do things, and if we are strategic it can make learning more powerful and more engaging than ever before, but it is *always* third after centering human beings and then doing the work of pedagogy and design. 3️⃣ The people who have previously been left out or left behind can make some big moves. For the first time in a long time (maybe ever) it is a HUGE advantage to be a small team, small district, or small institution. This means you can bring your whole group along so much faster than these large organizations. You thought the Fall might be crazy...it's already here. And we are just getting started. (Google drops their updates tomorrow.)

Another significant step-change in conversational AI. GPT-4o, released earlier, has a much smoother voice mode and insane real time vision capabilities. #AI #ChatGPT Kevindren govender Bridgette Donnelly Reagan Moyo Kieran Donnelly Kevin Power

Wow, the next-generation voice of Chat GPT-4o sounds strikingly similar to Scarlett Johansson in the movie 'Her' (2013)—a must-see if you haven't watched it yet! Fasten your seatbelts for the new features of GPT-4o 🚀 * Desktop Version & UI Refresh: The launch of a desktop application for the CHBT platform, along with a refreshed user interface, aims to simplify and enhance user accessibility and experience. * Launch of GPT 4o: The new model is now available to all users, including free users, and promises faster performance, reduced latency, and more natural interactions through voice communication. * Enhanced Accessibility: Significant strides have been made to make the technology more accessible, including removing the signup barrier and introducing real-time conversational abilities and multi-modal interactions. * Interactive Capabilities: You can now interact in text, audio (with a voice assistant), and video. Check out some powerful demos on YouTube, such as real-time translation, AI talking to AI, meetings with GPT, and language learning. View the playlist here: https://lnkd.in/e5tQ59S4 * Benefits of Plus: Enjoy 5x higher limits and the earliest access to features like our new macOS desktop app and next-generation voice and video capabilities. These features will be rolled out iteratively in the coming weeks, ensuring users can leverage the full potential of the updates. #OpenAI #LLM #Multimodal #Microsoft #SpringUpdate #GPT4o

This is a comment well below the intelligence of my average audience but.... Is it just me (or people of my generation) that see this and think of J.A.R.V.I.S (yes I am referring to the AI in Ironman created by Tony Stark) coming to life. #AI #Jarvis #OpenAI #quantumcomputing #quantumcomputers #quantumcomputer

What this means for the world and OpenAI Multimodal; Memory; Massive. Mulitmodal- any person can create any content type and interact with the web in their chosen mode; Memory- more users rapidly! as it remembers context and removes the interface barrier even further (Apple Siri still struggles with memory); Massive- over time it provides OpenAI with a new large labelled training dataset.

Alexa & Siri, bet you're improving your hearing, are you listening this? The future of AI assistants just got an upgrade. #GPT4o Why is this surprising us when we "had" it for a decade, or more? well, now we're almost getting "Her". Here's what I think : * iPhone's Super Siri (Ditching Siri?): Imagine a mini GPT-4o on your iPhone, learning from your data with optional cloud power. * Camera & Screen Integration: Stream your camera or screen directly to the AI, unlocking crazy new possibilities.. Don't think it's possible today, but surely is coming up. * Smart Home & Shortcuts 2.0: This could be the ultimate AI agent, controlling your phone and smart home with ease. Remember Siri Shortcuts? Get ready for a MAJOR upgrade, but keep the training and security on top of mind! Meanwhile I'll head to my nearest coffee shop that has no-wifi/phones/laptop policy aiming to embed yourself into the human interaction :) #GameOn #GPT4o #AIAssistantBattle https://lnkd.in/g7nmV46D

🚀 Exciting news in the world of AI! OpenAI has just released GPT-4o, a powerful language model that takes us one step closer to natural human-computer interaction. With the ability to accept a combination of text, audio, and image inputs, it generates outputs in any of these formats. What's more, GPT-4o boasts lightning-fast response times, with an average of just 320 milliseconds, comparable to human response time in a conversation. It even outperforms GPT-4 Turbo on text in non-English languages, making it an ideal tool for translation. But that's not all - GPT-4o also excels in vision and audio understanding, making it a game-changer for multimodal applications. And the best part? It's 50% cheaper than the API and faster than existing models. #openai #gpt #gpt4o #llms #multimodal #translation #ai

𝐎𝐩𝐞𝐧𝐀𝐈 𝐚𝐧𝐧𝐨𝐮𝐧𝐜𝐞𝐝 "𝐆𝐏𝐓-𝟒𝐨" This groundbreaking flagship model possesses the remarkable ability to seamlessly reason across audio, vision, and text in real time What's Cool About It? 1. Faster processing: Compared to GPT-4, GPT-4o is designed to be twice as fast. 2. Multimodal capabilities: It can handle text, audio, and image inputs and outputs, allowing for a more comprehensive user experience. 3. Improved accessibility: Now, you can enjoy some of GPT-4's best features for free, like chatbots and access to the API (with a waitlist). 4. Enhanced Desktop App: A new desktop application for ChatGPT was introduced alongside GPT-4o. This launch marks a step towards more intuitive human-computer interaction, with the eventual goal of enabling video chat with ChatGPT. It also offers benefits for developers through a more affordable and performant API. #Innovation #GPT4o #OpenAI #Programming #ChatGPT #AI