Co-Pilot for Product Team Experiment Processes | CRO & AI | AI-based UX Research | Consultant | Developer | Writer & Comics Author
What does the release of`gpt-4o-mini` mean for those developing AI apps? 👉 This from the perspective of my text-mining app which helps you find insights from user reviews, customer surveys, etc. =============== What's the big deal? =============== ✅ gpt-4o-mini is a FASTER version of gpt-4o. ✅ gpt-4o-mini is CHEAPER than gpt-3.5-turbo (60% cheaper!). ❌ gpt-4o-mini is not as good as gpt-4o for complex tasks. ================== So, what does this mean? ================== 💡 Where my app was using 3.5-turbo, switch to 4o-mini 💡 Where my app uses 4o--Can make the switch to benefit from performance gains without impact to accuracy. ============================ THE biggest benefit of the new model ============================ Reflective prompting just got a WHOLE lot cheaper! ℹ Reflective prompting is where you get the LLM to double-check its own output. This improves accuracy! My view: The price drop and performance improvements means that reflective prompting has now a major part of AI development. But a lot of testing needs to be done to validate accuracy using reflective prompts. 🙄 My plans for today has suddenly changed. But, so far my testing with reflective prompting is looking very promising indeed! (I know, I'm not talking much about experimentation lately, but I will get back to it, I promise! 😂 ) #ai #userresearch #cro
I love how it makes total sense to select different models for different 'mini tasks' that the LLM has to take care of.
I was just testing it this morning for something I'm building, and I was pleasantly surprised by how good it was :)
Great analysis from the perspective of a text-mining app Iqbal Ali! Do you see any challenges in implementing this approach?
Guess I'm not the only person testing it today either. So far so good and the price drop makes it very effective for some search query analysis that I'm doing at scale
Actually really like this kind of content. Don’t feel pressured to change your topics, unless you want to!
Human First Systems Engineer. Talks about: #Automation #Business #AI #LinkedIn
1moExperimentation scmerxpertaion, this is the meat here