Can a new LLM benchmark finally quantify the value of enterprise AI?

Today’s question: How can you tell which AI model will perform best at business tasks? 

There are plenty of LLM benchmarks that evaluate which AI models produce the best Python code or score highest on the LSAT. The problem is, those metrics aren’t very helpful for business users trying to gauge which AI tool is best at handling real-world work. 

But thanks to a new LLM benchmark built specifically for generative AI apps in CRM, organizations can finally evaluate LLMs against the kinds of tasks employees perform every day, enabling businesses to reliably identify the most useful AI solution for a given problem.

Is Generative AI the answer to enterprise IT Whac-A-Mole?

How many times have you deployed software to solve a business problem, only to have it become outdated or even obsolete when the next whiz-bang app comes along? Generative AI flips the script on IT future-proofing.

With apps that can learn on their own and AI copilots capable of performing tasks they were never programmed for, software obsolescence as we know it may soon become a thing of the past. 

What our community is saying

“As an HR specialist, I see great potential in AI to optimize a salesperson’s time. By reducing the burden of repetitive tasks, teams can focus more on building genuine relationships with clients. The main key will be maintaining the human touch while using these innovations.”

— ALEJANDRA ERICA P. , HR Specialist at GAOTek Inc.

What we’re reading

• Researchers have established a method of detecting LLM usage in scientific papers by measuring “excess words” that have suddenly surged in use in the LLM era. Topping the list: “delves.” ( Ars Technica )
• AI companies, keen to the growing wariness surrounding AI hallucinations, are working overtime to ground their enterprise LLMs in fact. ( Fast Company )
• Generative AI gives resource-starved small businesses the marketing capabilities they need to compete with larger competitors. ( CIO Online )

This newsletter was curated by Lisa DiCarlo Lee , Contributing Editor at Salesforce.

What’s the biggest question you have about AI? Let us know in the comments. We read each one and may just feature yours in a future newsletter!