Ram Mudambi’s Post

📢 Excited to introduce our new work, "Triple Preference Optimization: Achieving Better Alignment with Less Data in a Single Step Optimization"; https://lnkd.in/gafdgcwT. In this study, we propose Triple Preference Optimization (TPO), a new method for preference learning that efficiently fine-tunes a pre-trained model using three specific types of responses: gold, preferred, and unpreferred, for a given input x. We demonstrate that TPO requires significantly less data than other alignment methods such as SFT, DPO, KTO, IPO, CPO, and ORPO, surpassing their performance across ten diverse benchmarks. Notably, using TPO eliminates the need for a reference model during fine-tuning. Key Results: 🔹 Mistral+TPO surpasses Mistral+SFT and Mistral+DPO by 7.2% and 12.1% on the MT-Bench. 🔹 Mistral+TPO outperforms Mistral+SFT and Mistral+SFT+DPO by 4.2% and 4.97%, respectively, on the Open LLM Leaderboard benchmarks. 🔹 Phi-2+TPO outperforms Phi-2+SFT and Phi-2+SFT+DPO by 12.7% and 6.3% in the MT-Bench benchmark, respectively. Key Findings: ✅ Removing the reference model from the RLHF objective restricts the policy model's ability to learn the response y, which can hinder fine-tuning. However, TPO effectively addresses this issue by incorporating the SFT objective. ✅ Merging the processes of SFT and alignment into a single step significantly enhances performance while requiring less data. ✅ When the gold and preferred responses are highly similar, diminishing the influence of the SFT objective with regularization parameters during fine-tuning enhances performance. We welcome any feedback from the community. 😁 Collaborators on this project include Shivanshu Verma, Aswin Ravikumar Rangasamy Veerasamy, and Chitta Baral. For more details, please check: 🔸 website: https://lnkd.in/gTjn_UvQ 🔸 code: https://lnkd.in/g7piWRJu #NLP #TPO #DPO #IPO #KTO #CPO #ORPO #Optimization #PreferenceLearning

Couple of very topical posts in the world of #GenAI from SiliconANGLE & theCUBE. This week we are live broadcasting from #kubecon2023 (https://lnkd.in/gx6Rb4mX) in Chicago, while yesterday we covered the announcements from OpenAI Developer Day where their new class of GPTs were announced (https://lnkd.in/gvHkA8U4) offering new outbound APIs to pull in contextual datasets for fast RAG-live application development. What are the implications of fast GPT's for more mature, enterprise-class RAG orchestration workflows being offered by many other companies today? (See for example this nice overview on RAGStack from DataStax https://lnkd.in/gm9UtMtd). Rob Strechay David Vellante John Furrier Erika Hokanson Taylor Hamasaki Charna Parkey, Ph.D. Murali Nemani https://lnkd.in/gEe-AtkM

@Omdia_Cloud @OmdiaHQ AIOps continues to be a topic of significant interest, most organizations we surveyed put its adoption down to improve operational efficiency and not to reduce direct costs. But most are finding implentation harder than they thought

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/gE_CZzMV #DatabaseMonitoring #AIOps #TechInnovation

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/gyb5DxbD #DatabaseMonitoring #AIOps #TechInnovation

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/g9XSbh_c #DatabaseMonitoring #AIOps #TechInnovation

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/dcS787Cr #DatabaseMonitoring #AIOps #TechInnovation

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/eDJnDqCh #DatabaseMonitoring #AIOps #TechInnovation

Discover the cutting-edge world of AIOps and how it's revolutionizing database monitoring in this insightful blog. Explore the possibilities and stay ahead of the game in the dynamic field of technology. Read the blog here: https://lnkd.in/gZg4xc7Y #DatabaseMonitoring #AIOps #TechInnovation

Steps to Establish an Effective Internet Domain Name Policy "In cases where a name or brand will be made public in any manner, an application will be filed to protect it, or its consideration for public release is contemplated, domain name applications must be concurrently submitted prior to the matter becoming public. It is imperative that these applications are also assessed to ensure they do not infringe upon any third-party rights." Internet Domain Name Registrations: .gTLDs (Generic Top Level Domains) Since 1980; .com, .net, .org (open); .edu, .gov, .int, .mil (restricted) Starting from 2000 onwards with +7 additions: aero, .biz, .coop, .info, .museum, .name, .pro In 2003/2004 with +6 additions: asia, .cat, .jobs, .mobi, .tel, .travel On June 13, 2012, ICANN announced the inclusion of 1930 new gTLDs into the internet world, and implementation has commenced. https://lnkd.in/etqscP9 #udrp #icann #wipo #wipoadr #domainnames #cctlds #ai #yapayzeka #artificialintelligence