CTO | Technology Consultant | VP Engineering | Director Engineering | Head Of Engineering | Engineering Manager | Architect
Andrej Karpathy famously mentioned that English is the hottest #programminglanguage. The question that I am trying to respond to is for how long will we need classical programming languages? The paper pointed out by Elvis S. experiments exactly in this direction: using #LLMs as #compiler. This is a good step forward.
Co-founder at DAIR.AI | PhD | Prev: Meta AI, Galactica LLM, PapersWithCode, Elastic | Creator of the Prompting Guide (5M+ learners)
LLMs as Compilers This work proposes a think-and-execute framework to decompose the reasoning process in language models. This helps to improve algorithmic reasoning in LLMs. - It first THINKS to discover a task-level logic to solve a task and express logic in pseudocode - It then EXECUTES to simulate the execution of the code with language models Apparently, the process of discovering task-level logic behind a task improves performance on algorithmic reasoning tasks. It also outperforms instance-specific reasoning approaches like chain-of-thought and program-of-thoughts. Pseudocode understanding and generation is powerful and this paper shows how it can improve reasoning in LLMs. This is fascinating as pseudocode is one of my favorite approaches to solving really complex problems and build complex programs. Similar to the paper I shared yesterday on visualization-as-thoughts, I think this trend continues where we borrow ideas from how humans solve problems to improve LLMs and how we interact with them. Paper: https://lnkd.in/eTNJtVWv -- You can also track my weekly summary of LLM papers and research developments here: https://lnkd.in/e6ajg945