LLMs as Optimizers
This is a really neat idea. This new paper from Google DeepMind proposes an approach where the optimization problem is described in natural language.
An LLM is then instructed to iteratively generate new solutions based on the defined problem and previously found solutions.
It was first tested on linear regression and the traveling salesman problem. Leveraging LLMs with simple prompting match or surpass hand-designed heuristic algorithms. This shows good potential for using LLMs as optimizers.
The idea is then applied to prompt optimization that aims to maximize task accuracy on different tasks like math word problem-solving.
The first piece of the proposed meta-prompt takes in previously generated prompts along with corresponding training accuracies. The second piece includes the optimization problem description with samples obtained from a training set representing the task.
At each optimization step, the goal is to generate new prompts that increase test accuracy based on the trajectory of previously generated prompts.
The optimized prompts outperform human-designed prompts on GSM8K and Big-Bench Hard, sometimes by over 50%!
For math word problem solving, one of the most effective instructions found begins with "Take a deep breath and work on this problem step-by-step".
https://t.co/GsF8fzjevX
@ASUSIndia Sure. Your laptops are so pathetic it looks like a desktop now. Because I'm using UPS to make up for the damaged batteries you gave me 3 times.
#BoycottAsus#Asus_Scam#Asus
@ASUS_ROG_IN I own a rog zephyrus equiped with rtx 3060 its display was not able to work even over a year and fun fact @ASUSIndia isnt answering any of my query calls or mail so dont play games now rog laptops are only for opening chrome tabs worst qualtiy control on top line rog products
@ASUSIndia After i contacted your technical team for some assitance they were rude enough to not contact me even after my various mails and calls to provide any resolution evn after a week worst customer service by @asusindia , currently i am seeks to take legal action againts @ASUSIndia .
@ASUSIndia@ASUSIndia i bought rog zephyrus a year ago of price of around 1.5 lakhs rupees when i got my product it was dead on arrival after replacement nearly within a week after warrenty was over i got horizontal lines all over my laptop display while working
@ASUSIndia After i contacted your technical team for some assitance they were rude enough to not contact me even after my various mails and calls to provide any resolution evn after a week worst customer service by @asusindia , currently i am seeks to take legal action againts @ASUSIndia .