aifollow.news 搜索
返回 Rohan Paul
Rohan Paul· @rohanpaul_ai · X· · 原发布时间 AI 评分54

研究者提出 LFD,让自然语言目标引导科学分子生成

自动核验发布 · 本文由系统生成并完成证据核验,未经人工审稿。

AI 导读

LFD 用大语言模型将“设计抗癌肽”等文字目标拆成子目标,并通过迭代训练调整生成器。作者称,该方法无需针对任务训练奖励模型,在留出的计算评测中优于所列奖励引导方法;这些结果仍限于计算评测。

原帖引用 · 原文

该语言的正文暂不可用,当前显示已有版本。

@rohanpaul_ai

Paper: https://t.co/HYpffP0rLf

Website: https://t.co/s5BOKqO9Ig

Code: https://t.co/IeQkM7sXUR

回复Rohan Paul@rohanpaul_ai
You can now type what you want in plain English and have a drug-design model chase it. Normally, to make a model generate better drug candidates, you need a reward model trained on that exact target. Here they deleted that step and let an LLM grade the outputs instead, just by reading your goal in English. Any lab that couldn’t afford to build a scoring model for its target now has a path to a steered generator. That was the gate keeping small teams out of generative design, and it just moved. RLHF has the same cold-start problem everywhere: if the base model never produces a good output, there’s nothing to rank. So the LLM writes an easier goal first, grades against that, and keeps raising the bar as the model gets better. The base molecule model produced 0 usable hits in 38,500 samples. After a few rounds of this, it produced one in a batch of 512. The LLM’s scores are flat-out wrong a lot of the time, and it doesn’t matter, because DPO only needs “A is better than B”, not an accurate number. The LLM-graded model beat the versions that were allowed to train directly against the real scoring function, 69.06 vs 57.04, while never seeing a single score.
在 X 查看这条帖子 ↗
相关上下文Riccardo De Santi@r_de_santi
We’re bringing natural-language control to any scientific generator. We are very excited to introduce LLM-to-Flow Distillation (LFD), a method to adapt scientific generators to high-level natural-language discovery goals. Starting from textual goals like “design peptides with promising anticancer activity” or “design small molecules binding to the D2 dopamine receptor”, LFD distills high-level goal-related knowledge from LLMs into scientific generators through iterative DPO on LLM-generated sub-goals. 🔥 LFD does not need task-specific proxy rewards, works with any frontier LLM via API-access, and outperforms state-of-the-art reward-guided methods such as FlowGRPO and DiffusionNFT on held-out computational evaluations. (1/6)
在 X 查看这条帖子 ↗

来源:Rohan Paul · x.com

论文
发现内容有误?提交纠错