FlowEdit:图像局部编辑和风格转绘!无需反演&优化&模型无关的文本图像编辑方法
🌹大家好!欢迎来到破狼公众号。感谢大家的支持与鼓励。在AIGC探索道路上,我将与你一路同行。喜欢就星标关注破狼公众号或文末扫码加入交流群 !
FlowEdit简介
前沿:在使用预训练的文本到图像(T2I)扩散/流模型编辑真实图像,通常会涉及将图像反演为其对应的噪声图。然而,仅反演本身通常不足以获得满意的结果,因此许多方法还会在采样过程中进行干预。这些方法虽然取得了改进的结果,但它们不能在模型架构之间无缝转移。
今天文章主题将介绍一款基于文本提示语的FlowEdit的图像编辑方法。,FlowEdit是一种用于预训练T2I流模型的基于文本的编辑方法,FlowEdit无需反演、无需优化,并且与模型无关。FlowEdit方法构建了一个直接映射源和目标分布(对应于源和目标文本提示)的ODE,并实现了比反演方法更低的传输成本。
• 项目主页:https://matankleiner.github.io/flowedit/
• Github:https://github.com/fallenshock/FlowEdit
• 在线体验:https://huggingface.co/spaces/fallenshock/FlowEdit
FlowEdit ComfyUI体验
首先需要安装ComfyUI-Fluxtapoz这款ComfyUI插件即可,除了基础Flux文生图模型外无需下载额外模型。
• ComfyUI-Fluxtapoz插件 :https://github.com/logtd/ComfyUI-Fluxtapoz
Flux文生图&混元视频工作流
• F.1-绮梦流光-水湄凝香:
https://www.liblib.art/modelinfo/134c6dd95aef48e98a22b24e003e026b
• 文生图-Flux文生图(PuLID|LORA|Joy|SUPIR)工作流:
https://www.liblib.art/modelinfo/782aacd70f604da39e83368c696a02a8?versionUuid=9c5eceb01fb94d4d93d60fe2c0bd7468
• 文生视频-腾迅混元最强开源视频(LORA)工作流:
https://www.liblib.art/modelinfo/35ee21d5f6a94204abb767ad194ab9cd?versionUuid=be674032ffa14e5597a08922556f4da0
FlowEdit图像编辑工作流
FlowEdit图像编辑工作流已上传LIBLIB平台:
https://www.liblib.art/modelinfo/8a5b0d98386e4ac7803980b7506da02e?versionUuid=04bf1944b2224804ab1ee7a95e19e738
注意:
• FlowEdit图像编辑最有效的功能为:1:根据文本提示局部重绘;2:图像风格的转绘。这也将是本文核心关注体验案例。 • 能够从下面案例中清晰可见图像风格转绘。原提示词和目标提示词几乎完全一致,仅主体词改变即可。在下面案例中使用红色字体标注。 • 能够从下面案例中可以看出图像转绘仅需,在原提示词基础上增加风格提示词即可(如:3D anime style drawing)。在下面案例中使用红色字体标注。
01. 局部重绘-文字
源提示:A gas station with a white and red sign that reads "
CAFE
" There are several cars parked in front of the gas station, including a white car and a van.
目标提示:A gas station with a white and red sign that reads "AGI
" There are several cars parked in front of the gas station, including a white car and a van.
原图 | 效果图 |
02. 局部重绘-动物
源提示:A
kitten
sitting in a grassy field. The
kitten
is positioned in the center of the scene, surrounded by a field. The kitten appears to be looking at something in the field..
目标提示:Arabbit
sitting in a grassy field. The
rabbit
is positioned in the center of the scene, surrounded by a field. The kitten appears to be looking at something in the field.
原图 | 效果图 |
03. 局部重绘-人物
源提示:
A woman was leaning her back against a tree in a deep forest.
A brown bear was leaning against a tree in a deep forest
目标提示:.
原图 | 效果图 |
04.图像转绘-胶带
源提示:An Asian girl wears a parcel tape woven dress.
An Asian girl wears a parcel tape woven dress,,Hime Zaki Jun flat animation style
目标提示:
原图 | 效果图 |
05.图像转绘-持剑
源提示:a blonde woman in a yellow jumpsuit holding a sword in front of her face.
目标提示:a blonde woman in a yellow jumpsuit holding a sword in front of her face,anime style drawing
原图 | 效果图 |
06.图像转绘-森林
源提示:A woman was leaning her back against a tree in a deep forest.
A woman was leaning her back against a tree in a deep forest,Hime Zaki Jun flat animation style
目标提示:
原图 | 效果图 |
感兴趣加入[AGI技术交流群]+V