智谱CogVideoX1.5：10秒视频&音频&增强质量&任意长宽图生视频
🌹大家好！欢迎来到破狼公众号。感谢大家的支持与鼓励。在AIGC探索道路上，我将与你一路同行。喜欢就星标关注破狼公众号或文末扫码加入交流群 ！本人仅运营公众号平台，未经授权严禁CSDN等其他平台抄袭和转载！
CogVideoX v1.5简介
智谱开源了最新的视频生成模型：CogVideoX v1.5。模型为50亿参数的视频模型，能够生成10秒、768P、每秒16帧的视频，具有改善的质量、复杂的语义理解能力以及添加音效的能力。基于CogVideoX v1.5架构构建的全新商业化产品：清影AI视频生成工具，支持10秒、4K、每秒60帧的超高清晰度视频、任意长宽比和多通道输出。在AI视频生成开源领域，目前头部模型为：CogVideoX 和 Mochi两大主流，相信在社区的努力下，很快就会出现接近可商用的AI视频生成模型。AI视频生成将逐步的更加普及，另外这也要伴随着消费级显卡可运行的量化等模型性能优化。
• CogVideoX1.5-5B-SAT：https://huggingface.co/THUDM/CogVideoX1.5-5B-SAT
• CogVideoX1.5-5B diffusers：https://huggingface.co/Kijai/CogVideoX-5b-1.5/tree/main
• 在线体验：https://models.aminer.cn/cogvideo/
CogVideoX v1.5关键特性：
• 时长和分辨率：CogVideoX v1.5能够生成长达10秒、768P分辨率、每秒16帧的视频。
• 任意分辨率图像：图生视频模型支持任意长宽比的视频生成。
• 质量提升：视频生成质量得到了显著增强，确保更流畅、更详细的视觉效果。
• 复杂的语义理解：CogVideoX v1.5经过训练，能够理解复杂的语义上下文，使其能够生成更连贯、上下文更准确的视频。
• 音效：模型现在可以为视频添加音效，确保音频与视觉内容无缝配合。
CogVideoX v1.5 ComfyUI体验
更新ComfyUI并通过插件管理器Git安装ComfyUI-CogVideoXWrapper，模型会在首次运行时候自动下载。
• 插件地址：https://github.com/kijai/ComfyUI-CogVideoXWrapper
• Kijai/CogVideoX-5b-1.5模型：模型会自动下载，如需手动下载模型，则需要下载整个项目全部文件，并放置ComfyUI/models/CogVideo。下载地址：https://huggingface.co/Kijai/CogVideoX-5b-1.5/tree/main
Flux文生图工作流
Flux文生图感兴趣的同学可参考LIBLIB在线运行工作流：FLUX[续篇]：12B参数23G最大开源文生图模型，Dev版直出惊艳美图欣赏
另外LIBLIBAI已支持本地客户端使用可首页（https://www.liblib.art）下载体验。
CogVideoX v1.5工作流
CogVideoX v1.5工作流已上传LIBLIB平台：
https://www.liblib.art/modelinfo/da508657610d407795297f92b992ce63?versionUuid=421363a76f434b66aee9893d946e0f12
注意：
• @kijai大佬本次升级涉及大量重构和调整，旧工作流会被影响，请注意升级。
• CogVideoX v1.5可以使用之前讲述的镜头控制LORA，详情见案例4。运镜LORA使用参考：CogVideo:重磅升级！图生视频完美镜头控制和3D环绕,商用级开源AI视频曙光
01. 猛犸象群
Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.02.宁静的山庄
The image depicts a serene, moonlit countryside scene. A winding cobblestone path leads through lush, green fields, flanked by rustic wooden houses with warm, glowing windows. The path meanders gently, disappearing into the distance where it meets a small, quaint village. The sky is painted with hues of deep blue and orange, as the full moon rises, casting a soft, golden glow over the landscape. Wispy clouds drift across the moon, adding a touch of mystery to the tranquil night. Trees stand tall on either side of the path, their branches silhouetted against the twilight sky. The overall atmosphere is peaceful and idyllic, evoking a sense of calm and timeless beauty.03.兔子
A rabbit made of leaves takes a leisurely walk in the forest04. 镜头控制-旋转灯塔
更多AI视频镜头控制详情，参考文章：CogVideo:重磅升级！图生视频完美镜头控制和3D环绕,商用级开源AI视频曙光
In the heart of a frozen landscape, a majestic lighthouse stands tall, its stone walls blanketed in a thick layer of snow. The lighthouse, adorned with icicles, emanates a warm, golden glow from its windows, contrasting beautifully with the ethereal green and purple hues of the Northern Lights dancing across the night sky. The icy waters surrounding the structure are dotted with jagged ice formations, creating a surreal and otherworldly scene. The lighthouse keeper's footsteps, lightly imprinted in the snow, lead up the steps to the welcoming wooden door, hinting at the warmth and safety within. The serene, almost magical atmosphere is palpable, as if time itself has slowed to admire this breathtaking winter wonderland.更多推荐文章：
• [ComfyUI]Flux：Lovely网红写真，极致细节写实，小红书网红人物写真风格
• 太酷啦！实时人物表情编辑神器，ComfyUI玩转视频表情无限创意
• PixelWave：更真实细节|动漫|摄影多种艺术风格显著提升，基于黑森林F.1D超5周精调模型
• OmniGen：统一图像生成和多任务集成模型，任意人物自由合影，8位量化体验
• 15秒F.1D直出，极限无损加速方案，环境大升级敢不敢来试？
• CogVideo:重磅升级！图生视频完美镜头控制和3D环绕,商用级开源AI视频曙光
• 阿里InContextLoRA：更强ID一致性！基于黑森林F1身份一致性连贯视频分镜图集，10组风格无限创意
• [ComfyUI]InstantIR：来自小红书团队模糊图像修复技术，效果是否惊艳？
