AI News (opens new window)

# todo

利用AI大模型,一键生成高清短视频 Generate short videos with one click using AI LLM. (opens new window)

PyVideoTrans一键视频翻译+配音+字幕 (opens new window) https://mp.weixin.qq.com/s/6J35rQO8v69mpJfypFl8Tw

# 基础

# Protocol

Model Context Protocol vs Function Calling:

Model Context Protocol Clearly Explained (opens new window)

Sample MCP client (opens new window) Google maps MCP server (opens new window) MCP Schema (opens new window) Simple tool, resource, prompt servers (opens new window) Example servers (opens new window) MCP inspector (postman like tool) (opens new window)

# 私人部署

  • 推理框架 允许开发人员轻松地在本地部署和运行 LLM
  • AI 应用开发平台 提供了一套完整的工具和 API,用于构建、管理和部署 AI 应用

https://mp.weixin.qq.com/s/iwsSKjGloNe7SCM4-5nzDA

# NextJS+Vercel

https://sdk.vercel.ai/

https://www.youtube.com/watch?v=5_JT9H8j1Us https://github.com/a-bit-of-saas/examples/tree/main/next/chat-gpt?ref=ethanmick.com

# FastGPT

代理方案:

  • nginx 方案 - 需要一台国外服务器 (商用)
  • sealos nginx 方案 -(约等于不用钱,不需要额外准备任何东西) labring/FastGPT/blob/main/docs/deploy/proxy/sealos.md
  • vercel反向代理(完全免费,github,google等,万能代理,免费100G流量) gaboolic/vercel-reverse-proxy
  • cloudflare 方案 - 需要有域名(每日免费 10w 次代理请求) zhuanlan.zhihu.com/p/622765456
  • clash 方案 - 仅需一台服务器(需要有 clash) labring/FastGPT/blob/main/docs/deploy/proxy/clash.md

https://github.com/labring/FastGPT 支持 sealos 、one-api(one-api:OpenAI 接口管理 & 分发系统,支持多种渠道包括 Azure,可用于二次分发管理 key, Docker 镜像,一键部署,开箱即用 https://github.com/songquanpeng/one-api)

github.com/Yidadaa/ChatGPT-Next-Web (opens new window) 支持vercel免费一键部署

# NAS gpt

https://mariushosting.com/how-to-install-chat-with-gpt-on-your-synology-nas/

https://cloud.tencent.com/developer/article/2312981

# 个人知识库 local rag

  • chatpgt GPTs
  • 数据库助手 https://github.com/panosperi/superduperdb

# 去中心 web3+AI

https://github.com/OrbisWeb3/orbis-chat-gpt

https://www.gizatech.xyz/ https://www.youtube.com/watch?v=BHdP5oSISQE

# 自动化

Drag & drop UI to build your customized LLM flow https://github.com/FlowiseAI/Flowise

自动化视频制作工具ShortGPT (opens new window) https://mp.weixin.qq.com/s/tdgld7kH4GFhgtjOK1LQ7w

# prompt

chatgpt#prompt https://prompthero.com/ https://flowgpt.com/ https://github.com/trigaten/Learn_Prompting

https://udify.app/completion/SiKtiPJ9gHUrHUPy

我想着AI生成图片工具DALL-E中,制作一张内容为:「XXXXXXX」,请提供给我可以给AI生成图片的英文指令,另外注明要使用「专业摄影风格」。”

越狱: https://github.com/lyhistory/learn_aigc_CipherChat

# community

开源 huggingface https://huggingface.co/

https://latentbox.com/en

# 原理学习

https://github.com/naklecha/llama3-from-scratch

https://github.com/karpathy/LLM101n

可视化 https://github.com/bbycroft/llm-viz

# 按模型分

# LLM - Large Language Models

  • 开源
    • LangChain
    • LlamaIndex
    • 手机上运行 https://h2o.ai/platform/danube/
  • 闭源
    • chatgpt
    • claude

# 音频处理

文字转语音 https://chattts.com/ 方言: https://github.com/rany2/edge-tts https://mp.weixin.qq.com/s/HhIE3QUfr6kh6-6jA2Tk_g

OpenVoice https://mp.weixin.qq.com/s/QDPX7D1mnwwmmv1pb_TbOA

# Large Vision Models (LVM)

# Text to image model

Stable Diffusion model Stream Diffusion https://github.com/cumulo-autumn/StreamDiffusion https://colab.research.google.com/github/hewis123/stream-d/blob/main/Untitled2.ipynb

# Video Model - Image to Video

https://github.com/camenduru/stable-video-diffusion-colab

https://animatediff.github.io/

https://mp.weixin.qq.com/s/jD1hoQNjUv9eCCH__dzOQQ

https://mp.weixin.qq.com/s/aLXCrH4sUK8HY-h2D5zPSw

Deepfake 视频换脸 https://mp.weixin.qq.com/s/9RJGpxvKieMY4Mu__mHfFQ https://colab.research.google.com/drive/1NG9AoH3QDtC7h97z1Yodmn_CiiGh8Y1T?usp=sharing#scrollTo=0aHr4Fo-7IRy

钉钉+SD+UE5 https://mp.weixin.qq.com/s/fNxb2B5PiTTzTSXMuXHvOg

# ROBOT

Dobb·E An open-source, general framework for learning household robotic manipulation (opens new window)

# 按平台分类

ChatGPT

GOOGLE Bard

Cloudflare Workers AI https://mp.weixin.qq.com/s/R1m7IMUfHq53yEe-b9cjlA

# 按应用分类

# BOT

https://www.coze.com/ 使用扣子Coze——你想给你的抖音搭建一个24小时营业的机器人吗? https://mp.weixin.qq.com/s/GZXfoTRROP15ZKf8GP0cug

# 图像增强

Demofusion

# 图片生成

  • Dalle3
  • Bing上的GPT-4V 完全免费使用gpt-4最新的多模态和最强图片生成模型 https://mp.weixin.qq.com/s/MNIZCA9pxyXobA3VVEOEqQ

logo制作: https://www.uugai.com/

https://logodiffusion.com/

# 标题/文案

https://duozhongcao.com/ https://www.jasper.ai/

https://hix.ai/

https://mymap.ai/

# 文字《=》语音

https://ttsmaker.com/

google bart open-source text-to-speech+ model. https://github.com/suno-ai/bark

https://www.notta.ai/en

# 语音翻译

rask ai https://www.rask.ai/

# PPT

MotionGo是必优科技(原口袋动画团队)全新升级的一款PPT动画插件,兼容WPS和office软件,轻量级产品,让PPT动效表达更专业。 https://motion.yoo-ai.com/?viaurl=ainavpro.com

https://www.beautiful.ai/

https://gamma.app/?lng=en

# 2D => 3D, 3D建模

https://convert.leiapix.com/ https://lumalabs.ai/interactive-scenes

# 文字=》视频

text to video https://runwayml.com/

虚拟现实 https://github.com/princeton-vl/infinigen

pika labs https://runwayml.com/

https://wonderdynamics.com/

https://github.com/SCUTlihaoyu/open-chat-video-editor

极虎漫剪 https://mp.weixin.qq.com/s/eKkcFNx77DJM4Usoc72fjw

# 市场分析

transform your product knowledge into a detailed Ideal Customer Profile https://m1-project.com

# 家居设计

https://collov.ai/

# 按领域分

# 安全渗透

https://github.com/hackerai-tech/PentestGPT

# 软件

# 开发

Open Interpreter lets LLMs run code (Python, Javascript, Shell, and more) locally. (opens new window)

OpenDevin (opens new window)

A framework to enable multimodal models to operate a computer (opens new window) 指令爬虫 (opens new window)

GitHub Copilot Workspace

编程助手 codey

OpenAI's Code Interpreter open-interpreter https://github.com/lyhistory/tools_aigc_open-interpreter

Draw a ui and make it real https://github.com/tldraw/make-real

生成网站: https://typedream.com/

# GPT+DB

An intelligent and versatile general-purpose SQL client and reporting tool for databases which integrates ChatGPT capabilities.(智能的通用数据库SQL客户端和报表工具) https://github.com/chat2db/Chat2DB

# GPT GAMES World

虚拟世界的人 Generative Agents: Interactive Simulacra of Human Behavior https://github.com/joonspk-research/generative_agents

# 机器人

# open glass

Turn any glasses into AI-powered smart glasses (opens new window)

# GPT+Eyes

https://www.youtube.com/watch?v=w-wxguIs-0I

# GPT Robot

https://hackaday.io/project/189041-a-workbench-companion-from-an-amazon-echo-dot https://www.youtube.com/watch?v=bO-DWWFolPw&embeds_referring_euri=https%3A%2F%2Fhackaday.io%2F&source_ve_path=MjM4NTE&feature=emb_title

# todo

https://creatorkit.com/ OpenDAN Open-source Private AI OS https://www.opendan.ai/

从0实现网络安全“小”模型.md https://mp.weixin.qq.com/s/XyMmMl_XDithOt7gsW5qeA

新手用ChatGPT仅需数小时轻松构建零日漏洞,69家专业公司都检测不出来:“不仅能调用开源库,还能彻底重写源代码” https://mp.weixin.qq.com/s/iY4sG9TFC0kOi7xTdJttTw

一名大四学生如何用ChatGPT月入6.4万美元 https://mp.weixin.qq.com/s/Tig_bNbnclZGmtK4uvMkbg

Chatbase.co

Segment Anything Model (SAM) https://mp.weixin.qq.com/s/-LWG3rOz60VWiwdYG3iaWQ

格斗之王!AI写出来的AI竟然这么强!#拳皇#街头霸王#AI#强化学习

生成礼物建议。比如,母亲节快到了,该送什么礼物给你的妈妈,你可以到这个网站上描述你的需求,然后系统便会调用 AI 接口生成礼物建议。 https://gen.gifts/

Winglang,一门AI时代的全新编程语言 https://mp.weixin.qq.com/s/43k6Flpj5RhfT3MOxbF4aQ

1.安全方面: 给出私钥 给出某个网站的可利用漏洞 给出waf后的真实ip

2.趋势 给出问的最多的问题 给出中国用户最关心的问题

3.钱 给出最好的投资机会