All Tools
S
OtherFreeOpen Source
SHAREGPT4VIDEO
High-quality video captions for understanding and generation
Apache-2.0
ABOUT
Video VLMs and text-to-video models starve on short, noisy captions. ShareGPT4Video releases 40K dense GPT-4 Vision captions plus an open 8B video-language model so teams can train better video understanding and generation from richer supervision.
INTEGRATION GUIDE
1. Caption arbitrary-length videos with ShareCaptioner-Video in quality or efficiency mode
2. Chat about a local video using ShareGPT4Video-8B via run.py or the Gradio demo
3. Replace noisy VideoChatGPT captions with ShareGPT4Video data when fine-tuning Video-LLaVA
4. Improve Open-Sora-style text-to-video training with denser ShareGPT4Video captions
TAGS
pythonmultimodalvideocaptionsvision-languageneuripshuggingface