Joachim/VideoStory
Joachim/VideoStory
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Actualiser README.md

Browse source
This commit is contained in:
Joachim Rey 2025-07-04 12:22:43 +02:00
parent ad917ff790
commit d4ec54632d
1 changed files with 26 additions and 26 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

52
README.md
View file

@ -1,30 +1,6 @@
# VideoStory # VideoStory
This is an experiment with Stable Diffusion 1.5, Llama 3, and TTS that allows for the generation of "video" (a sequence of images) with a narrated story. It potentially supports SD Video. This program is not really intended for practical use. This is an experiment with Stable Diffusion (1.5/SDXL), Llama (2/3), Phi, and others that allows for the generation of "video" (a sequence of images) with a narrated story. This program is not really intended for practical use.
## Library
Here are the dependencies:
```
re
llama_cpp
outetts
diffusers
torch
os
moviepy
```
## Usage
In the `main.py` file, add the prompt in the call to main().
`SYSTEMPROMPTT` is the system prompt for Llama.
`SDBAD` is the negative prompt for Stable Diffusion.
`SYSTEMPROMPTI` is the system prompt for Llama for Stable Diffusion.
`promptTtoI.txt` and `promptUtoT.txt` are respectively the system prompt for Stable Diffusion and that for Llama.
In the `gen.py` file, in the functions `loadllama()`, `loadtts()`, and `loadsdxl()`, you need to add your models (local files).
The program is launched with `main.py`.
## Why does this project suck ## Why does this project suck
@ -194,4 +170,28 @@ subN: Video's subtitles
pt1: Gen SD prompt with simplified story pt1: Gen SD prompt with simplified story
pt2: Gen SD prompt with simplified story pt2: Gen SD prompt with simplified story
ptN: Gen SD prompt with simplified story ptN: Gen SD prompt with simplified story
``` ```
## Library
Here are the dependencies:
```
re
llama_cpp
outetts
diffusers
torch
os
moviepy
```
## Usage
In the `main.py` file, add the prompt in the call to main().
`SYSTEMPROMPTT` is the system prompt for Llama.
`SDBAD` is the negative prompt for Stable Diffusion.
`SYSTEMPROMPTI` is the system prompt for Llama for Stable Diffusion.
`promptTtoI.txt` and `promptUtoT.txt` are respectively the system prompt for Stable Diffusion and that for Llama.
In the `gen.py` file, in the functions `loadllama()`, `loadtts()`, and `loadsdxl()`, you need to add your models (local files).
The program is launched with `main.py`.