I’ve some expeimenting with Google Gemini for video. I normally use ChatGPT as my goto chatbot, I’m much less familiar with Gemin so I’m not actually sure which model I’m using. I basically just went to the normal chat window and asked it about generating video. It more or less gave me a manual on how to do things from my end. Mostly on things such as special codes to use in my prompts and providing reference images.
On that first visit I uploaded some images for my characters, I got those from ChatGPT. I wrote prompts for six different scenes which included character dialog. My sister told me that normally Gemini limits things like video to 3 per day, but I didn’t have any issues at all with 6. I download the six, 8 second clips it generated for me. And took them to a video editor. It came out much better than I was expecting. The lipsync was near perfect. There were a few issues, and I asked Gemini about that. And it told how to structure my prompts so that I don’t have those issues in the future.
I went back later, this time I created a Notebook, which as I understand is like a Project in ChatGPT. I told Gemini that my goal was to create a 15 minute video. My idea for for the video is based on Trilby Else’s story Hive. It gave me a list of documents which it suggested I provide So that it could provide me. These were things like character discription physical, the role in the story and personality traits, Another one was for locations with similar information. It also gave me some templates for those.
I told that I wanted to do as much as could, such as writing a screen play, composing music and preforming it for a sound track. I told it I planned to stitch every together using the Resolve video editor. It told me that was a good choice. I told it I would probably end up having it generate around 100 clips for me. Again it didn’t mention anything about limits. I do have a Pro subscription.
In the meantime I’ve been modeling my environment using Cinema 4D. A few days ago, I uploaded a scene inside the complex, and some reference images of one of characters, who is in a skin tight suit, no dialog but it gave me a video of the character walking down a corridore. It all been very cool so far.