11/24/2023 0 Comments Drop to gif aspect ratio distortedHere’s another video transformed with ControlNet Line art realistic.Įxperiment with different ControlNets to get different results. As we will see later, multiple ControlNet is a useful technique in reducing flickering. Unfortunately, as of the time of writing, multiple ControlNet does NOT work with the m2m script. ffmpeg -framerate 20 -pattern_type sequence -start_number 00000 -i ‘%05d-100.png’ -c:v libx264 -pix_fmt yuv420p out.mp4 Notes for ControlNet m2m script (You will need to have ffmpeg installed on your local PC) ffmpeg -framerate 20 -pattern_type glob -i '*.png' -c:v libx264 -pix_fmt yuv420p out.mp4Ī reader pointed out that the above command didn’t work on Windows and suggested the command below instead. Use the following command to convert the png files to an MP4 video. In the GIF option, set the Delay time to 5 (in 1/100 seconds) for 20 frames per second. Use the EZGIF page to convert the png files to an animated GIF. You have two options: (1) Combine the PNG files into an animated GIF, and (2) make an mp4 video. You will find a series of png files in the txt2img output folder. The script converts the image with ControlNet frame-by-frame. Step 5: Make an animated GIF or mp4 video Changing the seed will change the background and the look of the character.Ĭlick Generate. The seed value needs to be fixed to reduce flickering. Photo of Sci fi cute girl, pink hair, photorealistic, in the style of franciszek starowieyski, white porcelain sci fi, mecha, 32k uhd, machine aesthetics, dark white and azure, hans zatzka, silver and pink, science fiction city,shiny pink hair, half body, oil painting, white backgroundĮnter the following generation parameters: I will use deliberate v2.Ĭome up with a prompt and a negative prompt. Select a model you wish to use in the Stable Diffusion checkpoint at the top of the page. Enter the following settings:įor your own videos, you will want to experiment with different control types and preprocessors. Step 3: Enter ControlNet settingĮxpand the ControlNet section. Upload the mp4 video to the ControlNet-0 tab. In the Script dropdown menu, select the ControlNet m2m script. In AUTOMATIC1111 Web-UI, navigate to the txt2img page. Step 2: Upload the video to ControlNet-M2M The second setting lets the controlnet m2m script feed the video frames to the ControlNet extension.Ĭlick Apply Settings. The first option disables saving the control image to the image output folder, so you can grab the frame images easier. Allow other script to control this extension: Yes.Use the following button to download the video if you wish to follow with the same video.ĭownload input video Step 1: Update A1111 settingsīefore using the controlnet m2m script in AUTOMATIC1111, you must go to Settings > ControlNet. This video-to-video method is simpler to use but has a higher amount of flickering. Follow the installation instructions in the ControlNet article. You will need to install the ControlNet extension. You can use this GUI on Windows, Mac, or Google Colab. You will need AUTOMATIC1111 Stable Diffusion GUI. Step 3: Enter Pre-processing parameters.Step 2: Enter SD-CN-Animation parameters.Step 6: Convert the output PNG files to video or animated gif.Step 1: Convert the mp4 video to png files.Step 5: Make an animated GIF or mp4 video.Step 2: Upload the video to ControlNet-M2M.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |