Suggestion: TensorRT

Viewing 1 reply thread
  • Author
    Posts
    • #10830
      AvatarGiannis Flabouras
      Participant

        Recently nvidia released a tensor extension for the webui

        It would be cool if Andrew made a tutorial on how to make RT engines and convert loras. Personally using an SD1.5 model i managed to get on a batch size of 4 images on a 3090RTX  images of 512×768 and using the LCM lora in only just 3 seconds! It would be cool if Andrew made a detailed tutorial on how to use those various settings when creating the engines and explain more in-depth thanks.

         

      • #10831
        AvatarAndrew
        Keymaster

          Great suggestion! Played with it when it came out but it was too buggy. It should be a good time to revisit now.

      Viewing 1 reply thread
      • You must be logged in to reply to this topic.