![]() In this example, if you choose an output of 768x768 with a batch size of 1, the dynamic engine will automatically be used. ![]() This means that you can create a dynamic engine with a range that covers a 512 height and width to 768 height and width, with batch sizes of 1 to 4, while also creating a static engine for 768x768 with a batch size of 2. Performance or Flexibility…why not both? The TensorRT extension allows you to create both static engines and dynamic engines and will automatically choose the best engine for your needs.Dynamic engines generally offer slightly lower performance than static engines, but allow for much greater flexibility by allowing a wider range of output settings with a single engine. Dynamic Engines can be configured for a range of height and width resolutions, and a range of batch sizes. ![]() Static engines use the least amount of VRAM. Static engines provide the best performance at the cost of flexibility.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |