Tin mới
NVIDIA Ada Lovelace Architecture
TensorRT-LLM optimizes the performance of a range of well-known models on NVIDIA GPUs. The following sections provide a list of supported GPU architectures as well as important features implemented in TensorRT-LLM.
LLaMA/LLaMA 2/LLaMA 3/LLaMA 3.1