Search results

Can FasterTransformer support SAM2 ( Meta segment anything model 2)?

Status: Open.

#795 In NVIDIA/FasterTransformer;

· jackwei86 opened on Sep 5, 2024

How to implement a gemm with FP16 and INT4 using kernel in FasterTransformer/src/fastertransformer/kernels/cutlass_kernels/fpA_intB_gemm

Status: Open.

#794 In NVIDIA/FasterTransformer;

· AkatsukiChiri opened on Jul 26, 2024

An error occurred for the specific cuda version

bugSomething isn't workingSomething isn't working

Status: Open.

#793 In NVIDIA/FasterTransformer;

· CSLiuPeng opened on May 8, 2024

can be used in diffusion models,like sd and sdxl? how?where is the demos?tks

bugSomething isn't workingSomething isn't working

Status: Open.

#792 In NVIDIA/FasterTransformer;

· henbucuoshanghai opened on Apr 24, 2024

bug: memory of position_encoding_table is not malloced correctly.

bugSomething isn't workingSomething isn't working

Status: Open.

#790 In NVIDIA/FasterTransformer;

· johnson-magic opened on Mar 27, 2024

How to know the correspondence between versions vcr.io/nvidia/pytorch:xx.xx-py3 and pytorch?

Status: Open.

#788 In NVIDIA/FasterTransformer;

· johnson-magic opened on Feb 29, 2024

what is the mean of EFF-FT?

Status: Open.

#787 In NVIDIA/FasterTransformer;

· johnson-magic opened on Feb 29, 2024

Are <code>fuseQKV masked attention</code> and Flash Attention the same?

Status: Open.

#786 In NVIDIA/FasterTransformer;

· likejazz opened on Feb 4, 2024

on H800 can not exec nvidia/pytorch:23.09-py3 container success

Status: Open.

#784 In NVIDIA/FasterTransformer;

· chenglinjun opened on Dec 29, 2023

Confidence is not returned in the decoding example？

bugSomething isn't workingSomething isn't working

Status: Open.

#783 In NVIDIA/FasterTransformer;

· liuzhuang1024 opened on Dec 26, 2023

Does FasterTransformer support multi-stream pipeline parallelism ?

Status: Open.

#781 In NVIDIA/FasterTransformer;

· FlyingPotatoZ opened on Nov 21, 2023

error You need C++17 to compile PyTorch

bugSomething isn't workingSomething isn't working

Status: Open.

#779 In NVIDIA/FasterTransformer;

· ranggihwang opened on Nov 7, 2023