Performance when using Ctranslate for GPT2?
|
|
0
|
343
|
December 13, 2023
|
OpenNMT-py v3.4.3 released - blazing fast beam search inference
|
|
4
|
786
|
June 15, 2024
|
Need support for Continuous batching of incoming requests
|
|
1
|
496
|
September 19, 2023
|
Single words incorrect translation
|
|
3
|
667
|
July 28, 2023
|
Cannot scale well with multiple GPUs
|
|
32
|
4090
|
November 8, 2022
|
General questions to improve performance
|
|
10
|
1035
|
October 28, 2022
|
Sentencepiece decoder working inconsistently
|
|
3
|
604
|
June 14, 2022
|
OpeNMT-tf memory error
|
|
7
|
573
|
May 16, 2022
|
Deploying ctranslate2 on production
|
|
1
|
1063
|
April 25, 2022
|
OpenNMT-tf with Ampere GPUs
|
|
11
|
1493
|
April 14, 2022
|
Transformer Parameters for Low-Resource Machine Translation
|
|
0
|
1483
|
March 21, 2022
|
CTranslate2 generate a vocabulary mapping file of M2M100
|
|
1
|
857
|
February 4, 2022
|
CUDA Out-of-memory issue with horovod
|
|
7
|
2304
|
November 30, 2021
|
Translation example from OpenNMT documentation
|
|
3
|
1024
|
September 14, 2021
|
Shared Vocab usage & workflow
|
|
2
|
1617
|
August 14, 2021
|
Decreasing run time
|
|
2
|
994
|
April 25, 2021
|
Training performance boost with OpenNMT-tf v2.17.0!
|
|
4
|
1066
|
March 23, 2021
|
Lesser BLEU score compared to Fairseq
|
|
5
|
3154
|
September 10, 2020
|
Language Model Accuracy
|
|
1
|
917
|
August 21, 2020
|
Reduction in size of checkpoints: `--train_from` arg
|
|
3
|
939
|
August 12, 2020
|
ONMT multiprocess inference on CPU in production
|
|
3
|
1988
|
July 10, 2020
|
Fast CPU decoding
|
|
3
|
2561
|
October 11, 2019
|
Linguistic features surprisingly decrease the performance!
|
|
19
|
5349
|
May 14, 2019
|
Does converting trained model from FP32 to FP16 improve inference performance?
|
|
2
|
2794
|
April 30, 2019
|
Multi-GPUs is slower than single GPU
|
|
12
|
6271
|
April 16, 2019
|
Advice on new GPU
|
|
10
|
2127
|
January 1, 2019
|
Translating huge number of sentences
|
|
2
|
1165
|
December 12, 2018
|
What is the relationship between ppl, accuracy and bleu scores in machine translation? In my experiment, although ppl and accuracy on the validationset are greatly improved, Bleu scores is reduced
|
|
0
|
2872
|
November 25, 2018
|
Is the speed of CTranslate faster than that of lua version?
|
|
13
|
3243
|
June 18, 2018
|
Why Lua/Torch? (Please don't hate me for this question.)
|
|
8
|
12375
|
June 4, 2018
|