Performance when using Ctranslate for GPT2?
|
|
0
|
366
|
December 13, 2023
|
OpenNMT-py v3.4.3 released - blazing fast beam search inference
|
|
4
|
832
|
June 15, 2024
|
Need support for Continuous batching of incoming requests
|
|
1
|
517
|
September 19, 2023
|
Single words incorrect translation
|
|
3
|
704
|
July 28, 2023
|
Cannot scale well with multiple GPUs
|
|
32
|
4197
|
November 8, 2022
|
General questions to improve performance
|
|
10
|
1101
|
October 28, 2022
|
Sentencepiece decoder working inconsistently
|
|
3
|
626
|
June 14, 2022
|
OpeNMT-tf memory error
|
|
7
|
589
|
May 16, 2022
|
Deploying ctranslate2 on production
|
|
1
|
1084
|
April 25, 2022
|
OpenNMT-tf with Ampere GPUs
|
|
11
|
1532
|
April 14, 2022
|
Transformer Parameters for Low-Resource Machine Translation
|
|
0
|
1516
|
March 21, 2022
|
CTranslate2 generate a vocabulary mapping file of M2M100
|
|
1
|
882
|
February 4, 2022
|
CUDA Out-of-memory issue with horovod
|
|
7
|
2342
|
November 30, 2021
|
Translation example from OpenNMT documentation
|
|
3
|
1067
|
September 14, 2021
|
Shared Vocab usage & workflow
|
|
2
|
1658
|
August 14, 2021
|
Decreasing run time
|
|
2
|
1024
|
April 25, 2021
|
Training performance boost with OpenNMT-tf v2.17.0!
|
|
4
|
1089
|
March 23, 2021
|
Lesser BLEU score compared to Fairseq
|
|
5
|
3196
|
September 10, 2020
|
Language Model Accuracy
|
|
1
|
956
|
August 21, 2020
|
Reduction in size of checkpoints: `--train_from` arg
|
|
3
|
957
|
August 12, 2020
|
ONMT multiprocess inference on CPU in production
|
|
3
|
2020
|
July 10, 2020
|
Fast CPU decoding
|
|
3
|
2604
|
October 11, 2019
|
Linguistic features surprisingly decrease the performance!
|
|
19
|
5390
|
May 14, 2019
|
Does converting trained model from FP32 to FP16 improve inference performance?
|
|
2
|
2835
|
April 30, 2019
|
Multi-GPUs is slower than single GPU
|
|
12
|
6323
|
April 16, 2019
|
Advice on new GPU
|
|
10
|
2147
|
January 1, 2019
|
Translating huge number of sentences
|
|
2
|
1181
|
December 12, 2018
|
What is the relationship between ppl, accuracy and bleu scores in machine translation? In my experiment, although ppl and accuracy on the validationset are greatly improved, Bleu scores is reduced
|
|
0
|
2891
|
November 25, 2018
|
Is the speed of CTranslate faster than that of lua version?
|
|
13
|
3261
|
June 18, 2018
|
Why Lua/Torch? (Please don't hate me for this question.)
|
|
8
|
12437
|
June 4, 2018
|