How to Pretrain the BART model or generate BART-noisy in own data?

I find Transform/BART in Build Vocab/Train/Translate
How can I pretrain the BART model or generate the noisying results in my own data corpus by using these modules or settings? How can I visualize the noised inputs?
Appreciate very much!