Visualization-Based Improvement of Neural Machine Translation

We introduce a novel visual-interactive approach for analyzing, understanding, and correcting neural machine translation. Our system supports users in automatically translating documents using neural machine translation and identifying and correcting possible erroneous translations. User corrections can then be used to fine-tune the neural machine translation model and automatically improve the whole document. While translation results of neural machine translation can be impressive, there are still many challenges such as over- and under-translation, domain-specific terminology, and handling long sentences, making it necessary for users to verify translation results. Our system aims at supporting users in this task. Our visual analytics approach combines several visualization techniques in an interactive system. A parallel coordinates plot with multiple metrics related to translation quality can be used to find, filter, and select translations that might contain errors. An interactive beam search visualization and graph- or matrix-based visualizations for attention weights can be used for post-editing and understanding machine-generated translations. The machine translation model is updated from user corrections to improve the translation quality of the whole document. We designed our approach for an LSTM-based translation model and extended it to also include the Transformer architecture. We show for representative examples possible mistranslations and how to use our system to deal with them. A user study revealed that many participants favor such a system over manual text-based translation, especially for translating large documents. Furthermore, we performed quantitative computer-based experiments that show that our system can be used to improve translation quality and reduce post-editing efforts for domain-specific documents.

Project – Article - GitHub - Source code (DaRUS) - Models (DaRUS) - Video

@article{nmtvis2022,
  author = {Munz, Tanja and Väth, Dirk and Kuznecov, Paul and Vu, Ngoc Thang and Weiskopf, Daniel},
  title = {Visualization-based improvement of neural machine translation},
  journal = {Computers \& Graphics},
  year = {2022},
  volume = {103},
  pages = {45-60},
  doi = {10.1016/j.cag.2021.12.003},
}

Download BibTeX