EPIC: As a blind or low vision Francophone, I want to experience IMAGE in French, both for the UI and the generated interpretations, so that I can use IMAGE in my preferred language.

[notkaramel]

Roadmap:

1. Create IMAGE experiences in French (IMAGE-server)
   • (1st sprint) Integrate a translation API to generate French output from English output
   • (2nd sprint) Integrate the service to photo-audio-handler
2. Update UI to work in French (IMAGE-browser)
   • (3rd sprint) User option to experience French interpretation (UI)
   • (4th sprint) UX improvement and multi-lang support
3. (5th sprint) Testing, Validation, and move to production on pegasus

!! Things to keep in mind: The epic focuses on the French experience, but should implement in a generic way to support other languages in the future.

[notkaramel]

• First sprint STORY: As a handler developer, I want a service that translates English text into French, so that I can use it to generate French language renderings. #662
  • Implemented a gunicorn server (Python) using transformer to obtain tokenizer & model. Implementation can be viewed in the PR Translation Service Implementation  #688
  • Notes: The model was trained on MarianMT framework, which was written in C++. This means that there is a possibility that the performance of the service (multilang-support) can be improved significantly. Resources to follow if future Antoine (@notkaramel) or developers decided to re-implement:
    • Hugging Face's MarianMT Documentation
    • How to reduce inference time of OPUS MT translation (stackoverflow)
    • Helsinki-NLP/OPUS-MT
    • MarianNMT Documentation

[notkaramel]

• Second sprint STORY: As a handler developer, I want to send my generated text segments to a translation service so that I can provide experiences in languages other than English. #696
  • Each of a following PR is for a handler (stated in the title of each PR):
    • Integrating multilang-support translation service into photo-audio-handler #714
    • Integrate translation + French TTS to autour-handler #717
    • Integrate translation + French TTS service to high-charts handler #718

[notkaramel]

• As of June 16th, 2023, attempts to improve multilang-support translation service can be seen in Improved implementation of the translation multilang-support service #722 as a work in progress.
• The implementation works well to scale up IMAGE to support lots of other languages.

[notkaramel]

• Third sprint STORY: As an IMAGE user, I want to be able to select an output language on the extension, so that I can experience IMAGE in my preferred language. IMAGE-browser#327
  • PR: Language Selection for IMAGE extension IMAGE-browser#328
  • Added PR: French UI for IMAGE IMAGE-browser#330

[notkaramel]

• Fourth & fifth sprint: STORY: As a Francophone IMAGE user, I want the extension to be thoroughly tested and validated, so that I can have a seamless experience in my preferred language. #736
  • FrenchTTS pronouncing issue: French TTS (espnet-tts-fr) struggles with numerical numbers #723; was fixed with Helping French TTS to pronounce numbers  #739
  • Modifying handlers: Modifying multilang-support related implementation in handlers #743
  • Throughout testing on unicorn server & test extension.
  • Documentation: IMAGE Wiki 7th Entry on multilang
  • Pushing to production: TBD
• This sprint spans 6 weeks (2-sprint long) due to huge amount of work and the SURE presentation poster. This is also the final sprint of my summer 😿.

[notkaramel]

• The work of this epic was based on Support French language renderings #152. By finishing the final sprint, the work item will be closed.

[notkaramel]

French support is now available on production server, latest changes is also updated on the client-side browser extension. Congrats @notkaramel 🎉 🎉