@inproceedings{huamani-malca-etal-2024-lessons,
    title = "Lessons from Deploying the First Bilingual {P}eruvian {S}ign {L}anguage - {S}panish Online Dictionary",
    author = "Huamani-Malca, Joe  and
      Rodriguez Mondo{\~n}edo, Miguel  and
      Cerna-Herrera, Francisco  and
      Bejarano, Gissella  and
      V{\'a}squez Roque, Carlos  and
      Ramos Cantu, Cesar Augusto  and
      Oporto P{\'e}rez, Sabina",
    editor = "Calzolari, Nicoletta  and
      Kan, Min-Yen  and
      Hoste, Veronique  and
      Lenci, Alessandro  and
      Sakti, Sakriani  and
      Xue, Nianwen",
    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.lrec-main.901",
    pages = "10316--10323",
    abstract = "Bilingual dictionaries present several challenges, especially for sign languages and oral languages, where multimodality plays a role. We deployed and tested the first bilingual Peruvian Sign Language (LSP) - Spanish Online Dictionary. The first feature allows the user to introduce a text and receive as a result a list of videos whose glosses are related to the input text or Spanish word. The second feature allows the user to sign in front of the camera and shows the five most probable Spanish translations based on the similarity between the input sign and gloss-labeled sign videos used to train a machine learning model. These features are constructed in a design and architecture that differentiates among the coincidence for the Spanish text searched, the sign gloss, and Spanish translation. We explain in depth how these concepts or database columns impact the search. Similarly, we share the challenges of deploying a real-world machine learning model for isolated sign language recognition through Amazon Web Services (AWS).",
}

Bilingual dictionaries present several challenges, especially for sign languages and oral languages, where multimodality plays a role. We deployed and tested the first bilingual Peruvian Sign Language (LSP) - Spanish Online Dictionary. The first feature allows the user to introduce a text and receive as a result a list of videos whose glosses are related to the input text or Spanish word. The second feature allows the user to sign in front of the camera and shows the five most probable Spanish translations based on the similarity between the input sign and gloss-labeled sign videos used to train a machine learning model. These features are constructed in a design and architecture that differentiates among the coincidence for the Spanish text searched, the sign gloss, and Spanish translation. We explain in depth how these concepts or database columns impact the search. Similarly, we share the challenges of deploying a real-world machine learning model for isolated sign language recognition through Amazon Web Services (AWS).
Huamani-Malca, Joe Rodriguez Mondo{\~n}edo, Miguel Cerna-Herrera, Francisco Bejarano, Gissella V{\'a}squez Roque, Carlos Ramos Cantu, Cesar Augusto Oporto P{\'e}rez, Sabina
Lessons from Deploying the First Bilingual Peruvian Sign Language - Spanish Online Dictionary