China ASEAN Language Intelligence Institute independently builds a multilingual corpus
In recent years, with the rapid development of artificial intelligence and natural language processing technology, the construction of multilingual corpus has become an important foundation for promoting cross-language communication and technological innovation. The China ASEAN Research Institute of Language Intelligence (hereinafter referred to as the "Institute") recently announced that it has successfully built a multilingual corpus covering the main languages of the ten ASEAN countries, aiming to promote language interoperability, cultural dissemination and intelligent technology cooperation between China and ASEAN countries.
The construction of this corpus not only fills the gap in the field of multilingual language resources in China, but also provides high-quality data support for artificial intelligence applications such as machine translation, speech recognition, and text analysis. Here is an overview of the main features and data of this corpus:
Language types | Corpus Scale (100 million words) | Coverage areas | Source of data |
---|---|---|---|
Chinese | 50 | News, law, science and literature | Public publications, government documents |
Thai | 12 | Social media, news, travel | Provided by network crawling and cooperative institutions |
Vietnamese | 10 | Economics, cultures, education | Academic papers, news media |
Malay | 8 | Business, law, daily conversations | Corporate cooperation, translation agency |
Indonesian | 8 | News, social media, film and television | Public data sets, network crawling |
Corpus application scenarios
The construction of this corpus provides basic support for applications in multiple fields, mainly including:
1.Machine Translation: Through high-quality multilingual parallel corpus, the institute has trained a translation model that supports language pairs such as Chinese-English, Chinese-Thailand, and Chinese-Vietnam, and the translation accuracy is significantly improved.
2.Voice recognition: The voice data in the corpus provides training materials for the speech recognition systems of ASEAN countries, helping to develop applications such as intelligent voice assistants and customer service systems.
3.Cross-language information retrieval: Users can search related content in ASEAN languages through Chinese keywords, which greatly facilitates academic research and commercial information acquisition.
4.Cultural communication and research: The literature, film and television content in the corpus provides cultural scholars with rich analytical materials and promote cultural exchanges between China and ASEAN countries.
Future planning
The Institute said that the scale and language types of the corpus will be further expanded in the future, and plans to include more ASEAN small languages such as Burmese and Cambodian. At the same time, the institute will cooperate with academic institutions and enterprises in ASEAN countries to promote the open sharing of corpus and contribute to global language intelligence research.
The construction of this multilingual corpus is not only an important achievement of the China ASEAN Institute of Language Intelligence, but also provides strong support for language interoperability and technical cooperation under the "Belt and Road" initiative. With the continuous advancement of artificial intelligence technology, the application prospects of multilingual corpus will be broader.
check the details
check the details