Mechanisms of register variation in massively multilingual web-scale corpora
Bidragets beskrivning
This project targets web registers - web text varieties ranging from fact-based news to opinion-based advice pages and discussion fora. The project characterizes registers on the entire multilingual internet, providing detailed descriptions on all web registers in 18 languages across billions of words, and testing hypotheses on register characteristics and their stability on 100 languages. To tackle the yet unsolved challenges in modeling registers on the noisy, multilingual web, the project presents a novel framework combining register studies, and the recent advances in natural language processing (NLP) and multilingual deep learning. This allows us to compare the registers on the entire multilingual internet without manual work. The outcome will transform the noisy, fragmented web into a well-documented collection and have key theoretical importance for fields ranging from corpus linguistics to NLP, and practical consequences for everybody benefiting from web data.
Visa merStartår
2024
Slutår
2028
Beviljade finansiering
Finansiär
Finlands Akademi
Typ av finansiering
Akademiprojekt
Utlysning
Beslutfattare
Forskningsrådet för kultur och samhälle
13.06.2024
13.06.2024
Övriga uppgifter
Finansieringsbeslutets nummer
362459
Vetenskapsområden
Språkvetenskaper
Forskningsområden
Soveltava kielitiede
Identifierade teman
languages, language policy