Mechanisms of register variation in massively multilingual web-scale corpora
Description of the granted funding
This project targets web registers - web text varieties ranging from fact-based news to opinion-based advice pages and discussion fora. The project characterizes registers on the entire multilingual internet, providing detailed descriptions on all web registers in 18 languages across billions of words, and testing hypotheses on register characteristics and their stability on 100 languages. To tackle the yet unsolved challenges in modeling registers on the noisy, multilingual web, the project presents a novel framework combining register studies, and the recent advances in natural language processing (NLP) and multilingual deep learning. This allows us to compare the registers on the entire multilingual internet without manual work. The outcome will transform the noisy, fragmented web into a well-documented collection and have key theoretical importance for fields ranging from corpus linguistics to NLP, and practical consequences for everybody benefiting from web data.
Show moreStarting year
2024
End year
2028
Granted funding
Funder
Research Council of Finland
Funding instrument
Academy projects
Decision maker
Scientific Council for Social Sciences and Humanities
13.06.2024
13.06.2024
Other information
Funding decision number
362459
Fields of science
Languages
Research fields
Soveltava kielitiede
Identified topics
languages, language policy