The ILLFRAMES Babel Machine

Introduction

The ILLFRAMES Babel Machine Project uses the ILLFRAMES policy frames codebook to identify illiberal policy frames in texts. The codes are mutually exclusive and unequivocal. The codebook currently only covers the policy domain of migration and covid, but other policy domains such as climate, public health, and democracy will be added in the near future.

The model was the trained on sentence-level English language data and currently supports only datasets in English.

You can upload your datasets here for automated illiberal frames coding. If you wish to submit multiple datasets one after another, please wait 5-10 minutes between each of your submissions.

The upload requires you to fill the following form on metadata regarding the dataset. Please upload non-coded datasets, which should contain an id and a text column. The column names must be in row 1. You are free to add supplementary variables to the dataset beyond the compulsory ones in the columns following them.

After you upload your dataset and your file is successfully processed, you will receive the illiberal policy frames-coded dataset and a file (in CSV format) that includes the predictions by our model.

If the files you would like to upload are larger than 1 GB, please reach out to us with the download link attached (such as Dropbox or Google Drive) using our contact form.

If you have any questions or feedback regarding the Babel Machine, please let us know using our contact form. Please keep in mind that we can only get back to you on Hungarian business days.

Submit a dataset:

Processing Unit:

Name*

E-mail address*

Institution name*

Institution country*

Dataset name*

Level of dataset*

Geographical unit*

Dataset country*

Dataset language (language of data in text column)*

ILLFrames Domain*

Unit of observation*

Period (from)*

Period (to)*

Use case*

Description

The non-coded datasets should contain an id and text column. The column names must be in row 1. You are free to add supplementary variables to the dataset beyond the compulsory ones in the columns following them. All datasets must be uploaded in a CSV file format with UTF-8 encoding.

Dataset in .CSV format:
Choose file

Codebook:
Choose file

I have read the instructions and rules.

By ticking the checkbox I declare that this data does not contain any personal data and I am responsible for the legitimacy of the origin of the data. The uploaded data is suitable for text mining and I voluntarily provided the uploaded file(s) to poltextLAB. I also grant permission to poltextLAB researchers to make the data visualisation of the data I uploaded publicly available. In addition, I agree that the uploaded data may be stored on servers within the European Union and be used for data analysis and training purposes without time limit.

By ticking this checkbox, I consent to the processing of the personal data I provide in connection with the file upload (e.g., name, email address) for the sole purposes of returning the processed files and identifying the ownership of the uploaded data. I understand that my personal data will be securely stored and used exclusively for these purposes, in compliance with the purpose limitation principle (Article 5(1)(b)) and the data minimisation principle (Article 5(1)(c)) of the GDPR. I am also aware of my rights under Article 17 (Right to Erasure (‘right to be forgotten’)) and Article 15 (Right of access by the data subject) of the GDPR, and I may request the deletion or access to my personal data at any time.

Troubleshooting

If you are experiencing problems with the upload form, or your submission returns an error message (particularly "Something unexpected happened during upload. Please try again later."), please try performing the following steps:

If you use an adblocker browser extension, please turn it off for our site. Adblockers may interfere with legitimate functionality, such as the dropdowns on the upload form. (We do not serve ads on the site.)
Try turning off your VPN.
Try submitting your data from another browser, preferably with default settings.

If you are still receiving the "Something unexpected..." error message, please get in touch with us via our email address or the contact form. Try to add as much information as possible, e.g., what browser you are using, notable browser extensions, whether you are using a VPN or not, and exactly how you tried to submit the data (for example, you filled out everything but waited 10 minutes before pressing submit).

The research was supported by the Ministry of Innovation and Technology NRDI Office within the RRF-2.3.1-21-2022-00004 Artificial Intelligence National Laboratory project and received additional funding from the European Union's Horizon 2020 program under grant agreement no 101008468. We also thank the Babel Machine project and HUN-REN Cloud (Héder et al. 2022; https://science-cloud.hu) for their support. We used the machine learning service of the Slices RI infrastructure (https://www.slices-ri.eu/)

HOW TO CITE: If you use the Babel Machine for your work or research, please cite this paper:

Sebők, M., Máté, Á., Ring, O., Kovács, V., & Lehoczki, R. (2024). Leveraging Open Large Language Models for Multilingual Policy Topic Classification: The Babel Machine Approach. Social Science Computer Review, 0(0). https://doi.org/10.1177/08944393241259434