TLUSTOŠ, V. Interpretation of emotions from text on social media [online]. Brno: Vysoké učení technické v Brně. Fakulta informačních technologií. 2024.
The student has completed all the objectives specified in the project description. He has developed two models based on RoBERTa to analyze text for the detection of various emotions. He has tested it with four different datasets and the results are promising. The student has provided detailed results and comparisons with existing methods. It’s a very good work and thesis is easy to read and nicely written.
| Kritérium | Známka | Body | Slovní hodnocení |
|---|---|---|---|
| Informace k zadání | The thesis was related to detection of emotions from text on social media platforms. The work was challenging because it not only required knowledge in natural language processing, and machine learning but also required understanding of the emotions from psychological perspective. The complexity of the project increased due to the multi-level classification, that is a variety of emotions. The student proposed two models based on RoBERTa model, a large language model, to achieve this objective and tested it on four different databases. The results are promising. | ||
| Práce s literaturou | The student has provided detailed literature review in chapter 2. The chapter starts with description of emotions and the corresponding emotion models. Then the various datasets are discussed that have been used by various researchers in this domain. After discussing the datasets, the various quality metrics are discussed in detail. Finally, many articles are presented which have attempted to provide a solution to this problem. The last section provides critical review highlighting the limitations of the existing methods. Overall, it’s a very well written chapter. | ||
| Aktivita během řešení, konzultace, komunikace | The student had regular weekly meetings throughout the two semesters while working on the thesis. He was punctual and always came to meetings well prepared and on time. I found him to be a very dedicated and hardworking student. | ||
| Aktivita při dokončování | The student regularly consulted me before the submission of the thesis. The work was challenging because four different datasets were involved. The student proposed two models based on RoBERTa and performed extensive experimentation. Inspite of that, the student was able to complete all the development in time and was able to submit the thesis within the given timeframe. | ||
| Publikační činnost, ocenění | The thesis is well structured and organized, nicely written and contains content which is publishable. The student is willing to assist in preparing the draft for a journal paper. The journal paper is being prepared and will be submitted to a Q1 journal. In addition, he has provided a working web page on hugging face where a user can type in some text and the model will predict the emotion. |
The technical report is well-written and precise. The software solution works well, and the achieved results are competitive with the state of the art. Therefore, I overall grade the work as excellent - A .
| Kritérium | Známka | Body | Slovní hodnocení |
|---|---|---|---|
| Náročnost zadání | The assignment is in a more difficult category. It is a research-oriented assignment, requiring deep research into the state of the art and rigorous evaluation of results. | ||
| Rozsah splnění požadavků zadání | |||
| Rozsah technické zprávy | The technical report is approximately 83 standard pages long, falling within the usual range. All sections of the report contain essential and information-rich content. | ||
| Prezentační úroveň technické zprávy | 96 | The technical report is logically structured. First, the author presents a review of the literature on psychological models of emotions and approaches to emotion recognition. Available datasets are described and evaluated. Limitations and gaps in existing approaches are described. Next, research goals are outlined, and methodology to address the goals is proposed and fully described. Finally, the results of all experiments are thoroughly analysed and extensively evaluated in a span of 14 pages. The achieved results are competitive with the state of the art. The chapters are reasonably extensive and easy to understand for the reader. The continuity of individual chapters is also at a high level. | |
| Formální úprava technické zprávy | 92 | The document is well-designed from a typographic standpoint. There is only one instance of text and table overflowing to the page border. The technical report is written in clear and proper English. The language used is well-crafted, with no apparent mistakes in style or grammar. The text is clear and easy to understand. | |
| Práce s literaturou | 90 | The study sources are well chosen and represent actual state of the art. The sources are mostly scientific papers and are relevant to the assignment. The author works well with the sources and cites them accordingly. Only in the chapter regarding metrics of classification models, the lesser known metrics such as Brier Score or Expected Calibration Error probably should have sources specified. However, this issue is negligible in the context of the whole work. The rest of metrics can be safely regarded as common knowledge. Bibliographic citations are complete without any apparent problems. | |
| Realizační výstup | 92 | The software solution works well and is well-structured. It includes a model training component, evaluation scripts, and a demo application. The code is sufficiently commented and documented. The trained models were thoroughly evaluated. Also, the author made the models, application, and results freely available to the community, which is commendable. | |
| Využitelnost výsledků | The thesis is research-oriented and the achieved results are competitive with the state of the art, indicating potential for publication. |
eVSKP id 153407