{"id":2490,"date":"2024-12-20T08:04:41","date_gmt":"2024-12-20T07:04:41","guid":{"rendered":"https:\/\/wp.unil.ch\/iaunil\/generativr-ai-developing-an-understanding-of-its-mechanisms-to-enable-a-critical-and-enlightened-use\/"},"modified":"2025-12-15T14:48:34","modified_gmt":"2025-12-15T13:48:34","slug":"generativr-ai-developing-an-understanding-of-its-mechanisms-to-enable-a-critical-and-enlightened-use","status":"publish","type":"post","link":"https:\/\/wp.unil.ch\/iaunil\/en\/generativr-ai-developing-an-understanding-of-its-mechanisms-to-enable-a-critical-and-enlightened-use\/","title":{"rendered":"Generative AI: developing an understanding of its mechanisms to enable a critical use"},"content":{"rendered":"\n<div class=\"wp-block-group has-global-padding is-content-justification-left is-layout-constrained wp-container-core-group-is-layout-5b3d42a2 wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-group has-background has-ubuntu-font-family has-global-padding is-layout-constrained wp-container-core-group-is-layout-86f7a7ce wp-block-group-is-layout-constrained\" style=\"background-color:#d5e4e7;margin-bottom:var(--wp--preset--spacing--30);padding-top:var(--wp--preset--spacing--30);padding-right:var(--wp--preset--spacing--30);padding-bottom:var(--wp--preset--spacing--30);padding-left:var(--wp--preset--spacing--30);font-style:italic;font-weight:500\">\n<p>Professor Beno\u00eet Garbinato shares his insights into the mechanisms of generative artificial intelligence. He explains how these systems operate based on probabilities, highlights the crucial role of human input in their training, and explores the ethical and educational implications of their use. His message is clear: these tools are powerful, but they must be understood in order to be used wisely \u2014 especially in higher education, where they are already challenging traditional assessment methods.  <\/p>\n<\/div>\n\n\n\n<p style=\"font-size:clamp(0.875rem, 0.875rem + ((1vw - 0.2rem) * 0.708), 1.3rem);\">Professor Beno\u00eet Garbinato from department of Information Systems at UNIL Business faculties (HEC), shares his insights into how generative AI works and its implications for teaching. With an engineering degree from EPFL, Professor Garbinato began his career in industry before transitionning to academia in 2004. Although artificial intelligence is not his area of specialization, his strong background in algorithms enables him to offer an informed perspective on these technologies.  <\/p>\n<\/div>\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\" style=\"margin-top:var(--wp--preset--spacing--40);margin-bottom:var(--wp--preset--spacing--40)\"><div class=\"wp-block-embed__wrapper\">\r\n<iframe loading=\"lazy\" title=\"IA g\u00e9n\u00e9ratives et enseignement sup\u00e9rieur : entretien avec le professeur Beno\u00eet Garbinato\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/lRHeGsnT-SQ?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\r\n \r\n<\/div><\/figure><br>\n\n<div class=\"wp-block-group is-layout-flow wp-block-group-is-layout-flow\" style=\"padding-top:var(--wp--preset--spacing--20);padding-bottom:var(--wp--preset--spacing--20)\">\n<h2 class=\"wp-block-heading\">A system based on probabilities<\/h2>\n\n\n\n<p>Professor Garbinato explains that the working of a langage model as ChatGPT is based on a similar principle as text prediction models on smartphones: d&#8217;un mod\u00e8le de langage comme ChatGPT repose sur un principe similaire \u00e0 celui des syst\u00e8mes de pr\u00e9diction de texte des smartphones : &#8220;It&#8217;s very simplified, but it&#8217;s the same kind of algorithm you have on your phone when you&#8217;re trying to write a message and the software suggests the end of your sentences.\u201d The key distinction is the scale: ChatGPT has been trained on an extensive corpus and operates with millions of parameters. <\/p>\n\n\n\n<p>A crucial point raised by the researcher is that these models have no real understanding of what they generate : &#8220;ChatGPT hasn&#8217;t any notion of what is true or false, what is logical or illogical. However, what it has is a notion of what makes a statement plausible and fluent.&#8221;<\/p>\n<\/div>\n\n<div class=\"wp-block-group is-layout-flow wp-block-group-is-layout-flow\" style=\"padding-top:var(--wp--preset--spacing--20);padding-bottom:var(--wp--preset--spacing--20)\">\n<h2 class=\"wp-block-heading\">Human intervention in data cleaning<\/h2>\n\n\n\n<p>The interview highlights a lesser-known dimension of generative AI development: the substantial human effort involved in cleaning training data. In order to mitigate the reproduction of biases and harmful content present on the internet, a large workforce is tasked with curating and filtering the textual datasets used during model training. This situation brings to light a number of ethical concerns, especially in relation to the labor conditions of the individuals performing this work\u2014many of whom are underpaid and based in developing regions.  <\/p>\n\n\n\n<p>As an illustrative example, the professor mentions Microsoft\u2019s AI Tay in 2017-2018, which had to be shut down after it became &#8220;racist, misogynistic, and conspiracy-minded&#8221; in just 24h of exposure to Twitter contents. This experience then highlighted the importance of pre-filtering training datasets to prevent undesirable model behavior. <\/p>\n<\/div>\n\n<div class=\"wp-block-group is-layout-flow wp-block-group-is-layout-flow\" style=\"padding-top:var(--wp--preset--spacing--20);padding-bottom:var(--wp--preset--spacing--20)\">\n<h2 class=\"wp-block-heading\">Implications for education<\/h2>\n\n\n\n<p>Professor Garbinato, speaking as an educator, describes these tools as &#8216;absolutely fantastic\u2014provided you know what you&#8217;re doing with them.&#8217; He also highlights the importance of making a qualitative evaluation of the sentence generated. This technological shift is prompting him to rethink his assessment methods: &#8216;Testing rote memorization no longer makes sense. On the other hand, understanding how a piece of code works, identifying its issues or vulnerabilities\u2014that requires real intelligence.&#8217;  <\/p>\n\n\n\n<p>He encourages his colleagues in education to prioritize conceptual understanding over rote memorization, given that AI tools are now capable of producing highly plausible discourse without any genuine comprehension.<\/p>\n<\/div>\n\n<div class=\"wp-block-group is-layout-flow wp-block-group-is-layout-flow\" style=\"padding-top:var(--wp--preset--spacing--20);padding-bottom:var(--wp--preset--spacing--20)\">\n<h2 class=\"wp-block-heading\">Developpment prospects<\/h2>\n\n\n\n<p>Regarding the future of these technologies, the professor notes that the initial wave of enthusiasm is beginning to subside. He points out that ChatGPT\u2019s true innovation was less technological than social\u2014stemming from its release to the general public. <\/p>\n\n\n\n<p>Looking ahead, he mentions ongoing research\u2014particularly at Google\u2014aimed at combining language models with a &#8216;logical truth model.&#8217; &#8216;The day we manage to integrate the two, we\u2019ll take a significant step forward. [&#8230;] Not only will we be able to generate fluent text, as we already can, but we\u2019ll also have some guarantees that the output is logically coherent.&#8217;<\/p>\n\n\n\n<p>In conclusion, Professor Garbinato emphasizes the importance of not treating technology as magic. He urges users to always verify the information generated by these systems, even when it appears plausible: &#8216;Even if the discourse is fluent, even if it seems logically well-structured, go check the facts, cross-check the information, and see whether multiple sources say the same thing\u2014before concluding that because it sounds fluent and credible, it must be true.&#8217; <\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Beno\u00eet Garbinato, a professor at HEC Lausanne, explains the workings of generative AI and stresses the importance of a critical approach to its applications, limitations, and ethical concerns.<\/p>\n","protected":false},"author":108,"featured_media":1902,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","footnotes":""},"categories":[20],"tags":[],"class_list":{"0":"post-2490","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-ai-for-everyone"},"_links":{"self":[{"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/posts\/2490","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/users\/108"}],"replies":[{"embeddable":true,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/comments?post=2490"}],"version-history":[{"count":5,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/posts\/2490\/revisions"}],"predecessor-version":[{"id":3344,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/posts\/2490\/revisions\/3344"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/media\/1902"}],"wp:attachment":[{"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/media?parent=2490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/categories?post=2490"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wp.unil.ch\/iaunil\/en\/wp-json\/wp\/v2\/tags?post=2490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}