{"id":925,"date":"2024-05-12T20:36:54","date_gmt":"2024-05-12T17:36:54","guid":{"rendered":"https:\/\/acua.qcri.org\/blog\/?p=925"},"modified":"2024-05-12T20:36:54","modified_gmt":"2024-05-12T17:36:54","slug":"deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions","status":"publish","type":"post","link":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/","title":{"rendered":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions"},"content":{"rendered":"
\"Deus
\u00a0Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions<\/a><\/em><\/figcaption><\/figure>\n

Large language models (LLMs) can generate personas based on prompts that describe the target user group. To understand what kind of personas LLMs generate, in\u00a0this research led by Joni Salminen<\/a>, we investigate the diversity and bias in 450 LLM-generated personas with the help of internal evaluators (n=4) and subject-matter experts (SMEs) (n=5).<\/p>\n

The research findings reveal biases in LLM-generated personas, particularly in age, occupation, and pain points, as well as a strong bias towards personas from the United States. Human evaluations demonstrate that LLM persona descriptions were informative, believable, positive, relatable, and not stereotyped. The SMEs rated the personas slightly more stereotypical, less positive, and less relatable than the internal evaluators.<\/p>\n

The findings suggest that LLMs can generate consistent personas perceived as believable, relatable, and informative while containing relatively low amounts of stereotyping.<\/p>\n

Read the full research article! You will be glad you did!<\/p>\n

Salminen, J., Lui, C., Pian, W., Chi, J., H\u00e4yh\u00e4nen, E., and\u00a0Jansen, B. J.\u00a0(2023)\u00a0Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions<\/a><\/em>, In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), 11-16 May 2024, O\u02bbahu, Hawai\u02bbi, USA. Article 510, 1\u201320.\u00a0https:\/\/doi.org\/10.1145\/3613904.3642036<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Large language models (LLMs) can generate personas based on prompts that describe the target user group. To understand what kind of personas LLMs generate, in\u00a0this research led by Joni Salminen, we investigate the diversity and bias in 450 LLM-generated personas with the help of internal evaluators (n=4) and subject-matter experts (SMEs) (n=5). The research findings… Continue reading Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[26,2,57],"tags":[],"yoast_head":"\nDeus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua\" \/>\n<meta property=\"og:description\" content=\"Large language models (LLMs) can generate personas based on prompts that describe the target user group. To understand what kind of personas LLMs generate, in\u00a0this research led by Joni Salminen, we investigate the diversity and bias in 450 LLM-generated personas with the help of internal evaluators (n=4) and subject-matter experts (SMEs) (n=5). The research findings… Continue reading Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions\" \/>\n<meta property=\"og:url\" content=\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\" \/>\n<meta property=\"og:site_name\" content=\"Team Acua\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-12T17:36:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2024\/05\/Screenshot-2023-08-08-174236-300x257.png\" \/>\n<meta name=\"author\" content=\"Jim Jansen\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jim Jansen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\"},\"author\":{\"name\":\"Jim Jansen\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215\"},\"headline\":\"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions\",\"datePublished\":\"2024-05-12T17:36:54+00:00\",\"dateModified\":\"2024-05-12T17:36:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\"},\"wordCount\":240,\"publisher\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\"},\"articleSection\":[\"Algorithms\",\"Persona Analytics\",\"Web analytics\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\",\"url\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\",\"name\":\"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua\",\"isPartOf\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#website\"},\"datePublished\":\"2024-05-12T17:36:54+00:00\",\"dateModified\":\"2024-05-12T17:36:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/acua.qcri.org\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#website\",\"url\":\"https:\/\/acua.qcri.org\/blog\/\",\"name\":\"Team Acua\",\"description\":\"Audience, Customer, and User Analytics\",\"publisher\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/acua.qcri.org\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\",\"name\":\"Team Acua\",\"url\":\"https:\/\/acua.qcri.org\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png\",\"contentUrl\":\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png\",\"width\":1466,\"height\":770,\"caption\":\"Team Acua\"},\"image\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215\",\"name\":\"Jim Jansen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g\",\"caption\":\"Jim Jansen\"},\"sameAs\":[\"https:\/\/quecst.qcri.org\/blog\"],\"url\":\"https:\/\/acua.qcri.org\/blog\/author\/jjansenacm-org\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/","og_locale":"en_US","og_type":"article","og_title":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua","og_description":"Large language models (LLMs) can generate personas based on prompts that describe the target user group. To understand what kind of personas LLMs generate, in\u00a0this research led by Joni Salminen, we investigate the diversity and bias in 450 LLM-generated personas with the help of internal evaluators (n=4) and subject-matter experts (SMEs) (n=5). The research findings… Continue reading Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions","og_url":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/","og_site_name":"Team Acua","article_published_time":"2024-05-12T17:36:54+00:00","og_image":[{"url":"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2024\/05\/Screenshot-2023-08-08-174236-300x257.png"}],"author":"Jim Jansen","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jim Jansen","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#article","isPartOf":{"@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/"},"author":{"name":"Jim Jansen","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215"},"headline":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions","datePublished":"2024-05-12T17:36:54+00:00","dateModified":"2024-05-12T17:36:54+00:00","mainEntityOfPage":{"@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/"},"wordCount":240,"publisher":{"@id":"https:\/\/acua.qcri.org\/blog\/#organization"},"articleSection":["Algorithms","Persona Analytics","Web analytics"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/","url":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/","name":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions - Team Acua","isPartOf":{"@id":"https:\/\/acua.qcri.org\/blog\/#website"},"datePublished":"2024-05-12T17:36:54+00:00","dateModified":"2024-05-12T17:36:54+00:00","breadcrumb":{"@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/acua.qcri.org\/blog\/deus-ex-machina-and-personas-from-large-language-models-investigating-the-composition-of-ai-generated-persona-descriptions\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/acua.qcri.org\/blog\/"},{"@type":"ListItem","position":2,"name":"Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions"}]},{"@type":"WebSite","@id":"https:\/\/acua.qcri.org\/blog\/#website","url":"https:\/\/acua.qcri.org\/blog\/","name":"Team Acua","description":"Audience, Customer, and User Analytics","publisher":{"@id":"https:\/\/acua.qcri.org\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/acua.qcri.org\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/acua.qcri.org\/blog\/#organization","name":"Team Acua","url":"https:\/\/acua.qcri.org\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png","contentUrl":"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png","width":1466,"height":770,"caption":"Team Acua"},"image":{"@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215","name":"Jim Jansen","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g","caption":"Jim Jansen"},"sameAs":["https:\/\/quecst.qcri.org\/blog"],"url":"https:\/\/acua.qcri.org\/blog\/author\/jjansenacm-org\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/925"}],"collection":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/comments?post=925"}],"version-history":[{"count":1,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/925\/revisions"}],"predecessor-version":[{"id":929,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/925\/revisions\/929"}],"wp:attachment":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/media?parent=925"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/categories?post=925"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/tags?post=925"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}