{"id":321,"date":"2022-06-11T13:58:41","date_gmt":"2022-06-11T10:58:41","guid":{"rendered":"https:\/\/quecst.qcri.org\/blog\/?p=321"},"modified":"2022-06-11T13:58:41","modified_gmt":"2022-06-11T10:58:41","slug":"detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning","status":"publish","type":"post","link":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/","title":{"rendered":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning"},"content":{"rendered":"<figure id=\"attachment_322\" aria-describedby=\"caption-attachment-322\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-322\" src=\"https:\/\/quecst.qcri.org\/blog\/wp-content\/uploads\/2022\/06\/pain_points02.png\" alt=\"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning\" width=\"640\" height=\"400\" srcset=\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/06\/pain_points02.png 640w, https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/06\/pain_points02-300x188.png 300w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-322\" class=\"wp-caption-text\">\u00a0<a href=\"http:\/\/www.bernardjjansen.com\/uploads\/2\/4\/1\/8\/24188166\/pain_points.pdf\" target=\"_blank\" rel=\"noopener\"><em>Detecting Pain Points from User-Generated Social Media Posts<\/em>\u00a0Using Machine Learning<\/a><\/figcaption><\/figure>\n<p>Artificial intelligence, particularly machine learning, carries high potential to automatically detect customers\u2019 pain points, which is a particular concern the customer expresses that the company can address. However, unstructured data scattered across social media make detection a nontrivial task.<\/p>\n<p>Thus, to help firms gain deeper insights into customers\u2019 pain points, the authors experiment with and evaluate the performance of various machine learning models to automatically detect pain points and pain point types for enhanced customer insights.<\/p>\n<p>The data consist of 4.2 million user-generated tweets targeting 20 global brands from five separate industries. Among the models they train, neural networks show the best performance at overall pain point detection, with an accuracy of 85% (F1 score =.80). The best model for detecting five specific pain points was RoBERTa 100 samples using SYNONYM augmentation.<\/p>\n<p>This study adds another foundational building block of machine learning research in marketing academia through the application and comparative evaluation of machine learning models for natural language\u2013based content identification and classification. In addition, the authors suggest that firms use pain point profiling, a technique for applying subclasses to the identified pain point messages to gain a deeper understanding of their customers\u2019 concerns.<\/p>\n<p>Salminen, J., Mustak, M., Corporan, J., Jung, S., &amp;\u00a0Jansen, B. J.\u00a0(2022).\u00a0<a href=\"http:\/\/www.bernardjjansen.com\/uploads\/2\/4\/1\/8\/24188166\/pain_points.pdf\" target=\"_blank\" rel=\"noopener\"><em>Detecting Pain Points from User-Generated Social Media Posts<\/em>\u00a0Using Machine Learning<\/a>.\u00a0<u>Journal of Interactive Marketing<\/u>. 57(3)\u00a0<a href=\"https:\/\/doi.org\/10.1177\/10949968221095556\" target=\"_blank\" rel=\"noopener\">https:\/\/doi.org\/10.1177\/10949968221095556<\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Artificial intelligence, particularly machine learning, carries high potential to automatically detect customers\u2019 pain points, which is a particular concern the customer expresses that the company can address. However, unstructured data scattered across social media make detection a nontrivial task. Thus, to help firms gain deeper insights into customers\u2019 pain points, the authors experiment with and&hellip; <a class=\"more-link\" href=\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\">Continue reading <span class=\"screen-reader-text\">Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.13 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua\" \/>\n<meta property=\"og:description\" content=\"Artificial intelligence, particularly machine learning, carries high potential to automatically detect customers\u2019 pain points, which is a particular concern the customer expresses that the company can address. However, unstructured data scattered across social media make detection a nontrivial task. Thus, to help firms gain deeper insights into customers\u2019 pain points, the authors experiment with and&hellip; Continue reading Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning\" \/>\n<meta property=\"og:url\" content=\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\" \/>\n<meta property=\"og:site_name\" content=\"Team Acua\" \/>\n<meta property=\"article:published_time\" content=\"2022-06-11T10:58:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/quecst.qcri.org\/blog\/wp-content\/uploads\/2022\/06\/pain_points02.png\" \/>\n<meta name=\"author\" content=\"Jim Jansen\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jim Jansen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\"},\"author\":{\"name\":\"Jim Jansen\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215\"},\"headline\":\"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning\",\"datePublished\":\"2022-06-11T10:58:41+00:00\",\"dateModified\":\"2022-06-11T10:58:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\"},\"wordCount\":250,\"publisher\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\"},\"articleSection\":[\"Customer segmentation\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\",\"url\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\",\"name\":\"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua\",\"isPartOf\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#website\"},\"datePublished\":\"2022-06-11T10:58:41+00:00\",\"dateModified\":\"2022-06-11T10:58:41+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/acua.qcri.org\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#website\",\"url\":\"https:\/\/acua.qcri.org\/blog\/\",\"name\":\"Team Acua\",\"description\":\"Audience, Customer, and User Analytics\",\"publisher\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/acua.qcri.org\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#organization\",\"name\":\"Team Acua\",\"url\":\"https:\/\/acua.qcri.org\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png\",\"contentUrl\":\"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png\",\"width\":1466,\"height\":770,\"caption\":\"Team Acua\"},\"image\":{\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215\",\"name\":\"Jim Jansen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g\",\"caption\":\"Jim Jansen\"},\"sameAs\":[\"https:\/\/quecst.qcri.org\/blog\"],\"url\":\"https:\/\/acua.qcri.org\/blog\/author\/jjansenacm-org\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/","og_locale":"en_US","og_type":"article","og_title":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua","og_description":"Artificial intelligence, particularly machine learning, carries high potential to automatically detect customers\u2019 pain points, which is a particular concern the customer expresses that the company can address. However, unstructured data scattered across social media make detection a nontrivial task. Thus, to help firms gain deeper insights into customers\u2019 pain points, the authors experiment with and&hellip; Continue reading Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning","og_url":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/","og_site_name":"Team Acua","article_published_time":"2022-06-11T10:58:41+00:00","og_image":[{"url":"https:\/\/quecst.qcri.org\/blog\/wp-content\/uploads\/2022\/06\/pain_points02.png"}],"author":"Jim Jansen","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Jim Jansen","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#article","isPartOf":{"@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/"},"author":{"name":"Jim Jansen","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215"},"headline":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning","datePublished":"2022-06-11T10:58:41+00:00","dateModified":"2022-06-11T10:58:41+00:00","mainEntityOfPage":{"@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/"},"wordCount":250,"publisher":{"@id":"https:\/\/acua.qcri.org\/blog\/#organization"},"articleSection":["Customer segmentation"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/","url":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/","name":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning - Team Acua","isPartOf":{"@id":"https:\/\/acua.qcri.org\/blog\/#website"},"datePublished":"2022-06-11T10:58:41+00:00","dateModified":"2022-06-11T10:58:41+00:00","breadcrumb":{"@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/acua.qcri.org\/blog\/detecting-pain-points-from-user-generated-social-media-posts-using-machine-learning\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/acua.qcri.org\/blog\/"},{"@type":"ListItem","position":2,"name":"Detecting Pain Points from User-Generated Social Media Posts Using Machine Learning"}]},{"@type":"WebSite","@id":"https:\/\/acua.qcri.org\/blog\/#website","url":"https:\/\/acua.qcri.org\/blog\/","name":"Team Acua","description":"Audience, Customer, and User Analytics","publisher":{"@id":"https:\/\/acua.qcri.org\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/acua.qcri.org\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/acua.qcri.org\/blog\/#organization","name":"Team Acua","url":"https:\/\/acua.qcri.org\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png","contentUrl":"https:\/\/acua.qcri.org\/blog\/wp-content\/uploads\/2022\/10\/cropped-cropped-logo.png","width":1466,"height":770,"caption":"Team Acua"},"image":{"@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/e3bb7a0b58349e548e8940716694c215","name":"Jim Jansen","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/acua.qcri.org\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a4f97370631247bb1aed9a897d658981?s=96&d=mm&r=g","caption":"Jim Jansen"},"sameAs":["https:\/\/quecst.qcri.org\/blog"],"url":"https:\/\/acua.qcri.org\/blog\/author\/jjansenacm-org\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/321"}],"collection":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/comments?post=321"}],"version-history":[{"count":1,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/321\/revisions"}],"predecessor-version":[{"id":323,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/321\/revisions\/323"}],"wp:attachment":[{"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/media?parent=321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/categories?post=321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/acua.qcri.org\/blog\/wp-json\/wp\/v2\/tags?post=321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}