MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation

Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination. Their extensive reach and influence in shaping online communities' sentiments make the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2024-02
Hauptverfasser: Wang, Han, Roy Ka-Wei Lee
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Wang, Han
Roy Ka-Wei Lee
description Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination. Their extensive reach and influence in shaping online communities' sentiments make them invaluable tools for campaigning and promoting ideologies. Despite the development of several meme-generation tools, there remains a gap in their systematic evaluation and their ability to effectively communicate ideologies. Addressing this, we introduce MemeCraft, an innovative meme generator that leverages large language models (LLMs) and visual language models (VLMs) to produce memes advocating specific social movements. MemeCraft presents an end-to-end pipeline, transforming user prompts into compelling multimodal memes without manual intervention. Conscious of the misuse potential in creating divisive content, an intrinsic safety mechanism is embedded to curb hateful meme production.
doi_str_mv 10.48550/arxiv.2403.14652
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2403_14652</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2981988761</sourcerecordid><originalsourceid>FETCH-LOGICAL-a521-95ea5fd8c4debf1218b0c636ccc249afd1305c32c88add8e92f34dd8549947b13</originalsourceid><addsrcrecordid>eNotj1FLwzAUhYMgOOZ-gE8WfO5MbpI28U2rTmHDB_de0uQWOtp0pumY_95u8-kcOOdc7kfIHaNLoaSkjyYcm8MSBOVLJjIJV2QGnLNUCYAbshiGHaUUshyk5DPyssEOi2Dq-JQUvY94jKNpE-Nd8h2Nt5i-huaAPtmMbWy63k3haZKs0GMwsen9LbmuTTvg4l_nZPv-ti0-0vXX6rN4XqdGAku1RCNrp6xwWNUMmKqozXhmrQWhTe0Yp9JysEoZ5xRqqLmYjBRai7xifE7uL2fPgOU-NJ0Jv-UJtDyDTo2HS2Mf-p8Rh1ju-jH46acStGJaqTxj_A-v81Wu</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2981988761</pqid></control><display><type>article</type><title>MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Wang, Han ; Roy Ka-Wei Lee</creator><creatorcontrib>Wang, Han ; Roy Ka-Wei Lee</creatorcontrib><description>Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination. Their extensive reach and influence in shaping online communities' sentiments make them invaluable tools for campaigning and promoting ideologies. Despite the development of several meme-generation tools, there remains a gap in their systematic evaluation and their ability to effectively communicate ideologies. Addressing this, we introduce MemeCraft, an innovative meme generator that leverages large language models (LLMs) and visual language models (VLMs) to produce memes advocating specific social movements. MemeCraft presents an end-to-end pipeline, transforming user prompts into compelling multimodal memes without manual intervention. Conscious of the misuse potential in creating divisive content, an intrinsic safety mechanism is embedded to curb hateful meme production.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2403.14652</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Computer Science - Artificial Intelligence ; Computer Science - Computation and Language ; Computer Science - Computers and Society ; Computer Science - Multimedia ; Large language models</subject><ispartof>arXiv.org, 2024-02</ispartof><rights>2024. This work is published under http://creativecommons.org/licenses/by-nc-sa/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/licenses/by-nc-sa/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,784,885,27925</link.rule.ids><backlink>$$Uhttps://doi.org/10.1145/3589334.3648151$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.2403.14652$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Wang, Han</creatorcontrib><creatorcontrib>Roy Ka-Wei Lee</creatorcontrib><title>MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation</title><title>arXiv.org</title><description>Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination. Their extensive reach and influence in shaping online communities' sentiments make them invaluable tools for campaigning and promoting ideologies. Despite the development of several meme-generation tools, there remains a gap in their systematic evaluation and their ability to effectively communicate ideologies. Addressing this, we introduce MemeCraft, an innovative meme generator that leverages large language models (LLMs) and visual language models (VLMs) to produce memes advocating specific social movements. MemeCraft presents an end-to-end pipeline, transforming user prompts into compelling multimodal memes without manual intervention. Conscious of the misuse potential in creating divisive content, an intrinsic safety mechanism is embedded to curb hateful meme production.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computation and Language</subject><subject>Computer Science - Computers and Society</subject><subject>Computer Science - Multimedia</subject><subject>Large language models</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GOX</sourceid><recordid>eNotj1FLwzAUhYMgOOZ-gE8WfO5MbpI28U2rTmHDB_de0uQWOtp0pumY_95u8-kcOOdc7kfIHaNLoaSkjyYcm8MSBOVLJjIJV2QGnLNUCYAbshiGHaUUshyk5DPyssEOi2Dq-JQUvY94jKNpE-Nd8h2Nt5i-huaAPtmMbWy63k3haZKs0GMwsen9LbmuTTvg4l_nZPv-ti0-0vXX6rN4XqdGAku1RCNrp6xwWNUMmKqozXhmrQWhTe0Yp9JysEoZ5xRqqLmYjBRai7xifE7uL2fPgOU-NJ0Jv-UJtDyDTo2HS2Mf-p8Rh1ju-jH46acStGJaqTxj_A-v81Wu</recordid><startdate>20240224</startdate><enddate>20240224</enddate><creator>Wang, Han</creator><creator>Roy Ka-Wei Lee</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240224</creationdate><title>MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation</title><author>Wang, Han ; Roy Ka-Wei Lee</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a521-95ea5fd8c4debf1218b0c636ccc249afd1305c32c88add8e92f34dd8549947b13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computation and Language</topic><topic>Computer Science - Computers and Society</topic><topic>Computer Science - Multimedia</topic><topic>Large language models</topic><toplevel>online_resources</toplevel><creatorcontrib>Wang, Han</creatorcontrib><creatorcontrib>Roy Ka-Wei Lee</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Access via ProQuest (Open Access)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv Computer Science</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wang, Han</au><au>Roy Ka-Wei Lee</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation</atitle><jtitle>arXiv.org</jtitle><date>2024-02-24</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Online memes have emerged as powerful digital cultural artifacts in the age of social media, offering not only humor but also platforms for political discourse, social critique, and information dissemination. Their extensive reach and influence in shaping online communities' sentiments make them invaluable tools for campaigning and promoting ideologies. Despite the development of several meme-generation tools, there remains a gap in their systematic evaluation and their ability to effectively communicate ideologies. Addressing this, we introduce MemeCraft, an innovative meme generator that leverages large language models (LLMs) and visual language models (VLMs) to produce memes advocating specific social movements. MemeCraft presents an end-to-end pipeline, transforming user prompts into compelling multimodal memes without manual intervention. Conscious of the misuse potential in creating divisive content, an intrinsic safety mechanism is embedded to curb hateful meme production.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2403.14652</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2024-02
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2403_14652
source arXiv.org; Free E- Journals
subjects Computer Science - Artificial Intelligence
Computer Science - Computation and Language
Computer Science - Computers and Society
Computer Science - Multimedia
Large language models
title MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-19T18%3A41%3A25IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=MemeCraft:%20Contextual%20and%20Stance-Driven%20Multimodal%20Meme%20Generation&rft.jtitle=arXiv.org&rft.au=Wang,%20Han&rft.date=2024-02-24&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2403.14652&rft_dat=%3Cproquest_arxiv%3E2981988761%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2981988761&rft_id=info:pmid/&rfr_iscdi=true