What Drives Health Professionals to Tweet About #HPVvaccine? Identifying Strategies for Effective Communication
ORIGINAL RESEARCH — Volume 15 — October 11, 2018
Philip M. Massey, PhD, MPH1; Alex Budenz, MA1; Amy Leader, DrPH, MPH2; Kara Fisher, MPH3; Ann C. Klassen, PhD1; Elad Yom-Tov, PhD, MSc4 (View author affiliations)
Suggested citation for this article: Massey PM, Budenz A, Leader A, Fisher K, Klassen AC, Yom-Tov E. What Drives Health Professionals to Tweet About #HPVvaccine? Identifying Strategies for Effective Communication. Prev Chronic Dis 2018;15:170320. DOI: http://dx.doi.org/10.5888/pcd15.170320external icon.
We conducted this study to quantify how health professionals use Twitter to communicate about the human papillomavirus (HPV) vaccine.
We collected 193,379 tweets from August 2014 through July 2015 that contained key words related to HPV vaccine. We classified all tweets on the basis of user, audience, sentiment, content, and vaccine characteristic to examine 3 groups of tweets: 1) those sent by health professionals, 2) those intended for parents, and 3) those sent by health professionals and intended for parents. For each group, we identified the 7-day period in our sample with the most number of tweets (spikes) to report content.
Of the 193,379 tweets, 20,451 tweets were from health professionals; 16,867 tweets were intended for parents; and 1,233 tweets overlapped both groups. The content of each spike varied per group. The largest spike in tweets from health professionals (n = 851) focused on communicating recently published scientific evidence. Most tweets were positive and were about resources and boys. The largest spike in tweets intended for parents (n = 1,043) centered on a national awareness day and were about resources, personal experiences, boys, and girls. The largest spike in tweets from health professionals to parents (n = 89) was in January and centered on an event hosted on Twitter that focused on cervical cancer awareness month.
Understanding drivers of tweet spikes may help shape future communication and outreach. As more parents use social media to obtain health information, health professionals and organizations can leverage awareness events and personalize messages to maximize potential reach and parent engagement.
Approximately 80 million people in the United States, or approximately 1 in 4, are infected with human papillomavirus (HPV), and 14 million new cases of HPV occur each year (1). Long-term infection with certain types of HPV can cause cancer and genital warts, and a major public health advancement has been the development of vaccines that protect against these cancer-related strains of HPV (1). The vaccine is recommended for girls and boys (2), and updated 2016 guidelines recommend that a 2-dose series be administered 6 to 12 months apart (3).
Although vaccine rates have increased over the past 10 years, national rates continue to fall short of the Healthy People 2020 goal of 80% HPV vaccine coverage (4). Understanding the complex barriers surrounding HPV vaccine acceptance, particularly related to parent resistance, is key to strengthening vaccine uptake among adolescents (5). A key predictor of HPV vaccine uptake is a health professional’s recommendation (6,7). Although the Centers for Disease Control and Prevention provides guidelines for vaccine administration, one study found that some health professionals were more likely to strongly recommend the vaccine to older children than to younger children, and to girls than to boys (8). As more parents and health professionals are turning to online resources for health information and communication, there is an opportunity to address barriers and misinformation through strategic information dissemination and communication (9,10).
Social media, and particularly Twitter, is an online resource that many use to look for health information and to communicate about their health and health care experiences (11). There has been a recent increase in vaccine resources that parents can access through social media (12); however, many of these resources disseminate false information, speak out against medical professionals, and perpetuate fear of vaccines (13). To address health consumers’ growing use of online health information, various reports underscore the importance for health professionals to incorporate digital communication into their practice (14,15).
Given that a major driver of HPV vaccine uptake is a health professional’s recommendation and that more parents are turning to online resources for health information, we sought to examine how these topics are discussed on Twitter, particularly the communication pattern of health professionals related to the HPV vaccine on Twitter. Furthermore, drawing from research that examined the predictive nature of communication spikes on Twitter — specifically how online spikes may be associated with offline behaviors — we conducted a subanalysis of communication spikes to both describe current patterns and inform future use of this communication channel for preventive health care, in particular the HPV vaccine (16).
This study adds to a growing body of literature quantifying the use of Twitter to communicate health information (17–20), with a focus on health professionals and parents. The purpose of this study was to characterize and quantify 3 types of Twitter messages related to the HPV vaccine: 1) tweets sent by health professionals, 2) tweets intended for a parent audience, and 3) tweets sent by health professionals and intended for a parent audience.
We used data mining software to access the Twitter Search API to collect prospective data (21). We defined our inclusion criteria as tweets that contained any of our 5 search terms related to the HPV vaccine (“HPV,” “HPV vaccine,” “HPV shot,” “Gardasil,” and “Cervarix”) as well as the 5 corresponding hashtags. Our final data set contained 193,379 English-only tweets collected from August 1, 2014, through July 31, 2015, and included both original tweets and retweets; that is, whether the tweet was original or not. If a user’s tweet contained any of our key words, it was included in the final sample. We developed a codebook to analyze the content of the tweet text for HPV vaccine sentiment and characteristics and coded a subsample of tweets by hand (n = 1,470). We used the coded tweets to build classifiers using supervised machine-learning to classify our entire sample. Classifiers used in this study, along with the corresponding accuracy as measured by the area under the receiver operating characteristic curve (AUC), included the following: type of user (AUC = 0.75), target audience (AUC = 0.95), vaccine sentiment (AUC = 0.92), content (AUC = 0.72), side effects (AUC = 0.74), prevention/protection (AUC = 0.77), risk/prevalence (AUC = 0.88), men/boys (AUC = 0.92), and women/girls (AUC = 0.92). Our full methods and classification process are described elsewhere (22).
We operationalized our 3 subsample tweet types using the following study variables: 1) type of user = health professional; 2) target audience = parent; and 3) type of user = health professional AND target audience = parent (consisting of an overlap of the first 2 categories). For each type of tweet, we identified the period with the highest volume of tweets (or “spikes”) during our study. To examine activity surrounding these spikes, we considered 3 days before and after each spike, totaling a 7-day period.
For each spike we classified the content of the tweets, including type of tweet, tweet sentiment, tweet content, and vaccine characteristics (Box 1). The purpose of these analyses was to ascertain the nature of HPV messaging during periods with the highest volume of posts. We also quantified the potential reach of the tweets, on the basis of the average and median number of followers and engagement features for each tweet (ie, hashtags and mentions), because research has used these features as a measure of influence on social media (23,24). For a sample of tweets (approximately 10% of each spike), we examined links to websites that were included in the tweets by opening the link in a web browser. Finally, because a large number of tweets sent by health professionals were associated with a recently published article, we also examined a sample of web links from the second and third largest spikes for this group. We examined additional spikes only for health professionals to confirm preliminary findings. To measure significant differences across spikes, we used χ2 tests for categorical variables, analysis of variance for continuous variables, and the Kruskal–Wallis nonparametric test for medians. The study protocol was deemed exempt, and all procedures were approved by the Drexel University Institutional Review Board.
|Type of tweet|
|Health professional user: tweets posted by health professionals|
|Parent audience: tweets posted with content for parents, messages intended to reach parents|
|Health professional to parent: tweets posted by health professionals for a parent audience|
|Resource/information: objective information about the HPV vaccine with supporting source|
|Personal experience/opinion: story or opinion about HPV, no factual sources|
|Joke or parody: humorous/satirical statement about HPV|
|Other: tweet does not satisfy the above categories|
|Side effects: mention of side effects caused by the HPV vaccine|
|Prevention/protection: describes how HPV vaccine will protect or prevent negative health outcomes|
|Risk/prevalence of HPV: details risk of contracting HPV or the prevalence of HPV|
|Men/boys: tweet refers to men or boys along with HPV|
|Women/girls: refers to women or girls along with HPV|
|Positive: supportive messages about the HPV vaccine and encourages its uptake|
|Negative: disparaging messages about the HPV vaccine and/or discourages it uptake|
|Neutral: no opinions about vaccine, facts repeated|
|No mention: HPV vaccine is not mentioned|
Among tweets sent by health professionals (n = 20,451), the largest number of tweets were sent on April 13, 2015 (n = 381) (Figure). Among tweets intended for a parent audience (n = 16,867), the largest number of tweets were sent on February 4, 2015 (n = 494). Finally, among tweets sent by health professionals and intended for a parent audience (n = 1,233), the greatest number of tweets occurred on January 22, 2015 (n = 39).
Number of tweets, by group subsample over time, indicating the day with the most tweets for each group, study of twitter messages related to the human papillomavirus vaccine, August 2014-July 2015. [A tabular description of this figure is also available.]
|Date Created||Type of Tweet, No.|
|Health Professional User||Health Professional to Parent||Parent Audience|
In both spikes in which tweets were intended for a parent audience, almost all tweets were retweets (97.1% for parent audience and 89.9% for health professional to parent audience), compared with the health professional spike where approximately half of the tweets were retweets (50.1%) (Table).
The use of twitter engagement features, including links, mentions (@), and hashtags (#), also differed across the 3 spikes. In the health professional spike, most tweets included one link (66.3%), whereas most tweets in the other spikes did not include a link. Nearly all tweets in both parent audience spikes included at least one mention (97.7% for parent audience and 92.1% for health professional to parent audience). Among the 3 spikes, the health professional spike had the highest percentage of tweets that did not include a hashtag (57.1%) (Table).
The largest number of tweets sent by health professionals was from April 10 to April 16, 2015 (n = 851), and 66.6% of these tweets were classified as positive. In addition, 65.1% discussed resources or information, and 61.8% of tweets talked about men or boys. After examining a 10% sample of tweets from the spike, we found that many of the web links provided in the tweets referenced a study published in Cancer that conducted a cost-effectiveness analysis of HPV vaccination for boys (25).
Many of the tweets in the 2 additional spikes also focused on recently published studies on HPV vaccine research. The content of the second largest health professional spike, in June 2015, focused on an article published in Lancet Oncology that examined the efficacy of fewer doses of the HPV vaccine (26). Similarly, the content of the third largest health professional spike, in May 2015, was associated with an article published in BMJ that examined direct and indirect benefits to males when only girls are immunized (27).
Among tweets intended for a parent audience, the greatest number of tweets were sent from February 1 to February 7, 2015 (n = 1,043), and the greatest sentiment expressed in the parent audience spike was positive (47.1%). Nearly 60% of tweets in this spike discussed personal experiences or expressed opinions, followed by 35.0% of tweets discussing resources and information. The vaccine characteristics discussed in these tweets focused on risk and prevalence (17.5%), side effects (17.0%), and women or girls (13.2%). After further reviewing tweet content in this spike, we determined that many of the tweets intended for parent audiences corresponded with World Cancer Day, an annual awareness day taking place on February 4.
The largest spike in tweets from health professionals to a parent audience occurred from January 19, 2015, to January 25, 2015 (n = 89). Approximately 50% of tweets did not mention the HPV vaccine, followed by 36% of tweets having a positive sentiment toward the vaccine. The overall content of this spike was split nearly evenly between personal experiences/opinions (52%), and resources/information (46%). Examination of tweets in this spike indicated that many of the tweets were associated with a specific Twitter chat event focused on the hashtags #hpv and #teenhealth. The event took place during cervical cancer awareness month, occurring annually during January. Box 2 provides sample tweets from each of the spikes.
|Health professional user spike|
|RT @globeandmail: Vaccinating boys against HPV could cut health-care costs, study suggests http://t.co/kHKeVRSr7o|
|RT @CBCNews: HPV vaccination for boys needs more awareness: oncologist & MP http://t.co/GortY8bIML http://t.co/vmB50Tb3ql|
|@FSSWorldIssues HPV Vaccination for boys can be a money saver! http://t.co/Uivs5r9ERa|
|Parent audience spike|
|RT @CDCSTD: #Parents: You don’t open the door to #sex w/ #HPV #vaccine. You close the door to #cancer! http://t.co/a4iDQqmwpA|
|@TheSocialCTV I trust the ones we got as a kid. Tried & true ones. However HPV seems like a corporate sponsored vaccine that I don’t trust.|
|RT @VaxCalc: HPV (Gardasil) and Hep-B are lifestyle vaccines; do infants and children really need these? #parenting|
|Health professional to parent audience spike|
|RT @jhforg: RT @iTwixie: Thank you, @JHForg for sponsoring this important #TeenHealth chat! #HPV|
|@iTwixie thank you and @wgfpa @DrMaryxxxxx @igpxxxxx and all of our other participants! it was great to talk about #hpv and #teenhealth|
|RT @nycHealthy: For #CervicalCancer Awareness Month, ask your child’s doctor about the HPV vaccine. #VaccinateHPV http://t.co/Uu6dCARNQ3|
When comparing the spike subsamples with the full sample of tweets, we found differences in many of the tweet characteristics (Box 2). The number of original tweets and retweets differed significantly between the full sample and spike subsamples (P < .001), as did the use of Twitter engagement features, including links, mentions, and hashtags (P < .001). In general, positive sentiment was more prevalent in the health professional spike (66.6%) and parent audience spike (47.1%) compared with the full sample (39.0%, P < .001). The percentage of tweets that included resources or information was higher in the health professional spike (65.1%) compared with the full sample (50.9%, P < .001), and a higher percentage of tweets in the parent audience spike included personal experiences or opinion (59.9%) compared with our full sample (47.1%, P < .001). One of the largest differences between the health professional spike and the full sample of tweets was the percentage of tweets that focused on men/boys (61.8% vs 9.8%, respectively, P < .001). Prevention/protection was also a vaccine characteristic that was more prevalent in the health professional spike (35.5%) compared with all tweets (18.9%, P < .001). Conversely, side effects were mentioned more frequently in our all tweet sample (22.2%) compared with each of the spikes, including the health professional spike (10.7%, P < .001).
Findings from our study suggest different drivers of spikes in Twitter communication for tweets sent by health professionals and for tweets intended for parents. Health professional Twitter activity spiked around the communication of scientific findings, namely disseminating and discussing new scientific evidence. Conversely, parents’ tweets centered most often on awareness campaigns and national awareness events.
Our findings also show the importance of retweets in creating spikes and generating tweet volume. In 2 of the 3 spike periods, nearly all of the tweets were retweets, a much higher percentage than in the full sample of tweets. These data suggest that behaviors during awareness days and national campaigns may differ from general use behaviors, and capitalizing on the “retweet” phenomenon during these spike events is worth further exploration and could lead to a heightened level of interest and engagement in the topic area (16).
For health professionals on Twitter, the dissemination of new scientific evidence was a key driver of Twitter activity. Furthermore, we found that many of the links in the tweets were links to news stories in the popular media that covered the publication, rather than the original publication. The use of links to news stories may be due to the ease of linking a popular news source to Twitter messages (eg, by clicking a “share on Twitter” button), as opposed to creating and embedding a URL in the tweet for the peer-reviewed publication. In addition, many peer-reviewed articles are only accessible if a subscription is paid, limiting the public’s access. Another benefit of linking to a popular news source may be that the reporting is more relevant to a lay audience. Future studies may consider the impact of disseminating a popular news source that reports on a new study versus the original peer-reviewed article of the study. This consideration is particularly relevant in an era marked by the proliferation of online fake news.
Tweets in the health professional spike also included far fewer hashtags than the other 2 spikes, which could lead to less exposure or engagement with a wider audience. One way users are exposed to tweets is that a user must follow another user to see their tweets. This way, if a health professional tweets about HPV vaccine, all of their followers would be exposed to the tweet content. However, additional avenues for exposure and engagement exist, including users searching for key words on Twitter or clicking on a hashtag that is a topic of interest. This avenue leads to indirect exposure, as a user would read a tweet about HPV vaccine from a user they do not follow. This indirect exposure strategy, which uses different engagement features on Twitter, is important for health professionals and others to use, because it may decrease the likelihood of creating “echo chambers,” whereby health professionals may be tweeting only to other health professionals (ie, their followers). Furthermore, it is difficult to knowingly target parents by directly messaging or tweeting to them; however, it is more feasible and realistic to indirectly target parents by creating tweets that parents are more likely to “stumble” across on the basis of searches, key words, or hashtags, or by retweeting parent-focused tweets.
Tweets meant to reach and communicate to parents appeared to be most prominent around awareness days and months, such as National Cancer Awareness Day and Cervical Cancer Awareness Month, and were almost entirely retweets. Leveraging national awareness days to potentially reach the greatest number of followers may be a strategy for health organizations. Furthermore, the potential for a tweet to be a retweet of another organization was much higher during this spike, suggesting the importance of crafting messages that fully use the engagement features of Twitter during this period; many of the retweeted tweets in our sample, from prominent health organizations, did not include links or hashtags.
Although the overall volume of tweets sent by health professionals that were intended for parents was low, the highest number of these tweets also spiked around awareness days and hosted chat events. For example, in January, during Cervical Cancer Awareness Month, a hosted Twitter chat focused on improving girls’ health. Twitter chats have been used by organizations to mobilize a Twitter community to discuss and communicate about a particular topic. This strategy may be effective in connecting health professionals and parents around an important health topic, such as the HPV vaccine, using social media as a platform for communication. This strategy is underused. In our sample, many of the tweets in this spike did not explicitly mention the HPV vaccine, which may have been due to the fact that much of the spike was driven by a hosted chat event that focused on cervical cancer awareness, and the HPV vaccine was mentioned but not discussed during the chat.
Our study has limitations. First, we did not examine tweets sent by parents but rather tweets intended for parents. We framed our analysis this way to focus on a key driver of vaccine uptake: a health professional’s recommendation. Research has documented the strength of this effect on vaccine uptake, and we sought to examine whether this communication behavior was present on Twitter. Although our findings highlighted the positive sentiment of health professionals, most of the communication centered on disseminating new scientific evidence and was not necessarily directed toward a parent audience.
Second, our models for classifying user type, intended audience, and tweet characteristics could have misclassified the variable categories. We developed the classifiers by using an iterative process and checked a subsample of classified tweets; however, because the accuracy of each classifier was not 1.0, some subsets may have been misclassified. To help validate our classification models and study findings, we compared our findings in our full sample of tweets with those of 2 recent studies that used a similar methodology and analytic approach (19,20). We found that the distribution of tweet sentiment was similar across all studies. Of 83,551 and 110,778 tweets and retweets classified in the other studies, 25.1% and 32.0% of the respective samples were coded as negative sentiment (compared with 25.3% of our sample).
Third, although our study examined spikes in communication, we did not examine the nonspike patterns, which tend to be more continuous and durable. We did compare spike characteristics of the subsamples with the spike characteristics of the full sample of tweets; still, future work may consider examining nonspike periods. Our focus on spikes, or increased activity, was informed by studies highlighting the predictive nature of an increase in online communication with offline behaviors, representing an important and specific phenomenon (16).
Disseminating and communicating information on new scientific evidence that supports the HPV vaccine is important to strengthen uptake, and an opportunity exists to better synchronize dissemination of scientific evidence with national awareness days to maximize potential reach and impact. Syncing communication messages with seasonal events is something that the American Academy of Pediatrics has already championed, by producing a toolkit for HPV vaccination messages on Twitter (28). To continue developing strategic communication messages, health professionals may also consider personalizing the scientific evidence by making a clear recommendation to parents or by describing personal experiences or providing opinions that are supported by the new evidence. This strategy is supported by findings that show that the most persuasive messages from physicians to parents are straightforward and strong, such as “your child could get cancer as an adult, but you can stop that right now” (29), as well as messages that take an “announcement” approach that may normalize the vaccine, as compared with a “conversation” approach that may be less effective in mitigating hesitancy (30).
Finally, most research to date has documented the importance of a physician’s recommendation in the context of a clinical encounter, that is, a face-to-face interaction. Although this evidence has been used to inform and tailor the clinical encounter, a gap remains in understanding how a physician’s recommendation contributes to vaccine uptake in a virtual space, particularly in the social media environment. This understanding is important for the Millennial generation that has already begun to transition into parenthood. Norms in health care and health provider interactions will likely shift, and lines between face-to-face and online/virtual interaction will continue to blur. As parents and adolescents continue to use online resources and social media to look for and communicate about health information, health professionals and health organizations have an opportunity to better connect with these audiences by leveraging existing consumer behaviors. By doing so, there is the potential to disseminate important information and evidence in a more strategic way, maximizing reach and impact, with the ultimate goal being higher rates of vaccination.
This study was supported by grant no. IRG 14-251-07-IRG to the Sidney Kimmel Cancer Center at Thomas Jefferson University from the American Cancer Society.
Corresponding Author: Philip M. Massey, PhD, MPH, Department of Community Health and Prevention, Drexel Dornsife School of Public Health, 3215 Market St, Nesbitt Hall, Philadelphia, PA 19104. Telephone: 267-359-6067. Email: email@example.com.
Author Affiliations: 1Department of Community Health and Prevention, Dornsife School of Public Health, Drexel University, Philadelphia, Pennsylvania. 2Division of Population Science, Department of Medical Oncology, Thomas Jefferson University, Philadelphia, Pennsylvania. 3Association of American Medical Colleges, Washington, DC. 4Microsoft Research Israel, Herzeliya, Israel.
- Genital HPV infection — fact sheet, STD fact sheet. Atlanta (GA): Centers for Disease Control and Prevention, Division of STD Prevention, National Center for HIV/AIDS, Viral Hepatitis, STD, and TB Prevention; 2017.
- Markowitz LE, Dunne EFM, Saraiya M, Chesson HW, Curtis CR, Gee J, et al. ; Centers for Disease Control and Prevention (CDC). Human papillomavirus vaccination: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Recomm Rep 2014;63(RR-05):1–30. PubMedexternal icon
- Meites E, Kempe A, Markowitz LE. Use of a 2-dose schedule for human papillomavirus vaccination — updated recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR Morb Mortal Wkly Rep 2016;65(49):1405–8. CrossRefexternal icon PubMedexternal icon
- HPV vaccine, adolescents, 2008–2012. Healthy People 2020; 2014. https://www.healthypeople.gov/2020/topics-objectives/national-snapshot/hpv-vaccine-adolescents-2008–2012. Accessed January 15, 2017.
- Holman DM, Benard V, Roland KB, Watson M, Liddon N, Stokley S. Barriers to human papillomavirus vaccination among US adolescents: a systematic review of the literature. JAMA Pediatr 2014;168(1):76–82. CrossRefexternal icon PubMedexternal icon
- Gargano LM, Herbert NL, Painter JE, Sales JM, Morfaw C, Rask K, et al. Impact of a physician recommendation and parental immunization attitudes on receipt or intention to receive adolescent vaccines. Hum Vaccin Immunother 2013;9(12):2627–33. CrossRefexternal icon PubMedexternal icon
- Rahman M, Laz TH, McGrath CJ, Berenson AB. Provider recommendation mediates the relationship between parental human papillomavirus (HPV) vaccine awareness and HPV vaccine initiation and completion among 13- to 17-year-old U.S. adolescent children. Clin Pediatr (Phila) 2015;54(4):371–5. CrossRefexternal icon PubMedexternal icon
- Allison MA, Hurley LP, Markowitz L, Crane LA, Brtnikova M, Beaty BL, et al. Primary care physicians’ perspectives about HPV vaccine. Pediatrics 2016;137(2):. CrossRefexternal icon PubMedexternal icon
- Reis S, Visser A, Frankel R. Health information and communication technology in healthcare communication: the good, the bad, and the transformative. Patient Educ Couns 2013;93(3):359–62. CrossRefexternal icon PubMedexternal icon
- Beaunoyer E, Arsenault M, Lomanowska A, Guitton M. Understanding online health information: evaluation, tools, and strategies. Patient Educ Couns 2017;10(2):1–7. PubMedexternal icon
- Antheunis ML, Tates K, Nieboer TE. Patients’ and health professionals’ use of social media in health care: motives, barriers and expectations. Patient Educ Couns 2013;92(3):426–31. CrossRefexternal icon PubMedexternal icon
- Wilson K, Keelan J. Social media and the empowering of opponents of medical technologies: the case of anti-vaccinationism. J Med Internet Res 2013;15(5):. CrossRefexternal icon PubMedexternal icon
- Kata A. Anti-vaccine activists, Web 2.0, and the postmodern paradigm—an overview of tactics and tropes used online by the anti-vaccination movement. Vaccine 2012;30(25):3778–89. CrossRefexternal icon PubMedexternal icon
- Communication and dissemination strategies to facilitate the use of health and health care evidence. Agency for Healthcare Research and Quality; 2012. https://effectivehealthcare.ahrq.gov/ehc/products/433/1208/CommunicationDissemination_ResearchProtocol_20120731.pdf. Accessed May 31, 2017.
- Stubbe D. Communication commentary: communicating with the internet generation: challenges and opportunities. Focus 2012;10(3):323–6. CrossRefexternal icon
- How blogs and social media agendas relate and differ from the traditional press. Pew Research Center, Journalism and Media Staff; May 23, 2010. http://www.journalism.org/2010/05/23/new-media-old-media/. Accessed May 31, 2017.
- Surian D, Nguyen DQ, Kennedy G, Johnson M, Coiera E, Dunn AG. Characterizing Twitter discussions about HPV vaccines using topic modeling and community detection. J Med Internet Res 2016;18(8):. CrossRefexternal icon PubMedexternal icon
- Keim-Malpass J, Mitchell EM, Sun E, Kennedy C. Using Twitter to understand public perceptions regarding the #HPV vaccine: opportunities for public health nurses to engage in social marketing. Public Health Nurs 2017;34(4):316–23. CrossRefexternal icon PubMedexternal icon
- Dunn AG, Leask J, Zhou X, Mandl KD, Coiera E. Associations between exposure to and expression of negative opinions about human papillomavirus vaccines on social media: an observational study. J Med Internet Res 2015;17(6):. CrossRefexternal icon PubMedexternal icon
- Du J, Xu J, Song HY, Tao C. Leveraging machine learning-based approaches to assess human papillomavirus vaccination sentiment trends with Twitter data. BMC Med Inform Decis Mak 2017;17(Suppl 2):69. CrossRefexternal icon PubMedexternal icon
- Black A, Mascaro C, Gallagher M. Twitter zombie: architecture for capturing, socially transforming and analyzing the Twittersphere. Conference paper. Proceedings of the 2012 ACM Group; 2012. https://www.researchgate.net/publication/237009064_Twitter_Zombie_Architecture_for_Capturing_Socially_Transforming_and_Analyzing_the_Twittersphere. Accessed January 7, 2018.
- Massey PM, Leader A, Yom-Tov E, Budenz A, Fisher K, Klassen AC. Applying multiple data collection tools to quantify human papillomavirus vaccine communication on Twitter. J Med Internet Res 2016;18(12):. CrossRefexternal icon PubMedexternal icon
- Cha M, Haddadi H, Benevenuto F, Gummadi P. Measuring user influence in Twitter: the million follower fallacy. ICWSM 2010;10:30.
- Bae Y, Lee H. Sentiment analysis of Twitter audiences: measuring the positive or negative influence of popular Twitterers. J Am Soc Inf Sci Technol 2012;63(12):2521–35. CrossRefexternal icon
- Graham DM, Isaranuwatchai W, Habbous S, de Oliveira C, Liu G, Siu LL, et al. A cost-effectiveness analysis of human papillomavirus vaccination of boys for the prevention of oropharyngeal cancer. Cancer 2015;121(11):1785–92. CrossRefexternal icon PubMedexternal icon
- Kreimer AR, Struyf F, Del Rosario-Raymundo MR, Hildesheim A, Skinner SR, Wacholder S, et al. . Efficacy of fewer than three doses of an HPV-16/18 AS04-adjuvanted vaccine: combined analysis of data from the Costa Rica Vaccine and PATRICIA Trials. Lancet Oncol 2015;16(7):775–86. CrossRefexternal icon PubMedexternal icon
- Bogaards JA, Wallinga J, Brakenhoff RH, Meijer CJ, Berkhof J. Direct benefit of vaccinating boys along with girls against oncogenic human papillomavirus: bayesian evidence synthesis. BMJ 2015;350:h2016. CrossRefexternal icon PubMedexternal icon
- American Academy of Pediatrics. Tweets for healthcare professionals. HPV vaccine is cancer prevention: resources for HPV champions; April 2015. https://www.aap.org/en-us/Documents/hpvtoolkit_professionalTweets_hpv_2015_August.pdf. Accessed May 31, 2017.
- Malo TL, Gilkey MB, Hall ME, Shah PD, Brewer NT. Messages to motivate human papillomavirus vaccination: national studies of parents and physicians. Cancer Epidemiol Biomarkers Prev 2016;25(10):1383–91. CrossRefexternal icon PubMedexternal icon
- Brewer NT, Hall ME, Malo TL, Gilkey MB, Quinn B, Lathren C. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics 2017;139(1):. CrossRefexternal icon PubMedexternal icon
Table. Tweet Characteristics, by Spike, Compared With Full Sample of Tweets, Study of Twitter Messages Related to the Human Papillomavirus Vaccine, August 2014–July 2015a
|Characteristic||Type of Tweet||Full Sample of Tweets, August 2014–July 2015 (n = 193,379)|
|Health Professional User (n = 851)||Parent Audience (n = 1,043)||Health Professional to Parent Audience (n = 89)|
|Spike range, dates||4/10/15–4/16/15||2/1/15–2/7/15||1/19–1/25/15||—|
|Day with most tweets||Monday 4/13/15||Wednesday 2/4/15||Thursday 1/22/15||Wednesday 4/29/15|
|No. of followers per tweet|
|Original/retweet, no (%)b|
|Tweet is original||425 (49.9)||30 (2.9)||9 (10.1)||108,974 (56.4)|
|Tweet is a retweet||426 (50.1)||1,013 (97.1)||80 (89.9)||84,405 (43.6)|
|Links (URL) per Tweet, no (%)b|
|0||152 (17.9)||1,035 (99.2)||73 (82.0)||55,320 (28.6)|
|1||564 (66.3)||7 (0.7)||10 (11.2)||116,701 (60.4)|
|≥2||135 (15.9)||1 (0.1)||6 (6.7)||21,358 (11.0)|
|Mentions (@) per Tweet, no (%)b|
|0||346 (40.7)||23 (2.2)||7 (7.9)||81,330 (42.1)|
|1||385 (45.2)||711 (68.2)||48 (53.9)||79,653 (41.2)|
|2 or more||120 (14.1)||309 (29.6)||34 (38.2)||32,396 (16.7)|
|Hashtags (#) per Tweet, no (%)b|
|0||486 (57.1)||429 (41.1)||14 (15.7)||106,413 (55.0)|
|1||194 (22.8)||375 (36.0)||29 (32.6)||36,892 (19.1)|
|≥2||171 (20.1)||239 (22.9)||46 (51.7)||50,074 (25.9)|
|Spike sentiment, no (%)b|
|Positive||567 (66.6)||491 (47.1)||32 (36.0)||75,393 (39.0)|
|Negative||99 (11.6)||199 (19.1)||4 (4.5)||48,940 (25.3)|
|Neutral||102 (12.0)||133 (12.8)||8 (9.0)||25,110 (13.0)|
|No mention of vaccine||83 (9.8)||220 (21.1)||45 (50.6)||43,936 (22.7)|
|Spike content, no (%)b|
|Resource/information||554 (65.1)||365 (35.0)||41 (46.1)||98,484 (50.9)|
|Personal experience/opinion||290 (34.1)||625 (59.9)||46 (51.7)||91,042 (47.1)|
|Joke or parody||3 (0.4)||53 (5.1)||2 (2.2)||3,428 (17.7)|
|Other||4 (0.5)||0||0||425 (0.2)|
|Spike vaccine characteristics, no (%)c|
|Side effectsb||91 (10.7)||177 (17.0)||11 (12.4)||42,989 (22.2)|
|Prevention/protectionb||302 (35.5)||125 (12.0)||5 (5.6)||36,591 (18.9)|
|Risk/prevalenceb||88 (10.3)||183 (17.5)||14 (15.7)||21,529 (11.1)|
|Men/boysb||526 (61.8)||94 (9.0)||16 (18.0)||18,971 (9.8)|
|Women/girlsd||83 (9.8)||138 (13.2)||8 (9.0)||21,407 (11.1)|
The opinions expressed by authors contributing to this journal do not necessarily reflect the opinions of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors’ affiliated institutions.