Artigos

Conteúdo (article):

Information about benzodiazepines: what does the internet offer us?

Thales Brandi Ramos
Mestrado em Administração e Gestão da Assistência Farmacêutica, Faculdade de Farmácia, Universidade Federal Fluminense
Email: thalesbrandi980@gmail.com
ORCID: 0000-0002-1442-1020

Luciana Castilho Bokehi
Residência em Farmácia Hospitalar, Faculdade de Farmácia, Universidade Federal Fluminense
Email: luciana_b@globo.com
ORCID: 0000-0003-1870-8202

Erika Barreto de Oliveira
Residência em Farmácia Hospitalar, Faculdade de Farmácia, Universidade Federal Fluminense
Email: erikabarreto@id.uff.br
ORCID: 0000-0003-2341-8752

Marcel da Silva Amorim Gomes
Residência em Farmácia Hospitalar, Faculdade de Farmácia, Universidade Federal Fluminense
Email: marcel_amorim1@hotmail.com
ORCID: 0000-0003-2281-8973

José Raphael Bokehi
Instituto de Computação, Universidade Federal Fluminense
Email: jraphael@ic.uff.br
ORCID: 0000-0003-2141-6948

Selma Rodrigues de Castilho
Mestrado em Administração e Gestão da Assistência Farmacêutica, Faculdade de Farmácia, Universidade Federal Fluminense
Email: selmarc@id.uff.br
ORCID: 0000-0003-0272-4777

Resumo
Este trabalho analisou a qualidade da informação veiculada na internet sobre 4 benzodiazepínicos amplamente utilizados no Brasil: alprazolam, bromazepam, clonazepam e diazepam. Essa escolha se justifica pelo fato desses medicamentos serem amplamente utilizados, poderem gerar dependência química e a internet ser importante fonte de informação sobre eles. Foram analisados 20 sites para cada medicamento. Mais da metade (56,3%) dos sites foram classificados como deficientes ou muito deficientes. Os problemas mais freqüentes foram a ausência da descrição do responsável pelo sítio (60%), informação incompleta (62,5%), ausência de contato para informação adicional (45%) e da última data da atualização (82%). Os resultados reforçam a preocupação com a qualidade da informação em saúde veiculada na internet, já apontada pela literatura, e a necessidade de adoção de critérios mínimos de qualidade para esta informação.
Palavras-chave: internet, medicamento, informação


Abstract
This study analysed the quality of information published on the internet regarding 4 benzodiazepines that are widely used in Brazil: alprazolam, bromazepam, clonazepam and diazepam. This choice is justified by the fact that these drugs are widely used and can generate chemical dependency, and the internet is an important source of information about them. We analysed 20 sites for each drug. More than half (56.3%) of the sites were classified as deficient or very deficient. The most frequent problems with the sites were the absence of a description of the person responsible for the site (60%), incomplete information (62.5%), the absence of a contact for additional information (45%) and the absence of the last date the site was updated (82%). These results reinforce concerns regarding the quality of the health information published on the internet, which has already been noted in the literature, and the need to adopt minimum quality criteria for this information.
Keywords: internet, drug information

Introduction
The advent of the Internet has revolutionized both the access to information1-4 and health relations5-7. Internet access has increased significantly, reaching just over four billion users in 2018, accounting for 55.1% of the world\'s population8. In Brazil, continuous National Household Sample Survey (PNAD) data from 2016 showed that there was internet use in 48.1 million households visited, which represented 69.3% of households9.
The health-related information is becoming increasingly available on the websites and pages of public and private institutions. Easy access to information assists in the day-to-day life of both health professionals and users, directly influencing the doctor-patient relationship1,5,6. In Brazil, the Internet has already reached the 75 million users mark, taking the country to fifth place in the search for health information on the Internet1.
Silvestre et al.6 interviewed patients in the 18-60 age group in a waiting room for outpatient care in the city of Tubarão, Santa Catarina, and observed that 50% of the interviewees using the Internet to access health information were individuals between the ages of 31-45 and were women.
Moretti et al.10 interviewed 1,828 individuals and observed that the internet has been a source of health information with great relevance to the population, predominantly being used by women seeking information for their own health (92%). For most of these women (86%), the internet is one of their main sources of health information. The authors report that 69% of respondents acknowledge the impact of the internet on their relationship with physicians and that 16% and 10% of them asked the doctor to prescribe a specific drug or to change the prescribed drug, respectively, after an online consultation. Fifty-two percent of these people stated that doctors have met these requests.
Sinclair et al.11 interviewed 284 pregnant women and observed that 39% of them were using medication when they found themselves to be pregnant. Of these women, 79% used the internet to seek information about the safety of these drugs during pregnancy.
Pereira Neto et al.12 analysed the profile of online information consumption by young people from a popular community in a waiting room for medical consultation in a primary care clinic linked to the Unified Health System and observed that although these young people searched for information on the network, they continued to use the doctor as their main source of information.
However, the quality of health information on the Internet is still a challenge worldwide3,13,14. Often, health information on the Internet is inaccurate, incomplete, or incomprehensible to readers, posing risks to users15. Several studies have addressed the evaluation and qualification of websites on the internet 1,2,14,16-18. An instrument that is widely used in evaluating the quality of health pages is proposed by the Health On the Net (HON) Foundation, a Swiss nongovernmental organization. The HON Foundation grants a certificate of quality to pages that comply with its code of conduct, which has seven basic principles: authorship, complementarity, confidentiality, attributions, justifications, transparency and publicity honesty19.
In Brazil, several authors have proposed the development and use of mechanisms to evaluate the quality of information on health pages 2,15,20,21. The Sanitary Surveillance Center (CVS) of the state of São Paulo has translated and adapted a document from the World Health Organization (WHO), entitled the Guide to Finding Safe Information, with the objective of providing users with criteria for evaluating site content, such as the name and contact information of the person responsible, publication dates, identification of funders and the objectives of page,1,22. The Regional Council of Medicine of the State of São Paulo also published a manual with ethical principles for medical and health websites23.
An alternative evaluation model was created by Pereira Neto et al.21, with a proposal of three dimensions for evaluation: content, usability and readability, subdivided into indicators to which weights are assigned. These added values allow one to create a page ranking, making it possible to identify weaknesses and strengths of each site, in addition to pointing out how accurate the information on the proposed theme is.
Benzodiazepines are among the most prescribed drugs in the world. According to data from the National Controlled Products Management System, of the five active substances with greatest consumption in Brazil between 2007 and 2010, three are benzodiazepines24. Two drugs in this class are included in the list of the 100 most marketed drugs in 2017 in the country25. Several authors point to the high prevalence of these drugs in the Brazilian population26-29, even without a medical prescription30.
In this scenario, the objective of this article is to study the quality of information on the internet regarding the 4 benzodiazepines that are the most widely used in Brazil: alprazolam, bromazepam, clonazepam and diazepam. This choice is justified by the fact that these drugs can generate chemical dependence, and the internet is an important source of information about them.
Methods
The identification of the sites occurred through a search on Google, the main search engine in use in Brazil, using the common Brazilian denomination (DCB) of medicines as a keyword. We used the DCB of each drug because it allows the recovery of both the sites that treat the product by the trade name and those that exclusively refer to benzodiazepines with this name. For each drug, the first 20 sites recovered were selected. The exclusion criteria were official sites of public agencies or sales sites that did not provide information about the product. Official sites from public agencies were excluded because, in principle, they are not directly influenced by commercial interests or groups of users and are usually developed by trained professionals.
The choice of evaluation criteria (Table 1) was based on the work of Pereira Neto et al.21 in terms of content and design. Regarding the content, the accuracy and comprehensiveness of the information, the name and other data of the owner / the party responsible for the site information, as well as their references and the date of the last update, were considered. To assess the accuracy, which involves the degree of agreement between the information available and the available scientific evidence3, the content of the site was compared to the technical data available in the bulletin of the National Sanitary Surveillance Agency 31. The ANVISA bulletin was taken as a parameter, once it was approved by the Brazilian regulatory agency, due to its official character. The same text was used to analyse the comprehensiveness of the information, defined by Pereira Neto et al.3,21, such as the degree of the coverage of the information. The information specified, in addition to the indications, the contraindications of the product, the indication of the need for professional follow-up regarding the use of the product in the body of the site information, and the DCB for the medicine. To evaluate the existence of financial interests, both where the product could be purchased and expressions of suggested use or that offered information such as dose were considered. In terms of the design, the existence of distractions, such as animations, advertisements and the presence of images, for example, was considered, as well as the language used.
Table 1
Each site was independently evaluated by two team members. If there was disagreement between the analyses of any indicator, a third individual performed the analysis, and the opinion of the majority prevailed.
Sites that scored higher than 80 were considered to have good quality information, those with scores less than 80 but greater than or equal to 50 were considered regular, those with scores less than 50 but greater than or equal to 30 were considered deficient, and those with scores lower than 30 were considered very deficient.
The data from the evaluation were stored in a spreadsheet from the Microsoft Excel 2010 software. For the analysis of the results, descriptive statistics tools were used with the aid of the same software.
In addition, the sites that had the HON Foundation seal of quality were evaluated. The clarity and adequacy of the site language was also analysed, and the use of technical terms that could make it difficult to understand the text and the type of language adopted (technical or lay) was taken as a parameter.
The Kruskal–Wallis test was used to evaluate the difference in scores obtained by different types of sites (blogs, sales sites and discussion sites) and between the different drugs.

Results
In total, 80 sites were analysed (twenty for each drug), and the majority were blogs (40%), sales sites / companies (27.5%), sites that had drug inserts (21.2%) and discussion sites (2.5%).
The sites analysed had a lower score and, therefore, more problems in relation to the presentation of the site manager (60%), incomplete information (62.5%), contact for additional information (45%) and date of update (82%). (Figure 1).
In general, the presence of user distraction elements, such as images and videos, was observed in advertisements on almost half of the sites (47.5%), especially on those related to the drugs bromazepam (65%) and alprazolam (50%). The suggestion of where to buy the product was observed on 31.2% of the sites, while contraindications were absent on 37.5% of them.
Figure 1
For clonazepam, 60% of the sites were deficient or very deficient (mean score = 47, fashion = 40), and for diazepam, 50% were considered good or regular and 50% deficient (mean score = 52, fashion = 40) (Table 2).
Information about where to have access to the drug was present on 40% of the clonazepam and diazepam sites and was present on only 25% and 20% of the alprazolam and bromazepam sites, respectively. The need for professional counselling for consumption was absent in 45% of clonazepam and bromazepam sites, which may influence consumption by self-indication. The absence of a contact for additional information was observed on 85% of the sites for clonazepam.
Table 2
All websites of sales companies exhibited the "banned internet sale" indicator, as determined by ANVISA.
More than half (56.3%) of the sites were classified as deficient or very deficient (Table 3). Only two sites (2.5%) had the HON seal at the time of analysis. One of these sites was considered to have the best score for both alprazolam and bromazepam but was classified as regular for bromazepam and clonazepam. The information provided in the second site, however, was considered deficient for all 4 medications.
Table 3
Comparing the scores obtained by the different medications showed no statistically significant differences at a significance level of 5% (p = 0.7168). There was also no statistically significant difference between the scores of the different site types for each drug: alprazolam (p = 0.9933), bromazepam (p = 0.8932), clonazepam (p = 0.8378) and diazepam (p = 0.6866). However, when considering the complete set of sites analysed, the difference between the scores obtained by the different site types was statistically significant (p = 0.00018), with sites with the package insert format having a better score. There was no statistically significant difference between the results of company websites and blogs (p = 1), and both were inferior to the package insert sites.
For sites that spoke about diazepam, the main source for additional contact was by telephone (50%), followed by question and answer mechanisms (37.5%) and e-mail (18.75%). For bromazepam, question and answer mechanisms was the predominant form of additional contact on 45% of sites, while the telephone represented 55% of the contact options. For clonazepam, on the 3 sites that presented additional contact information, the predominant mode was by telephone. For alprazolam, only 45% of the sites had an additional form of contact: 55% used question and answer, and 22.5% each used either telephone or email.
The use of lay language was observed on 55% of sites involving alprazolam and bromazepam, 45% of diazepam sites and 40% of clonazepam sites. The imbalance between indications of use and the presentation of contraindications and care was observed on 36.5% of all sites analysed.

Discussion
Of the 80 sites analysed, 56.3% were classified as deficient or very deficient. This result is in agreement with that found by Pereira Neto and collaborators21, who, when evaluating 8 NGO sites related to HIV / AIDS, observed that only one site presented content that was in accordance with what was expected from at least 50%. A similar result was observed by Neumark et al.14 when analysing 29 Hebrew sites about contraceptives based on HON codes. The average accuracy rating of the sites was 50.9%.
Paolucci et al. 15 evaluated the quality of information on tuberculosis on Brazilian sites and showed that no site obtained more than 65% compliance with the quality criteria adopted in the evaluation. Del Giglio et al. 32 evaluated the quality of information related to diabetes mellitus, systemic arterial hypertension and acute myocardial infarction, also on national sites, and observed that the information was often inadequate and insufficient.
Yoon et al. 18 analysed Korean sites on inflammatory bowel disease and concluded that the quality of the information was not ideal and varied significantly both in relation to the type of site but also in the search tool used. The authors also noted that the quality of the information was not related to the position in which the site appears in the search results.
The absence of responsible content (60%) and the date of update (82%) in most of the analysed sites directly affected the reliability of the site, as noted by Newmark and collaborators14, Mendonça and Pereira Neto2 and Molino et al. In addition, the lack of these features makes taking responsibility for the information provided unfeasible. These results are in agreement with other studies 15,34,35. In contrast, Hirata et al. 36 identified a description of the person responsible for 79.3% of the 4 Brazilian sites on coronary disease analysed.
The incomplete information observed on 62.5% of the sites is in agreement with the literature1,14,35,37,40,41 and compromises the possibility that the user can adequately analyse the safety and feasibility of using the product or the health problems treated by the site. The imbalance in information, also noted by several authors 1,35,40, highlighting the benefits and omitting the contraindications, is another aspect that may expose the user to risk by leading him or her to consume unnecessary or inappropriate products. This same strategy is observed in media pieces advertising drugs, such as in advertisements for drugs broadcast on radio stations38 and those arranged in pharmacies and drugstores39. A similar strategy was observed in scientific journal articles in a magazine that is highly circulated in Brazil13.
The concern with the quality of the information made available specifically on psychoactive drugs, such as benzodiazepines, in advertisements was also noted by Mastroianni et al40. The authors note that these pieces presented incomplete, summarized, inconsistent and different information from the studies cited in the scientific text, always favouring therapeutic indication, efficacy, safety and the cost of the products.
The internet will continue to grow as a health information provider, but the means by which this information reaches the patient should not compromise characteristics such as accuracy, credibility, quality and comprehensibility of information42. In this context, engaging those responsible for sites that provide health information with codes of conduct or quality standards is important43-45. Varady et al. 44 analysed sites containing information on osteoarthritis in several countries and found that HON-certified sites or those using the DISCERN instrument, which is used for consumers to assess the quality of written information about treatment choices, 46 obtained significantly higher scores than those without certification. A similar result has been indicated by other studies44-46.
In this sense, the low number of sites on benzodiazepines with HON certification (2.5%) is worrying. The percentage of sites with HON certification varied significantly between different studies 43,47-50, with 4% to 60% of certified sites being found. Equally relevant is the fact that, even on the sites with HON certification, problems of information quality were observed. This result is in agreement with Grohol et al.50. The statistically significant difference in the evaluation of the 80 sites analysed according to the type of site is in agreement with the results observed by other authors 18,50. Yoon et al. 18 observed superior quality in institutional sites. Support sites (maintained by support groups, users, etc.) had the lowest scores in terms of quality assessment50.

Conclusion

Despite the limited number of sites analysed, i.e., only sites in the Portuguese language that were retrieved by a single search tool, in addition to the use of the ANVISA bulletin as a parameter for comparing product information, which is the main limitation of this study, the results show the poor quality of information available on the internet regarding benzodiazepine medicines. In this way, these results reinforce the worldwide discussion on the need to regulate health-related content available on the Internet.
The low percentage of sites that have a quality label, such as HON certification, for example, shows the low level of concern the developers of these pages have for offering a reliable parameter of evaluating the content of the site for users. This lack of concern is reinforced by the lack of basic information such as identification of those responsible for the available content, the references used and the date of updating the content, which are all relevant to the reliability of the information provided.
In this way, the regulation of the information presented on these sites and the application of quality stamps in Brazil are crucial for the user to know what information can be trusted, thus avoiding the irrational use of medicines and the serious health problems that could result from the use of medicines due to a lack of or low quality information provided.

References
1. OLIVEIRA F, BERTOLLO-GOLLONI E M e PAVARINO EC. A Internet como fonte de Informação em Saúde. J Health Inform 2013; 5(3): 98-102.
2. MENDONÇA APB, PEREIRA NETO A. Critérios de avaliação da qualidade da informação em sites de saúde: uma proposta. RECIIS 2015; 9(1): 1-15.
3. PEREIRA NETO, FARIA A, PAOLUCCI R, DAUMAS RP, SOUZA RV. Avaliação participativa da qualidade da informação de saúde na internet: o caso de sites de dengue. Cien Saude Colet 2017; 22(6): 1955-1968.
4. BIGGS TC, JAYAKODY N, BEST K, KING EV. Quality of online otolaryngology health information. J Laryngol Otol 2018; 132(6): 560–563.
5. GARBIN HBR, PEREIRA NETO AF, GUILAM MCR. The internet, expert patients and medical practice: an analysis of the literature. Interface (Botucatu) 2008; 12(26): 579-88.
6. SILVESTRE JCC, ROCHA PAC, SILVESTRE BC, CABRAL RV, TREVISOL FS. Uso da internet pelos pacientes como fonte de informação em saúde e a sua influência na relação medico-paciente. Revista da AMRIGS 2012; 56(2):149-55.
7. GARBIN HBR, GUILAM MCR, PEREIRA NETO AF. Internet na promoção da saúde: um instrumento para o desenvolvimento de habilidades pessoais e sociais. Physis 2012; 22(1): 347–63.
8. INTERNET WORLD STATS [Internet]. Miniwatts Marketing Group. Population Statistics [about 1 screen] Available from: https://www.internetworldstats.com/stats.htm
9. Instituto Brasileiro de Geografia e Estatística (IBGE). PNAD Contínua TIC 2016: IBGE notícias. 2018. Available from: https://agenciadenoticias.ibge.gov.br/agencia-sala-de-imprensa/2013-agencia-de-noticias/releases/20073-pnad-continua-tic-2016-94-2-das-pessoas-que-utilizaram-a-internet-o-fizeram-para-trocar-mensagens
10. MORETTI FA, OLIVEIRA VE, SILVA EMK. Acesso a informações de saúde na internet: uma questão de saúde pública? Rev Assoc Med Bras 2012; 58(6):650-658.
11. SINCLAIR M, LAGAN BM, DOLK H, McCULLOUGH JEM. An assessment of pregnant women\'s knowledge and use of the Internet for medication safety information and purchase. J Adv Nurs Jan; 74(1):137-147. doi: 10.1111/jan.13387. Epub 2017 Sep 7.
12. PEREIRA NETO AF, BARBOSA L., MUCI S.Internet, geração Y e saúde: um estudo nas comunidades de Manguinhos (RJ) Comun. & Inf 2016; 19(1): 20-36.
13. VAZ P, PORTUGAL DB. A nova “boa-nova”: marketing de medicamentos e jornalismo científico nas páginas da revista brasileira Veja. Comun Mídia Consumo 2012; 9(26): 37-60.
14. NEUMARK Y, FLUM L, LOPEZ-QUINTERO C, SHTARKSHALL R. Quality of online health information about oral contraceptives from Hebrew-language websites. Isr J Health Policy Res 2012; Sep 24; 1(1):38. doi: [10.1186/2045-4015-1-38] Pubmed PMID: 23006798.
15. PAOLUCCI R; PEREIRA NETO A, LUZIA R. Avaliação da qualidade da informação em sites de tuberculose: análise de uma experiência participativa. Saúde debate, 2017, 41(spe), 84-100. https://dx.doi.org/10.1590/0103-11042017s08
16. EYSENBACH G, POWELL J, KUSS O, SA ER. Empirical studies assessing the quality of health information for consumers on the World Wide Web. A systematic review. JAMA 2002, 287(20): 2691-2700.
17. LOPES IL. Novos paradigmas para avaliação da qualidade da informação em saúde recuperada na Web. Ci Inf 2004; 33(1), 81-90. http://dx.doi.org/10.1590/S0100-19652004000100010.
18. Yoon JS, Lee SJ, Kim ES, Kim SK, Jung MK, Lee HS, Kwon YH, Nam SY, Jeon SW, Jin S, Lee JS, Yeo SJ. .Quality of information on the Internet for Korean patients with inflammatory bowel disease. Korean J Intern Med. 2018 Oct 1. doi: 10.3904/kjim.2018.019. PMID: 30257552.
19. HEALTH ON THE NET FOUNDATION (HON) [Internet]. Código de conduta para sites web em Medicina e Saúde (HONcode). Available from: .
20. SANTOS V, Portal MM, FERIGOLO M, DANTAS DCM, BARROS HMT, TRINDADE, CS. Sites sobre drogas de abuso: recursos para avaliação. Trab. educ. saúde 2010; 8(3): 575-585. https://dx.doi.org/10.1590/S1981-77462010000300015
21. PEREIRA NETO AF, SANTOS EM, CRUZ MM, TORRES RMC. Avaliação de sites de saúde em questão: a Aids nos sites brasileiros de Organizações Não Governamentais (ONG) de Lésbicas, Gays, Bissexuais, Travestis e Transexuais (LGBT). Rev Electron Comun Inf Inov Saude 2013; Mar 7(1) dói: http://dx.doi.org/10.3395/reciis.v7i1.451.
22. LOPES IL. Novos paradigmas para avaliação da qualidade da informação em saúde recuperada na Web. Ci. Inf. 2004 33 (1): 81-90.
23. CONSELHO REGIONAL DE MEDICINA DO ESTADO DE SÃO PAULO (CREMESP) [Internet]. Manual de princípios éticos para sites de medicina e saúde na Internet. Available from
24. BRASIL. Agência Nacional de Vigilância Sanitária. Boletim de Farmacoepidemiologia do SNGPC. 2011, 2(1), 14p.
25. BRASIL. Agência Nacional de Vigilância Sanitária. Anuário estatístico do mercado farmacêutico 2016. Brasília, 2017, 28 p.
26. FIRMINO KF, ABREU MHNG, PERINI E, MAGALHÃES SMS. Utilização de benzodiazepínicos no Serviço Municipal de Saúde de Coronel Fabriciano, Minas Gerais. Cien Saude Colet 2012; 17(1):157-166.
27. LOPES AP. Ansiedade e consumo de substâncias psicoativas em adolescentes. [Dissertação de Mestrado]. São Bernardo do Campo (SP): Faculdade de Saúde da Universidade Metodista de São Paulo, 2011.
28. LOPES AP, REZENDE MM. Ansiedade e consumo de substâncias psicoativas em adolescentes. Estud psicol 2013; 30(1): 49-56.
29. Carlini EA et al. (Organizadores) VI Levantamento Nacional sobre o Consumo de Drogas Psicotrópicas entre Estudantes do Ensino Fundamental e Médio das Redes Pública e Privada de Ensino nas 27 Capitais Brasileiras – 2010 -- São Paulo: CEBRID - Centro Brasileiro de Informações sobre Drogas Psicotrópicas: UNIFESP - Universidade Federal de São Paulo 2010. 1ª edição. SENAD - Secretaria Nacional de Políticas sobre Drogas, Brasília – SENAD, 2010. 503 p.
30. Galduróz JCF, Noto AR, Fonseca AM, Carlini EA. V Levantamento sobre o consumo de drogas psicotrópicas entre estudantes do ensino fundamental e médio da rede pública de ensino nas 27 capitais brasileiras – 2004. São Paulo: CEBRID - Centro Brasileiro de Informações sobre Drogas Psicotrópicas: UNIFESP - Universidade Federal de São Paulo. 1ª edição. SENAD - Secretaria Nacional de Políticas sobre Drogas, Brasília – SENAD, 2005, 14 p.
31. BRASIL. Agência Nacional de Vigilância Sanitária. Bulário Eletrônico. Availabe at http://www.anvisa.gov.br/datavisa/fila_bula/index.asp.
32. DEL GIGLIO A, ABDALA B, OGAWAL C, AMADO D, CARTER D, GOMIEIRO F, SALAMA F, SHIROMA M, DEL GIGLIO A. Qualidade da informação da internet disponível para pacientes em páginas em português. Rev Assoc Med Bras 2012; 58(6):645-649
33. MOLINO CGRC, MELO DO. A criação de sítio para disseminar informações sobre medicamentos no SUS: um relato de experiência. Rev Eletron Comun Inf Inov Saúde. 2017 jan.-mar.; b11(1) http://dx.doi.org/10.3395/reciis.v11i1
34. GONDIM AP, WEYNE DP, FERREIRA BS.Qualidade das informações de saúde e medicamentos nos sítios brasileiros. Einstein. 2012;10(3):335-41
35. SILVA EV, CASTRO LLC, CYMROT R. Informação sobre o tratamento farmacológico da obesidade em sítios da Internet: avaliação da qualidade. Rev Tempus Actas Saúde Colet 2010; 4(3):95-111.
36. HIRATA DM, QUEIROZ NR, SOUZA RC, OLIVEIRA LB, MARTINS WA. Qualidade da Informação na Internet sobre Coronariopatia. Rev Bras Cardiol 2010; 23(1):39-46.
37. PARR O, DUNMALL K. An evaluation of online information available for women with breast implants aged 47-73 who have been invited to attend the NHS Breast Screening Programme. Radiography (Lond). 2018 Nov; 24(4):315-327. doi: 10.1016/j.radi.2018.03.008. Epub 2018 Apr 18.
38. BATISTA, Almária Mariz; CARVALHO, Maria Cleide Ribeiro Dantas. Avaliação da propaganda de medicamentos veiculada em emissoras de rádio. Cien Saude Colet 2013; 18(2):553-561.
39. SILVA PS, RANGEL BCC, CASTILHO SR. Avaliação da propaganda de medicamentos isentos de prescrição em farmácias comunitárias do município de Niterói (RJ, Brasil). R Dir Sanit 2017; 18(3), p. 77-93.
40. MASTROIANNI PC, NOTOL AR, GALDURÓZ JCF. Propagandas de medicamentos psicoativos: análise das informações científicas. Rev Saude Publica 2008; 42(3):529-35.
41. HERNÁNDEZ-GARCÍA I, GIMÉNEZ-JÚLVEZ T. Evaluación de la información sanitaria disponible en internet sobre las recomendaciones de vacunación frente al Meningococo B. Rev Esp Salud Publica 2018;92, 11 de maio, e1-e9, e201805017.
42. HIRSCH M, AGGARWAL S, BARKER C, DAVIS CJ, DUFFY JMN. Googling endometriosis: a systematic review of information available on the Internet. Am J Obstet Gynecol 2017 May;216(5):451-458.e1. doi: 10.1016/j.ajog.2016.11.1007. Epub 2016 Nov 11.
43. FALCÃO AEJ, MANCINI F, TEIXEIRA FO, SOUSA FS, HUMMEL AD, AURELIANO KC, COSTA TM, SIGULEM D, PISA IT. Análise da percepção de usuários sobre a qualidade de websites em saúde comparada com os critérios de adequação da HON. J Health Inform 2011; 3(3): 103-8.
44. VARADY NH, DEE EC, KATZ JN. International assessment on quality and content of internet information on osteoarthritis. Osteoarthritis Cartilage 2018; Aug;26(8):1017-1026. doi: 10.1016/j.joca.2018.04.017. Epub 2018 May 23.
45. Ottenhoff JSE, Kortlever JTP, Teunis T, Ring D. J. Factors Associated With Quality of Online Information on Trapeziometacarpal Arthritis. J Hand Surg Am. 2018 Oct;43(10):889-896.e5. doi: 10.1016/j.jhsa.2018.08.004.
46. CHARNOCK D, SHEPPERD S, NEEDHAM G, GANN R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health 1999; 53(2): 105–111.
47. FAST AM, DEIBERT CM, BOYER C, HRUBY GW, McKIERMAN JM. Partial nephrectomy online: a preliminary evaluation of the quality of health information on the Internet. BJU Int 2012; Dec;110 (11 Pt B): E765-9. doi: 10.1111/j.1464-410X.2012.11626.x. Epub 2012 Oct 26.
48. RAJ S, SHARMA VL, SINGH AJ, GOEL S. Evaluation of Quality and Readability of Health Information Websites Identified through India’s Major Search Engines. Adv Prev Med 2016, http://dx.doi.org/10.1155/2016/4815285 PMID: 27119025.
49. FISCHER JH, O´CONNOR D, FLEXMAN AM, SHAPERA S, RYERSON CJ. Accuracy and Reliability of Internet Resources for Information on Idiopathic Pulmonary Fibrosis. Am J Respir Crit Care Med 2016; Jul 15;194(2):218-25. doi: 10.1164/rccm.201512-2393OC.
50. GROHOL JM, SLIMOWICZ J, GRANDA R. The quality of mental health information commonly searched for on the internet. Cyberpsychol Behav Soc Netw. 17 (2014) 216–221.
51. COSTA AO, ALONZO HGA. Casos de exposição e intoxicações por medicamentos registrados em um Centro de Intoxicações do interior do estado de São Paulo. Rev Bras Pesq Saúde 2015; 17(2):52-60.
52. MONTE BS, NUNES MST, NUNES MDS, MENDES CMM. Estudo epidemiológico das intoxicações por medicamentos registrados pelo centro de informações toxicológicas do Piauí: 2007 a 2012. R Interd 2016; 9(3):96-104.
53. SILVA RLF, SAMPAIO PR, ESTEPHANIN VV, LEITE ICG, BONFANTE HL. Perfil epidemiológico das intoxicações exógenas na cidade de Juiz de Fora – MG. HU Revista 2017; 43(2)149-154.
54. SILVA IM, CATRIB AMF, MATOS VC, GONDIM APS. Automedicação na adolescência: um desafio para a educação em saúde. Cien Saude Colet. 2011; 16(supl 1): 1651-1660.
55. CASTRO GLG, MENDES CMM, PEDRINI ACR, GASPAR DSM, SOUSA FCF. Uso de Benzodiazepínicos como automedicação: consequências do uso abusivo, dependência, farmacovigilância e farmacoepidemiologia. R Interd 2013; 6(1):112-123.
56. SILVA EG, FERNANDES DR, TERRA JUNIOR AT. Uma abordagem ao uso indiscriminado de medicamentos benzodiazepínicos. Rev Cient FAEMA 2018; 9:610-614.