scientometric methods can be used to show potentially fruitful areas for drug discovery , based on the assumption that higher levels of scientific activity , including publication rates , will point to specific targets for novel therapies.1 bordons et al demonstrated the usefulness of bibliometric analyses to detect trends in the research of a therapeutic drug including the evolution of drug studies over time.2 can a scientometric indicator reflecting initial drug  coverage  in biomedical journals be used to assess a specific drug s potential ? the first attempt to predict the clinical success of drugs by using bibliometric data was made by windsor in 1976.3 later he wrote ,  just as rabbits leave rabbit tracks and squirrels leave squirrel tracks  successful drugs leave different bibliometric tracks than do unsuccessful drugs . sometimes these track records can be used to make predictions.4 he used bibliometric traits of the journal literature on levodopa over a 14-year period to identify predictors of the drug s success . he concluded that the bibliometry of single - author papers may have promise in this regard . in 2011 a scientometric indicator , the top journal selectivity index ( tjsi ) , was suggested for use in the assessment of therapeutic drugs.5 it represents the ratio ( as percentage ) of the number of all types of articles on a particular drug in the top 20 journals relative to the number of articles in all ( > 5000 ) biomedical journals covered by medline over the 5 years since the drug s introduction . five years is a relatively long period of time , but the accurate assessment of a drug s value takes much longer . the true assessment of a drug usually comes with the confirmation of its effectiveness by meta - analyses ( the process of combining results of many clinical studies to draw conclusions about the therapeutic value of a drug ) . the conclusion on a drug s value reached via this process can take 1020 years.6 however , even this period may not be sufficient , because the comparison of various drugs in meta - analyses is usually indirect , using a placebo as a common comparator.7 as a result such comparisons are not often reliable ; only direct head - to - head comparisons between drugs can provide dependable information on drugs relative efficacy thus an accurate conclusion on a drug s value via this process can take longer than 20 years . the relatively rapid ( 35 years ) publication response to a new drug may have an important predictive power related to the whole period of a drug s protracted evaluation . in the assessment of the success of new analgesics over the past 50 years , we observed a difference in the publication response to a new drug between biomedical journals in general and in the top journals : the number of published articles on a drug increased ( or declined ) more rapidly in the top journals.6 this observation prompted the introduction of tjsi as an early indicator of drug success . this feature of tjsi can probably be explained by the high - caliber experts involved in the assessment of manuscripts evaluating new drugs in the top specialty journals . one of the tjsi determinants is the number of all types of journal articles with or without abstracts ( including editorials , case reports , reviews , and letters to the editor ) covered by the web site of us national library of medicine  pubmed ( see http://www.ncbi.nlm.nih.gov/pubmed ) . pubmed comprises over 21 million citations for the biomedical literature and covers approximately 5000 journals . the pubmed web site was used to count the number of articles in english published in all types of journals ( original research and review journals ) . boolean operations were used in which variables were the selected keywords and years of publications . another tjsi determinant is the number of articles published in the 20 top journals ( also counted using the pubmed web site ) . the selection of the top 20 journals was based on two factors : the rank of a journal sorted by ( 1 ) the impact factor and ( 2 ) the journal specialty area related to the drug s specific pharmacological class . sixteen journals were common for all selected drugs . they represent medicine in general ( 10 journals ) and pharmacology ( six journals ) : ann intern med , annu rev pharmacol toxicol , bmj , clin pharmacol ther , j clin invest , j pharmacol exp ther , jama , lancet , n engl j med , nat med , nat rev drug discov , nature , pharmacol rev , proc natl acad sci u s a , science , and trends pharmacol sci . for example , in the case of drugs used by neurologists the selected journals were : ann neurology , brain , nat neurosci , and trends neurosci . journals were sorted by the rank of their impact factor presented by journal citation reports , science edition ( see http://science.thomsonreuters.com ) . the choice of the specific journals is more important than the total number of top journals . when we used 100 top journals instead of 20 , the difference in the values of tjsi was not distinct . it should be noted that the chosen determinants are not mutually exclusive ; one relies on a subject of the information used to create the other . figure 1 gives an example of tjsi calculated in this manner for drugs in six pharmacological classes when the first - in - class drug ( ficd ) had multiple follow - on drugs ( fod ) . the assessment period could be decreased to 3 years if the increase in the rate of publications in all journals is sufficiently high from the very beginning . ten analgesics approved by the us federal drug administration ( fda ) during the period 19862009 were selected for analysis.5 they included new molecular entities ( nme ) developed as analgesics and also drugs developed for nonpain indications with subsequent fda approval for the treatment of pain as an additional indication : sumatriptan , tramadol , remifentanil , gabapentin , zolmitriptan , celecoxib , ziconotide , pregabalin , topiramate , and duloxetine . in counting the numbers of articles published over the 5 years since a drug s introduction , specific keywords were selected according to the name of an analgesic in addition to using pubmed medical subject heading [ mesh ] terms . terms added to the name of a drug were  pain  or  headache disorder  [ mesh ] or  migraine  . the analgesic success score was determined based on the following criteria : ( 1 ) novelty of molecular target ( completely novel target , novel modification of existing target , or incremental improvement of existing drug ) ; ( 2 ) analgesic efficacy ( magnitude of pain relief , strength of evidence regarding effectiveness , and universality in use ) ; and ( 3 ) response by the pharmaceutical market ( based on the number of nme similar to the initial drug ) . the contributions of these three criteria to the total success score were weighted differently : much more weight was given to analgesic efficacy ( up to the maximum of 5 points ) than to the two other criteria ( up to the maximum of 2 points each ) . the strength of the relationship between tjsi and success score was quite impressive : r = 0.876 , p < 0.001 ( figure 2 ) . even if the sumatriptan is not taken into account , the correlation coefficient continues to be high at 0.694 ( p < 0.05 ) . tjsi was compared with two other bibliometric indices : the number of all types of articles presented in pubmed ( aji ) and the number of articles covering only randomized controlled trials ( rct ) . it was found that although there was some tendency for positive relationships between the  all articles  index ( or  rct articles  ) and the success score , these relationships did not reach statistical significance . there are other approaches trying to find relationships between the success rate of drugs and different factors of drugs research performance . the most interesting in this report is the study by koenig.9 he defined the composite drug output index , which served as a good predictor for past ( or ) future success . his finding of a high correlation between the number of all published articles and expert judgment of the quality of pharmaceutical research is of particular interest . his data also indicated that the number of highly cited clinical articles correlated with drug research success ( assessed by expert judgment ) even better than the number of all clinical articles . because the top biomedical journals selected for our index calculations have a much higher citation rate than the rest of the journals , the previously mentioned better correlation rate for highly cited clinical articles compared to all clinical articles could service as an indication going in the same direction as our conclusion . two groups of drugs were selected to test the hypothesis that the difference between the most successful ( breakthrough ) and less successful drugs of the same category can be detected by tjsi.8 the fda web site for approved drug products ( see http://www.fda.gov/drugs ) was used for selection of drugs approved between 19801989 . one group of 10 agents included the most successful ( breakthrough ) drugs belonging to different pharmacological classes . the other group of 10 drugs was selected using a paired design : the paired drug belonged to the same pharmacological group with a mechanism of action as similar as possible . the selection of drugs for both groups was based on two principles : the degree of advancement in the new drug development and the level of commercial success . the drug in the first group had a novel mechanism of action and also a highly competitive market status ( six or more pharmaceutical companies had applied to the fda for a generic alternative ) . the drug in the second group provided only an incremental improvement on the existing drug and had a lower marketing status as a generic drug ( one to five pharmaceutical companies applied to the fda ) . the following breakthrough drugs were included : acyclovir , buprenorphine , captopril , diltiazem , enalapril , fluoxetine , gemfibrozil , lovastatin , omeprazole , and zidovudine . the paired group of drugs included : abacavir , alfentanil , felodipine , fenofibrate , fluvastatin , foscarnet , lansoprazole , maprotiline , moexipril , and perindopril . the two groups were compared using three publication indices : the tjsi , the number of all types of articles on a drug in journals covered by pubmed ( aji ) , and the number of articles presenting only randomized controlled trials ( rct ) . it was found that tjsi can detect the difference between the two groups of drugs better than the two other indices . the results indicated that the mean tjsi of the breakthrough drugs was much higher than that of similar , but less successful , drugs ( 18.6  2.9 vs 7.4  4.2 , difference of 11.2  5.2 ; p < 0.0001 ) . for the aji the mean difference between the groups was 423  457 ( p < 0.02 ) , and for the rct index the mean difference was statistically insignificant ( 8  42 ; p > 0.5 ) . table 1 indicates that the higher value of tjsi was always that of the breakthrough member of a pair . with aji , the value of a breakthrough member was higher , in only eight of 10 pairs . with rct , the value of an index was higher with a breakthrough member in only four of 10 pairs . the percentage of times that an index for the breakthrough drug was higher than that of its corresponding pair , and related 95% confidence interval ( ci ) is presented in table 1 . the table indicates that the tjsi was distinguishable from random chance was 100% of the time with a 95% ci at 69% and 100% . for the aji , the value was 80% of the time with a 95% ci at 44% and 98% . for the rct index , the distinguishability from random chance was 40% of the time with a 95% ci at 12% and 74% . thus , tjsi will detect the breakthrough drug at least 69% of the time with 95% confidence . for the other two indices , their cis contain 50% , and thus they are not distinguishable from random chance ( 50% ) in selecting the breakthrough drug . thus , tjsi can detect the difference between a breakthrough drug and a less successful drug from the same pharmacological class . usually the introduction of a ficd is followed by the development of many similar drugs , referred to as fod . while some fod have pharmacological properties that distinguish them from the ficd , others do not . drugs without distinguishing features are often called  me - too  drugs , because they offer no significant benefits ( including safety ) over the previous agents.10 the marketing of each new drug without distinguishing features becomes questionable , especially when the sequential number of the market entry is as high as five or more . it was shown that tjsi can provide help in the assessment of late market entrants without distinguishing features.11 to prove that there is a relationship between the tjsi of  me - too  drugs and the order ( sequential number ) of their market entry , the 43 fod without distinguishing features were assessed . the study was based on drug classes approved by the fda for marketing between the 1960s and early 2000s . the analysis of the remaining 43 fod without such distinguishing properties demonstrated ( figure 3 ) that the relationship between tjsis for fods and the order of the drugs market entry had a negative correlation ( r = 0.372 ; p = 0.014 ) : the higher the order ( sequential number ) , the lower the tjsi . the negative correlation between fod without distinguishing features and the order of market entry can be used for the identification of  me - too  drugs . it was found that if tjsi is less than 0.5 of ficd and market entry order is 5 or higher , the fod is a  me - too  drug ( with false negative rate of only 9.1% . ) the ficd and the first three fods that followed it were excluded from this analysis to eliminate the possibility of counting as  me - too  drugs those that might be involved in the process of competition for being the first drug in a new class . to underline the notion that the determinants of the tjsi are not mutually exclusive one can indicate that with each new  me - too drug a reasonable increase in the number of publications on the related nme could occur . this would increase both the tjsi and the aji for the nme . among quantitative studies regarding the effect of fods order - of - entry on the drugs commercial success there was a publication indicating that despite the average success of pioneers over later entrants , there are examples of opposite phenomenon ; later entrants have gained dominant market share.12 the development and the marketing of  me - too  drugs has been criticized as duplicative , wasting resources that should be used instead to develop more innovative products.13,14 the view that investment in the development of  me - too  drugs is not an effective use of community resources dates back to the 1959 kefauer us senate committee review.15 since that time many arguments have been made on both sides of the debate regarding how many  me - too  drugs is too many.16 identifying which fod offer no significant benefits over previous agents , ie , how to distinguish  me - too drugs among fod is a difficult question , and the tjsi could confirm the presence of a  me - too drug among fods . tjsi is a scientometric index reflecting the potential importance of a new drug and can be an indicator for sustained use of a drug : a higher score increases the probability of continuing success . studies on drugs with narrow , limited use do not have many publications ; some of such studies are not published . in addition for example , among the 14 analgesics analyzed previously5 only 10 had enough publications to calculate the tjsi . four drugs ( ketorolac , pentosan , topical lidocaine , and valproate ) were excluded from the calculations , either because they did not have sufficient number of publications in the all journal category ( more than 10 articles ) or not a single article in the top 20 journals category . the other tjsi limitation is that this index does not differentiate between publications characterizing a drug in a positive and negative way . sometimes after a drug introduction ( due to the possible discovery of unexpected adverse effects ) a significant number of articles can be devoted to the serious problems associated with its administration . for example , in 20012008 , publications on the cardiovascular risk related to cycloxygenase-2 ( cox-2 ) selective inhibitors reached up to 12% of all publications on cox-2 inhibitors.6 the evaluation of the tjsi is based on the three presented examples . the real - life utility of this index for various groups of drugs and different situations should be further explored .