Correlation of Basic Research Evaluation Indices
Keywords:
Citations count, Expert finders, Expertise, g-index, h-index, Research evaluation parametersAbstract
Research evaluation parameters are a benchmark to measure the scientific output of researchers. Many techniques have been used previously to measure scientific output. Although all these parameters gave a good measure of the researcher’s contribution, due to different domains and small volume of data sets, it is hard to say which parameter best measures the expertise of a researcher. This paper analyzes the application of basic research evaluation parameters on a common large dataset in a single domain and investigates their correlation. Firstly, ranking lists of indices were created to analyze the application of parameters. Secondly to investigate their relationship potential correlation of indices was accessed. The research work presented here concentrated on the Computer science domain however we suggest it should apply to other scientific domains as well.
References
Beel, J., Gipp, B., Langer, S., & Breitinger, C. (2016). Paper recommender systems: A literature survey. International Journal on Digital Libraries, 17(4), 305–338.
Bornmann, L., Mutz, R., & Daniel, H.-D. (2008). Are there better indices for evaluation purposes than the h-index? A comparison of nine different variants of the h-index using data from biomedicine. Journal of the American Society for Information Science and Technology, 59(5), 830–837.
Buckley, C., & Voorhees, E. M. (2017). Evaluating evaluation measure stability. In ACM SIGIR Forum (Vol. 51, No. 2, pp. 235–242). ACM.
Cole, F. J., & Eales, N. B. (1917). The history of comparative anatomy: Part I.—A statistical analysis of the literature. Science Progress (1916-1919, 11(44), 578–596.
Egghe, L. (2006). An improvement of the H-index: The G-index. ISSI Newsletter, 2(1), 8–9.
Egghe, L. (2006). Theory and practice of the g-index. Scientometrics, 69(1), 131–152.
Egghe, L. (2007). Dynamic h-index: The Hirsch index in function of time. Journal of the American Society for Information Science and Technology, 58(3), 452–454.
Fang, & Zhai, C. (2007). Probabilistic models for expert finding. Lecture Notes in Computer Science: Advances in Information Retrieval (pp. 418–430).
Gross, P. L. K., & Gross, E. M. (1927). College libraries and chemical education. Science, 66(1713), 385–389.
Hirsch, J. E. (2005). Expertise Browser: An index to quantify an individual's scientific research output. International Conference on Software Engineering (pp. 503–512).
Hirsch, J. E. (2007). Does the h-index have predictive power? Proceedings of the National Academy of Sciences, 104(49), 19193–19198.
Kelly, C. D., & Jennions, M. D. (2006). The h-index and career assessment by numbers. Trends in Ecology & Evolution, 21(4), 167–170.
Kosmulski, M. (2006). A new Hirsch-type index saves time and works equally well as the original h-index. ISSI Newsletter, 2(3), 4–6.
Latif, S., Fang, X., Mohsin, S. M., Akber, S. M. A., Aslam, S., Mujlid, H., & Ullah, K. (2023). An enhanced virtual cord protocol-based multicasting strategy for the effective and efficient management of mobile ad hoc networks. Computers, 12(1), 21.
Latif, S., Fang, X. W., Arshid, K., Almuhaimeed, A., Imran, A., & Alghamdi, M. (2023). Analysis of birth data using ensemble modeling techniques. Applied Artificial Intelligence, 37(1), 2158273.
Narin, F. (1976). Evaluative bibliometric: The use of publication and citation analysis in the evaluation of scientific activity. Washington, DC: Computer Horizons.
Ravichandra Rao, I. K. (2007). Distributions of Hirsch-index and G-index: An empirical study. In D. Torres-Salinas & H. F. Moed (Eds.), Proceedings of the 11th Conference of the International Society for Scientometrics and Informetrics (Vol. 2, pp. 655–658).
Taylor, M., & Richards, D. (2008). Discovering areas of expertise from publication data. In Pacific Rim Knowledge Acquisition Workshop (pp. 218–230). Berlin, Heidelberg: Springer.
Yimam-Seid, D., & Kobsa, A. (2003). Expert-finding systems for organizations: Problem and domain analysis and the DEMOIR approach. Journal of Organizational Computing and Electronic Commerce, 13(1), 1–24.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Sohaib Latif, Muhammad Waleed Butt, Haroon Shafique
This work is licensed under a Creative Commons Attribution 4.0 International License.
