Nothing Special   »   [go: up one dir, main page]

Skip to main content
Log in

Meso-level institutional and journal related indices for Malaysian engineering research

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

The literature considers a journal’s h-index as a compared measure, however the relation between institutional level h-index (IHI) and journal related indices (JRI) has not been explored in previous studies at meso-level research assessment. This study applies the scientometric approach to meso-level data to examine the association, functional relationship and correlation analysis to evaluate the reliability of IHI with respect to JRI. For this purpose, data from the Web of Science, journal citation report and time cited features were used. The unit of analysis was Malaysian engineering research with a wider time span of 10 year’s data (2001–2010) and a larger set of journals (1381). We explored the inter-correlation of IHI with a set of eight JRI and applied principle component analysis, regression analysis, and correlation. At the institutional level, the component analysis and functional relationship of the cumulative impact factor and 5 years IF yielded a more strong association with IHI. Cumulative impact factor is a strong predictor for IHI followed by cumulative 5 years impact factor. Correlation matrix results show that average impact factor (AIF) is correlated with immediacy index and Eigenfactor only. AIF and median impact factor (MIF) have no correlation with each other and IHI is correlated with all indices except AIF and MIF. This study puts forward a better understanding in considering new impact indices at meso level for performance evaluation purpose.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Abrizah, A., Zainab, A. N., Kiran, K., & Raj, R. G. (2013). LIS journals scientific impact and subject categorization: A comparison between Web of Science and scopus. Scientometrics, 94(1), 721–740.

    Article  Google Scholar 

  • Amin, M., & Mabe, M. (2000). Impact factor: Use and abuse. Perspectives in Publishing, 1, 1–6.

    Google Scholar 

  • Bador, P., & Lafouge, T. (2010). Comparative analysis between impact factor and h-index for pharmacology and psychiatry journals. Scientometrics, 84(1), 65–67.

    Article  Google Scholar 

  • Bergstrom, C. (2007). Eigenfactor: Measuring the value and prestige of scholarly journals. College & Research Libraries News, 68(5), 314–316.

    Google Scholar 

  • Bornmann, L., Marx, W., Gasparyan, A. Y., & Kitas, G. D. (2012). Diversity value and limitations of the journal impact factor and alternative metrics. Rheumatology International, 32, 1861–1867.

    Article  Google Scholar 

  • Bornmann, L., Mutz, R., & Daniel, H. D. (2008). Are there better indices for evaluation purposes than the h-index? A comparison of nine different variants of the h- index using data from biomedicine. Journal of the American Society for Information Science and Technology, 59(5), 830–837.

    Article  Google Scholar 

  • Bornmann, L., Mutz, R., & Daniel, H. D. (2009). Do we need the h-index and its variants in addition to standard bibliometric measures? Journal of the American Society for Information Science and Technology, 60(6), 1286–1289.

    Article  Google Scholar 

  • Bornmann, L., Mutz, R., Hug, S. E., & Daniel, H. D. (2011). A multilevel meta-analysis of studies reporting correlations between the h index and 37 different h index variants. Journal of Informetrics, 5(3), 346–359.

    Article  Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (2005). A Hirsch-type index for journals. The Scientist, 19(22), 8.

    Google Scholar 

  • Braun, T., Glänzel, W., & Schubert, A. (2006). A Hirsch-type index for journals. Scientometrics, 69(1), 169–173.

    Article  Google Scholar 

  • Conway, J. M., & Huffcutt, A. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods, 6(2), 147–168.

    Article  Google Scholar 

  • Costas, R., & Bordons, M. (2007). The h-index: Advantages, limitations and its relation with other bibliometric indicators at the micro-level. Journal of Informetrics, 1(3), 193–203.

    Article  Google Scholar 

  • Gavel, Y., & Iselid, L. (2008). Web of Science and scopus: A journal title overlap study. Online Information Review, 32(1), 8–21.

    Article  Google Scholar 

  • Harzing, A.-W., & Van der Wal, R. (2009). A google scholar h-index for journals: An alternative metric to measure journal impact in economics and business? Journal of the American Society for Information Science and Technology, 60(1), 41–46.

    Article  Google Scholar 

  • Hatcher, L. (1994). A step-by-step approach to using the SAS system for factor analysis and structural equation modeling. Cary, NC: SAS Institute Inc.

    Google Scholar 

  • Hicks, D., & Wang, J. (2011). Coverage and overlap of the new social sciences and humanities journal lists. Journal of the American Society for Information Science and Technology, 62(2), 284–294.

    Article  Google Scholar 

  • Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31–36.

    Article  MATH  Google Scholar 

  • Leydesdorff, L. (2009). How are new citation-based journal indicators adding to the bibliometric toolbox? Journal of the American Society for Information Science and Technology, 59(2), 278–287.

    Article  Google Scholar 

  • Malaysia, Ministry of Education. (2015). Malaysian education blueprint 2015–2025 (higher education): Executive summary. Putrajaya, Malaysia: Ministry of Education.

    Google Scholar 

  • Mikki, S. (2010). Comparing google scholar and ISI Web of Science for earth sciences. Scientometrics, 82(20), 321–331.

    Article  Google Scholar 

  • Mingers, J., Macri, F., & Petrovici, D. (2012). Using the h-index to measure the quality of journals in the field of business and management. Information Processing and Management, 48, 234–241.

    Article  Google Scholar 

  • Moussa, S., & Touzani, M. (2010). Ranking marketing journals using the google scholar-based hg-index. Journal of Informetrics, 4, 107–117.

    Article  Google Scholar 

  • Prathap, G. (2011). Correlation between h-index, Eigenfactor™ and article influence™ of chemical engineering journals (letter). Current Science, 100(9), 1276.

    MathSciNet  Google Scholar 

  • Preacher, K. J., & MacCallum, R. C. (2002). Exploratory factor analysis in behavior genetics research: Factor recovery with small sample sizes. Behavior Genetics, 32, 153–161.

    Article  Google Scholar 

  • Raj, R. G., & Zainab, A. N. (2012). Relative measure index: A metric to measure quality. Scientometrics, 93(2), 305–317.

    Article  Google Scholar 

  • Schreiber, Malesios, C. C., & Psarakis, S. (2012). Exploratory factor analysis for the hirsch index, 17 h-type variants, and some traditional bibliometric indicators. Journal of Informetrics, 6, 347–358.

    Article  Google Scholar 

  • Soutar, G. N. & Murphy, J. (2009). Journal quality: A Google analysis. Australasian Marketing Journal, 17, 150–153.

    Article  Google Scholar 

  • Tahira, M., Abrizah, A., Alias, R. A., Bakri, A. (2015). New research performance evaluation development and journal level indices at meso level. Paper presented in the 15th international conference on scientometrics & informatics (ISSI’ 2015) held in Istanbul, Turkey on 29th June to 4th July. pp. 697–705.

  • Tahira, M., Alias, R. A., Bakri, A., & Shabri, A. (2014). h-index, h-type Indices, and the role of corrected quality ratio. Journal of Information Science Theory and Practice, 2(4), 20–30.

    Article  Google Scholar 

  • Tahira, M., Alinda, R. A., & Bakri, A., (2012). Bibliometrics, reference enhanced databases and research evaluation in knowledge management international conference (KMICe) 2012, Johor Bahru, Malaysia, 4–6 July 2012.

  • Thomson-Reuters. (2015). Web of Science™. http://admin-apps.webofknowledge.com/JCR/help/h_impfact.htm). Retrieved 20 Mar 2015.

  • Yin, C. Y. (2011). Do impact factor, h-index and Eigenfactor™ of chemical engineering journals correlate well with each other and indicate the journals’ influence and prestige? Current Science, 100(5), 648–665.

    Google Scholar 

  • Yin, C.-Y., Aris, M., & Chen, X. (2010). Combination of Eigenfactor and h-index to evaluate scientific journals. Scientometrics, 84(3), 639–648.

    Article  Google Scholar 

Download references

Acknowledgments

The work of Muzammil Tahira and A. Abrizah was supported by the Ministry of Higher Education Malaysia (HIR-MOHE) UM.C/HIR/MOHE/FCSIT/11.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. Abrizah.

Appendix

Appendix

See Table 11.

Table 11 Analysis of complete dataset for institutional level indices applied

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tahira, M., Alias, R.A., Bakri, A. et al. Meso-level institutional and journal related indices for Malaysian engineering research. Scientometrics 107, 521–535 (2016). https://doi.org/10.1007/s11192-016-1850-4

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-016-1850-4

Keywords

Navigation