Skip to Main Content

Measuring Research Quality and Impact - Research Guide

Researcher Impact

Demonstrating Impact

Researchers may be asked to demonstrate the quantity, quality and impact of their research publications for a variety of purposes, including:

  • to enhance researcher profiles and promote their research to potential collaborators and investors
  • to benchmark their productivity for performance reviews
  • to support promotion or tenure applications
  • to support grant or other funding applications and progress reports.

The output of an individual researcher can be measured using citation metrics, other alternative metrics, measures of esteem, and indices such as an h-index or field weighted citation impact (FWCI).

Researcher profiles and identifiers make the process of collating your publication and citation counts easier.

Researcher Profiles and Identifiers

Researcher profiles allow you to:

  • Showcase your research outputs and publications to a worldwide audience
  • Attribute your research outputs to Murdoch University
  • Manage your publications list
  • Avoid misidentification
  • Increase the visibility of your research to potential collaborators
  • Track citation and other metrics. 

There are a number of researcher profile services available and you may find that more than one profile service is required to include all of your research. All Murdoch University researchers should have an Academic Profile in the Murdoch Research Portal.

It is recommended that any author identifiers such as ORCID are added to any profile you may have so your publications can be correctly attributed across various profiles and platforms. This will assist with measuring the impact of your research through citation metrics and alternative metrics, which can be used to support applications for grants and for academic promotion.

Murdoch University Academic Profiles showcase Murdoch academics and their work: outputs, projects, research and teaching activities.

Key information to add to your Academic Profile includes:

  • A brief introduction to your research under Describe your research
  • Your ORCID and any other author identifiers under Global IDs
  • A profile image 
  • Keywords about your research under Research Topics.

To further add to your profile, you can include links to other professional profiles such as Google Scholar or websites associated with your research or teaching, add awards or education, and any affiliations to other positions you hold within Murdoch or externally. 

Research Publications, Activities, and Projects

Your Academic Profile includes research outputs, with previous publications having been migrated to your Academic Profile in the Research Portal from the former Research Repository. New research outputs will be added to the Research Portal using a smart harvesting process. For further information, see Contribute your research publications in the Research Portal. 

 Activities are another type of content that can be added to your academic profile. These might include:

  • Teaching 
  • Service to the Community, Institution or Profession
  • Consulting
  • Supervising, Advising and Mentoring
  • Events. 

For further information, see Update your academic profile on the intranet.

ORCID stands for Open Researcher and Contributor ID. ORCID is a global not-for-profit organisation with a vision for a world where all who participate in research, scholarship, and innovation are uniquely identified and connected to their contributions.

ORCID provide three interrelated services:

  • The ORCID iD - a persistent digital identifier which distinguishes you from other researchers 
  • An ORCID record connected to the ORCID iD, which stores automatic links to all your research and links all your research with you
  • A set of Application Programming Interfaces (APIs), along with services and support of communities of practice that enable interoperability.

Registering for an ORCID profile enables you to attach your identity to your research outputs such as articles, citations, datasets, patents, experiments and equipment. You can easily share your ORCID record with an increasing number of funding, publications, repositories, and other research workflows. Using ORCID streamlines manuscript submission and grant applications, as many systems enable auto-population of forms when you log in to their systems with your ORCID iD.

It is highly recommended that you:

  • Register with ORCID (note: if you are unsure if you you already have an ORCID iD or record, search for your name in the ORCID registry)
  • Add your ORCID iD as a Global ID to your Murdoch Academic Profile
  • Link your ORCID iD to any other identifiers, such as Scopus Author Identifier or Web of Science ResearcherID.

 

Scopus uses an algorithm to automatically generate a unique author identifier number and profile when an author first has a publication indexed in Scopus. The Scopus Author Identifier assigns a unique number to each author in the Scopus database and groups together all their publications. It accounts for variant versions of names by matching affiliations, addresses, subject areas, co-authors and dates of publication. It automatically calculates citation counts and the h-index.

To find your Scopus Author Identifier:

  • Log in to Scopus
  • Use the 'Authors' search to search by Author name or ORCID
  • Click on the name to access the author profile generated by Scopus
  • Locate the Scopus Author Identifier number below the author name and affiliation details.

You can request corrections to your author profile if a publication has been wrongly assigned, the preferred name needs to be changed, or some documents indexed in Scopus are missing from the profile. For more information, see the Scopus Author Profile FAQs and How do I correct my author details?.

It is recommended that you link your ORCID iD to your Scopus author profile, so viewers can see the link to your ORCID record on the Author details page. To associate your Scopus author profile with ORCID:

  • Log in to Scopus
  • Use the 'Authors' search to search by Author name
  • Click on the name to access the author profile generated by Scopus
  • Select 'Connect to ORCID' 
  • Follow the prompts to link the author profile to ORCID.

 

Web of Science ResearcherID

Web of Science ResearcherID is a unique identifier that differentiates researchers in Web of Science. It aims to solve the problem of identifying unique authors and ensure publications are correctly attributed. A Web of Science ResearcherID can be found on both a Web of Science Researcher Profile and an algorithmically generated author record in Web of Science Core Collection.

 

Web of Science Researcher Profile
Author records created by the algorithm can be claimed by the author to create a Web of Science Researcher Profile. Information that can be included on the profile includes researcher information such as name and institution, Web of Science ResearcherID, and publication metrics. 

If you previously had a Publons profile, your profile may have been migrated over to a Web of Science Researcher Profile. See Web of Science Researcher Profiles for further information..

Other identifiers can be linked, such as ORCID, allowing publications to sync between profiles. Other methods of adding publications include system suggested publications, identifier import (e.g. DOI), and file upload (RIS, CSV or Bibtex format). Profiles also contain citation metrics such as number of times cited and h-index are automatically calculated using details from Web of Science.

See Researcher Search, Author Record, and Web of Science Researcher Profiles for further information. 

 

Google Scholar Profiles 

Create a profile in Google Scholar to ensure correct attribution of your publications and citations. This will allow you to check who is citing your articles, track citations over time, and calculate several citation metrics including h-index. Homepage links can be added to a profile, for example to your Academic Profile or ORCID record. Profiles can be private or public. All citations should be checked for accuracy.

 

Calculating Your Field Weighted Citation Impact or h-index

FWCI 

The field-weighted citation impact (FWCI) is an author metric which compares the total citations actually received by a researcher's publications to the average number of citations received by all other similar publications from the same research field. The global mean of the FWCI is 1.0, so an FWCI of 1.50 means 50% more cited than the world average; whereas, an FWCI of .75 means 25% less cited than the world average.

The following tool can be used to calculate your FWCI:

SciVal

SciVal allows you to compare the research performance of individual researchers and research groups to Australian and global benchmarks, and to identify and evaluate collaboration partners. Benchmarking data for individual researchers includes FWCI and h-index.

h-index  

The h-index is an author metric, first proposed by J. E. Hirsch in 2005, that attempts to measure both the productivity and citation impact of the publications of an author. 

The h-index is a measure of an individual's impact on the research community based upon the number of papers published and the number of citations these papers have received.

The method of calculating a h-index is the number of articles in a database that have received the same number or more citations over time. As an example, a researcher with an h-index of 20 has (of their total number of publications) 20 papers which have been cited at least 20 times each:

Source: Wikipedia

An h-index is not skewed by a single highly cited paper nor by a large number of poorly cited papers.

As well as SciVal, the following tools can also be used to calculate your h-index:

Scopus - Scopus is an online citation database that indexes resources in the health and life sciences, chemistry, physics, mathematics, engineering, earth and environmental sciences, social sciences, psychology, and economics, business and management. Scopus allows you to measure your h-index using the Scopus citation data and to create a h-graph.

Note: As these databases index different sets of journals over different time periods, your h-index may vary significantly between the two tools. You should check all tools and carefully select the measurement that best represents your output. When a h-index is included in documents, you should state which tool you used and the date the data was obtained. A more accurate h-index may be obtained by collating data from both of these tools, and other citations databases, using an ORCID; however if you wish to create a true h-index based on all unique citations to your publications from all sources, you will need to calculate it manually.  The fewer papers you have the more significant each citation becomes in terms of calculating your h-index.

Google Scholar - The My Citations feature requires a Google login and password. The Publish or Perish software analyses academic citations based on information from a variety of data sources, including Google Scholar and Microsoft Academic Search, to obtain the raw citations, and presents a range of metrics including the h-index.

Note: Google Scholar citations have been criticised for duplications and misidentifications. Careful analysis and verification of results is recommended.

Other Metrics and Measures of Esteem

Alternative metrics and measures of esteems may also indicate the quality and impact of a researcher's publications.

Measures of esteem are additional factors which may provide evidence of research quality. These measures may include:

  • awards and prizes
  • rankings in prestigious lists
  • membership of professional or academic organisations
  • positions on national and international committees or strategic advisory bodies
  • influence on government or public policy
  • industrial advisory roles
  • research fellowships
  • patents or other commercial output
  • international collaborations
  • successfully completed research grants or projects
  • editorial or reviewer role for a significant journal or reference work
  • keynote and plenary addresses at conferences, conference organisation or presentations at significant international conferences.