Re: Australian Academy of Science - Research Quality Framework journal rankings

From: Arthur Sale <ahjs_at_ozemail.com.au>
Date: Fri, 16 Nov 2007 10:57:41 +1100

Stevan

The Australian ranked lists are developed by committees set up by relevant
professional bodies in Australia (for example CORE - the peak research body
in computer science in Australia). Similarly for other sub-disciplines, like
Physics, Chemistry etc down to even finer detail. This is true peer reviewed
ranking, but of course colored by self-interest.

I view it as a start towards a set of metrics, because it at least competes
with JIFs and citation counts (albeit an ISI one which is useless to
computer science).

Please don't mistake the [Australian] Academy of Science's call for comment
as anything other than that. It is not a web-based opinion poll. The
rankings were developed by peers, and I would expect little change as a
result of releasing then for public [researcher] comment.

Arthur Sale PhD
Professor of Computer Science
University of Tasmania

> -----Original Message-----
> From: American Scientist Open Access Forum
[mailto:AMERICAN-SCIENTIST-OPEN-
> ACCESS-FORUM_at_LISTSERVER.SIGMAXI.ORG] On Behalf Of Stevan Harnad
> Sent: Wednesday, 14 November 2007 10:23 PM
> To: AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM_at_LISTSERVER.SIGMAXI.ORG
> Subject: [AMERICAN-SCIENTIST-OPEN-ACCESS-FORUM] Australian Academy of
> Science - Research Quality Framework journal rankings
>
> > Research Quality Framework (RQF)
> >
> > The Academy is inviting feedback to the draft Research Quality
> > Framework (RQF) journal lists ranked by expert groups through the
> > Academy of Science.
> > http://www.science.org.au/rqf.htm
>
> Determining journal quality based on an unfiltered web-based opinion
> poll makes almost as little sense as doing it on the basis of polling
> preferences for the color of the journal's cover.
>
> A targeted evaluation by qualified peers would make far more sense.
>
> And even then, the journal's rated quality or impact factor (average
> citation count) should only be one (or two) in a rich battery of
> candidate metrics (including article citation counts, author citation
> counts, download counts, co-citations, chronometrics for citations and
> downloads, hub/authority indices, endogamy measures, "h-index," funding,
> students, and many other candidate metrics), jointly cross-validated
> and weighted, in a multiple regression equation, against qualified peer
> evaluations or other criteria that are either face-valid or have already
> been validated.
>
> Harnad, S. (2007) Open Access Scientometrics and the UK Research
> Assessment Exercise. In: Proceedings of 11th Annual Meeting of the
> International Society for Scientometrics and Informetrics 11(1), pp.
> 27-33, Madrid, Spain. Torres-Salinas, D. and Moed, H. F., Eds.
> http://eprints.ecs.soton.ac.uk/13804/
>
> Stevan Harnad
> AMERICAN SCIENTIST OPEN ACCESS FORUM:
>
http://amsci-forum.amsci.org/archives/American-Scientist-Open-Access-Forum.h
tml
> http://www.ecs.soton.ac.uk/~harnad/Hypermail/Amsci/
>
> UNIVERSITIES and RESEARCH FUNDERS:
> If you have adopted or plan to adopt a policy of providing Open Access
> to your own research article output, please describe your policy at:
> http://www.eprints.org/signup/sign.php
> http://openaccess.eprints.org/index.php?/archives/71-guid.html
> http://openaccess.eprints.org/index.php?/archives/136-guid.html
>
> OPEN-ACCESS-PROVISION POLICY:
> BOAI-1 ("Green"): Publish your article in a suitable toll-access
journal
> http://romeo.eprints.org/
> OR
> BOAI-2 ("Gold"): Publish your article in an open-access journal
if/when
> a suitable one exists.
> http://www.doaj.org/
> AND
> in BOTH cases self-archive a supplementary version of your article
> in your own institutional repository.
> http://www.eprints.org/self-faq/
> http://archives.eprints.org/
> http://openaccess.eprints.org/
>
>
> > Feedback needs to be made by Friday 23 November 2007 through the
> > use of a provided form. http://www.science.org.au/rqf-form.doc
> > Please email feedback forms to Ms Fenja Theden
> > (fenja.theden -- science.org.au).
> >
> > Nancy Pritchard
> > Manager - International Programs
> > Australian Academy of Science
> >
> >
> >
> >
> >
> >
> >
Received on Fri Nov 16 2007 - 00:16:28 GMT

This archive was generated by hypermail 2.3.0 : Fri Dec 10 2010 - 19:49:06 GMT