Chapter 4. Web Browser Interface for Administrative Users

Go to the URL:

above (you may be bounced via DICE weblogin authentication).

Choose the REF (Admin) desktop from the Choose Desktop menu. If you get an insufficient privilige error you don’t have the necessary administrative role - if you think you should contact support.

You will get a desktop open with five tabs:

For now ignore the open Paper one and click on the Person one instead. This will bring up a list of all REF eligible staff (including those not necessarily affiliated with the local Unit). Note however that any external staff that need access to the system (as a Rater for example) will need to have a DICE account. This can be done by setting them as a local Visitor.

For each person only the last three cells in the row are editable - Eligible, Rater and Moderater. To make changes click the appropriate checkbox to toggle the state and then click on the Save Changes button at the bottom right. By default all listed staff will be eligible, so you shouldn’t normally need to change the Eligible value (those that aren’t eligible are not listed by default). If a person has Rater set then they will be available for assignment to rate papers, if a person has Moderater set then they will be available for assignment to moderate papers. Changes made on this panel may not be reflected immediately on the Paper panel - you can force the update at any time by re-opening the whole desktop from Choose Desktop.

Now click on the Paper tab. This lists ALL papers proposed for the REF. In the top part nothing is editable apart from the Chosen field which allows you to set that paper to be put forward for the REF submission. You can scroll through papers using the scroll bar at the right of the panel. This can be inefficient when there are a lot of papers in which case querying for a few at a time is beneficial. For example, to view just Joe Blogg’s papers click on the New Query button at bottom right, click in the Submitter Lastname field and enter "bloggs" then click on the Search button at bottom right. You should then just see the papers submitted by Joe Bloggs.

The Status box has some management stats (all of these are read only). The Raters: Done/Count, Rater1: Rating (Name) and Rater2: Rating (Name) are the same as on the PapersToModerate panel on the REF (User) desktop. If the first and second rater assigned ratings differ the Raters field will have the value "Disagree", otherwise if they are they same this will be "Agree". If one of the raters has not entered a rating yet this will be blank. The Moderaters: Done/Count and Moderaters: Rating (Name) do exactly the same job except for the moderaters assigned to the paper. Note that any number of raters and any number of moderaters can be assigned to a paper. The Moderater field will be "Differs" when the average value (as a floating point number) of the ratings given by the raters is distinct from the average value (as a floating point number) given by the moderater, and will be "Average" otherwise. It will be empty if one or both raters have not entered a rank or if the moderater has not entered a rank. This field can be used to show where the moderation process has resulted in a rating divergent from the original rating. Following completion of review th Result field value will indicate the best rated paper (based on moderated rating) for each submitter. Where a submitter has multiple papers rated the same then the one that the submitter ranked highest will be indicated as the best. Where the submitter has used the same ranking more than once then the one indicated as the best will be effectively random. Further information about all fields can be found in the DDL Documentation.

The final two boxes are used to assign raters and moderaters to papers, although if assignment is being done by submitter (i.e. raters or moderaters are assigned to all papers of a submitter) then the Submitter panel should be used instead (see below). For any given paper do as follows to add a Rater (adding a Moderater is identical). Click on the little green plus icon at the bottom right of the Rater table to get a new row. Click on the Lastname field in the new row to get a drop-down menu. This will be a list of possible names (those that have the Rater checkbox set on the Person panel). Then start typing the surname (DO NOT USE MOUSE/TRACKPAD TO SELECT) by lookahead, e.g. if I type b the selected menu option shown will move down to and highlight Bloggs. Then hit Return to close the drop down menu and click on the Save Changes button at bottom right. You have now added Bloggs as a rater to whatever paper you had in view at the time. Note that you can add multiple raters and moderators before saving. With practice you can get very fast at doing this.

More than one rater (or moderater) can be added as above. To delete one click in the relevant row, then click on the red X button at bottom right of table then Save Changes. Note that if you delete an assignment then all the ratings and comments made by the rater for the paper will also be deleted so make sure the values shown are empty (or confirm you don’t mind any being lost).

To re-assign you can click on a row, select a new rater from the drop-down menu (using the keyboard) then Save Changes). Note that any ratings and comments made by the previous rater will then be attributed to the new rater, so make sure the values shown are empty (or confirm you don’t mind the attribution shifting).

In each entry the Rank and Comment fields will show what that rater/moderater has actually entered (these can also be edited, although that might not be necessary). These fields can be used to constrain the query used on the Paper panel so as to just show raters or moderaters who haven’t finished done their reviews yet for example.

Now click on the Submitter tab. This lists ALL submitters that have proposed papers for the REF. Only the two ? Rater columns and the ? Moderater column are editable. Use these drop-downs, as on the Rater box and Moderater box in the Paper panel (see above) to choose the first and second rater and moderater for a submitter. Done this way then the raters and moderater will be assigned to all the papers proposed by that submitter in one step.

Now click on the Institute tab. This is a configuration table that should only need to be used once. This holds organisation names (exactly as they are defined in PURE) and a short local abbreviation. The data is used to map from organisation affiliations held in PURE so that they can be shown easily against each submitter where relevant. The Include checkbox also needs to be set for this to happen. For each institute you can select a Director and a Deputy Director from the drop-down options. These control the institute directorship access via the REF (Institute) desktop.

Now click on the Overview tab. This has largely identical content to Papers however it is presented in a tabular format which can be easier to use to get an overall or filtered view. You can search on this in the same way as the other panel. For example, to see just the best submitted papers for each author click on the New Query button at bottom right, click in the first row under the column Result and enter "best" then click on the Search button at bottom right. You should then just see the best papers submitted.