Of what quality be the UCSB resources evaluators?
UCSB's response to criticism of its resource evaluations.
Pickens, J.R., "Of what quality be the UCSB resources evaluators?", RFC 545, DOI 10.17487/RFC0545, July 1973, <https://www.rfc-editor.org/info/rfc545>.
@misc{rfc545,
series = {Request for Comments},
number = 545,
howpublished = {RFC 545},
publisher = {RFC Editor},
doi = {10.17487/RFC0545},
url = {https://www.rfc-editor.org/info/rfc545},
author = {J.R. Pickens},
title = {{Of what quality be the UCSB resources evaluators?}},
pagetotal = 2,
year = 1973,
month = jul,
} RFC text
Network Working Group J. Pickens Request for Comments: 545 UCSB Computer Systems Laboratory NIC: 17791 23 July 1973 References: RFC 531,369. 519 OF WHAT QUALITY BE THE UCSB RESOURCE EVALUATORS? A Response to "Feast of Famine" In RFC 531, M.A. Padlipsky complains that the UCSB resource evaluators were derelict in not consulting the Resource Notebook for available documentation. In addition, Padlipsky equates the goals of the resource evaluators to the goals of the software repository advocaters. A misunderstanding exists and perhaps, with this note, may be cleared. To respond to Padlipsky's example of UCSB botching login attempts let me make two comments. First, more people than the resource evaluators were accessing the ARPANET. The group of evaluators, at least, knew the login procedure from the Resource Notebook. (By the way, we do have a Multics Programmers Manual.) Second, the OLS TELNET echoes no lower case, which can generate confusion. Even UCSB's technical liaison, after consulting the Resource Notebook, managed to botch his login. The first law of resource evaluation, at least for UCSB evaluators, is "read the Resource Notebook!" (RFC 369, incidentally, was based on a Resource Notebook that was barren compared to the notebook of today.) Questions left unanswered by the Notebook are resolved by accessing online documentation first at the NIC and second at the site being evaluated. If, after all this effort, questions still exist, then a consultant is contacted. Consultation may be either online or by telephone and may entail purchasing appropriate user manuals (for some of the resources we evaluated, no manuals existed). Our approach has been to consult the most publicly available documentation first. Only if the advertised paths fail do we resort to personal contact with a (busy) technical liaison. If technical liaisons wish to be consultants for uninitiated users and feel that this is their role we will gladly modify our behavior. There certainly is a meal, to use Padlipsky's analogy, of documentation already available on the Network. However, a meal is no good without silverware. Site specific and function specific MINIMANS (see RFC 369 and RFC 519) are attempts to provide this tableware. Our first-pass MINIMANS are available on request for those who would like to see what we are trying to do. Resource evaluators are concerned with much more than documentation. A closer reading of prior RFC's would have shown that we investigate dynamic phenomenon such as help facilities, online consultation, response time, reliability, and human engineering. We make suggestions for improvement. Indeed we see ourselves, at least for UCSB users, in the role of plain clothes inspector. We don't claim absolute efficiency but we do claim good intent and good results. We have spurred improvements at local as well as foreign network sites. We apologize to any we may have offended in the past with poor reviews. We are learning, continually, how best to say things in a constructive rather than destructive way. [ This RFC was put into machine readable form for entry ] [ into the online RFC archives by Javier Echeverria 2/98 ]
ISO Plain Language
On this page
§1Replying to the Criticism
John Pickens responds to comments in RFC 531 about UCSB resource evaluators and their use of the Resource Notebook. He says there is a misunderstanding about the evaluators' goals and notes that other people, not only the evaluators, were using the network.
He also says the OLS TELNET did not echo lowercase characters, which could confuse users during login.
Pickens says the criticism reflects a misunderstanding of the evaluators' work. He also points to a TELNET behavior that could make login confusing.
§2The Evaluation Process
Pickens says UCSB evaluators begin by reading the Resource Notebook. If it does not answer their questions, they consult online documentation at the NIC and then at the site being evaluated; only after that do they contact a consultant.
Consultation might be online or by telephone and could include buying user manuals. Pickens says they prefer public documentation before contacting a technical liaison.
The evaluators start with the Resource Notebook, then check online documentation at the NIC and the site. They contact a person if questions remain.
§3What Evaluators Examine
The author says resource evaluators examine more than documentation. Their work includes help facilities, online consultation, response time, reliability, and human engineering, and they make suggestions for improvement.
Pickens says they are learning how to make their reports constructive and apologizes to anyone they may have offended.
Evaluators test how a service behaves and how it supports users, not just what its documents say. Pickens says they aim to make their feedback constructive.