4 conttnutty and tnnovatton tn reterence retrteval …...wor+45 wor-45 com/tnd r+d soctety act/res...

4
10, 4 CONTtNUtTYANDtNNOVATtONtNREtERENCE RETRtEVALtNTtESOCtALSCtENCES : tllustrationstromTheUniversal Reference System ALtRED DEtRAZtA ThecomputerizedUniversalReferenceSystem,nowinde- pendentlyorganized, haditsbeginnings in theABS biblio- graphic referencetools,suchastheABStuidetoRecent PublicationsintheSocialandBehavioralSciencesand "NewStudies,"which isaregularfeatureoftheABS . Alfredde trazia, founderandformereditorof theABS,is Professoroftovernmentat NewYorkUniversity .Thisar- ticle,reviewingtheURS andautomatedreferenceservices ingeneral,isexcerptedfromhis addressatthe American Library Association ConventioninJuly, 1966 . ∎TheUniversalReferenceSystem (URS)isaimedatachiev- ingthedesiresofbibliographers,librarians,andscholars .'ttis acomputerizeddocumentationandinformationretrievalsys- tememployingcitationsofmaterialsaboveamodestlevelof quality,appearinginallofthesocialsciences,annotated,and indexedbyauthor ;itincludesasetofstandarddescriptorsthat arederivedfromamastersystemoftopicsandmethodologies andfromtheuniquefacetsoftheworksbeingscreened . ThefirstvolumeoftheURSserieson"PoliticalScience, tovernment&PublicPolicy"is tnternationalAffairs, published in1965 . 2 tnternationalAffairs isa1,200pagecomputerized indextosome3,030selectedbooks,articles,andpamphlets onforeignpoliticsandinternationalrelations .ttsvaluederives inpartfromthedepthofitsindexing ."Whereasmostkeyword ; indexestobibliographiesrelysolelyontitles(perhapsaug- mentedwithadditionalkeywords),theURSinputisnotonly annotatedbutisalsotaggedwithanaverageoftwenty"Stand- ard"and"Unique"descriptorsperitem .Moreover,fromtwo tofourofthesedescriptorsareidentifiedas"Critical"descrip- torsandaregivenspecialtreatmentinindexing .Toillustrate thenatureofthepunchcardinputtoURS,someofthe3,030 entriesfromits"Cata!ogue"ofcontentsarereproducedin tigure1 . tnordertosavespaceinthecomputerprintout,mostofthe URSdescriptorshavebeentruncatedincodewords - prompt- ingthevolumetobecalleda"CODEX"insteadofan"index ." TheprogramforprocessingtheURSentriesandproducing thekeywordindexwaswrittenforthetBM1401/1410com- puters .Essentially,theprogramisatypeofkeywordindexing 4 usingthedescriptorsaskeywords .Sampleoutputfromthe URS tnternationalAffairs CODEXisgivenintigure2 . Thesectionoftheprintoutchosenforreproductionin tigure2containstheitemstaggedwithCOMPUT/tR("me- chanicalandelectronicdevelopmentsforinformationre- trieval")asadescriptor .Ofthetwelveentriestaggedwith COMPUT/tR,twohavethecodewordasa"Critical"descrip- tor(listedinthesecondcolumn) .AssumingtheCODEX userisinterestedinonlythesetwoitems,hewouldnotetheir identificationnumbers - AO182andA0610 - andobtaincom- pletecitationsandaccompanyingannotationsfromtheCODEX Catalogue(tigure1 ) . tEBRUARY, 1967 V A0181-AO193 EXAMtNATtONOtTtREEECONOMtCSYSTEMSASALTERNATtVE ANDCOMPETtTtVEMODELStORTtEECONOMtCDEVELOPMENTOt UNDERDEVtLOtEDCOUNTRtES .PARTtCULARLYOtTtOSEtNAStA . SUttESTSTtATTtEtNDtANEXAMPLEOtttttPRtORtTYTOWEL- tARLtOALSANDLtMtTATtCNSONMARKETtORCESBYPARTtAL PLANNtNtANDSOMEDtRECTCONTROLSMtttTBEtOLLOWED . CttNJAPS/AStAEC/UNOEVECO/CEVMARKETWEALTt ... .ECO DOC/ANAL . A0182NORTtR .C .ETAL . CONTENTANALYStS AtANDBOOKWtTtAPPLtCATtONStORTtE STUDYOttNTERNATtONALCRtStS . EVANSTON-NORTtWESTERNU .PR . .1963 .182PP . .$2 .95 . AVALUABLEtNTRODUCTtONTOA USEtUL RESEARCtTECtNtQUE . tNCLUDESCONCRETEtLLUSTRATtONSPLUStUtDES'tORDECtDtNt WtETtER .WtEN,ANDWtATtORMOtCONTENTANALYStSStOULDBE USED .'TtEEXAMPLESCOMEtROMRESEARCtONTtEORtttNSOt WORLDWARtANDONCONTEMPORARYStNO-SOVtETRELATtONS . SPECtALtORMSDtSCUSSEDtNCLUDE TtECONVENTtONALtREQUENCY COUNTANDQUALtTATtVEtCENTtttCATtONS .O-SCRTS .PAtRCOM- PARtSONS .ANDEVALUATtVEASSERTtONANALYStS . CttNJAPCOMEUR+WW1MOD/EURUSSRtNT/ORtROUTtNETEC/DEV COMMUNPERCEPTRtttD/tLEX ALL/VALS COERCEDOMtNEDU/PROP . . .. POLQUANTTESTSCON/ANALCOMPUT/tRStMULtEN/LAWStEN/METt . AOtB3LERCtEC .O .JR . .SAtD A .A . CONCEPTSOttNTERNATtONALPOLtTtCS . r ENtLEWOOD CLtttS PRENTtCE-tALL .1963,314PP . .$4 .95 . SYSTEMATtCDEVELOPMENTOtTtECONCEPTSOtTtESTATE ANDtOREttNPOLtCY .TtENOTtONOtPOLtTtCSASTtECRUCtAL tORMOttNTERSTATERELATtONSttPS,ANDSUBSTANTtVEPROBLEMS OttNTERNATtONALPOLtTtCSSUCtASWAR .tDEOLOtY .TECtNOLOtY . TRADE .ANDCOMMUNtCATtON . WOR+45WOR-45tNT/ORttNT/TRADEDELtB/tPEX/STRUCLAW ROUTtNETEC/DEVATTtTORD/tREEPWRRESPECTCOERCEECO/TAC LEttT WAR .... POLDOC/ANALSTERTYPtEN/LAWS . tigure 1 . CATALOt Ot tTEMS tROM tNTERNATtONALAttAtRS, VOLUME t Ot TtE UNtVERSALREtERENCESYSTEM, PAtE 14 tnternationalAffairs isURS'sfirstpublishedvolume .ttis intendedthatURSbecomenotonlyapublisherofasmany majorandminordisciplinaryandproblem-orientedbibliog- raphiesastheremaybeaneedforinthesocialsciences,but alsomakeavailableanansweringservicetoindividualscholars, librarians,andotheragencies,bylargelyautomaticmeans . Manyclaimsaremadeforthesystemasinitiatedand planned,butitwouldbeimmaterialaswellaspresumptuous togointothemhere .Rathertshouldliketoreportandgen- eralizesomeoftheexperiencethatwehavehadinbuildinga newoperationforthetime-honoredworldofbibliographic researchandinintroducinginnovations . CONTtNUtTYtNREtERENCERETRtEVAL ttissaidthateveryinventionhasmoreelementsofthe oldthanofthenewandthastentoaffirmthispropositionwith regardtotheURS .tdosoinordernotonlytocreditthepast, 1

Upload: others

Post on 17-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 4 CONTtNUtTY AND tNNOVATtON tN REtERENCE RETRtEVAL …...wor+45 wor-45 com/tnd r+d soctety act/res ctotce create oeltb/tp person knowl. . . .stat deep/tnt stand/tnt samp/stz ctarts

10,

4

CONTtNUtTY AND tNNOVATtON tN REtERENCERETRtEVAL t N TtE SOCtAL SCtENCES :

tllustrations trom The Universal Reference System

ALtRED DE tRAZtA

The computerized Universal Reference System, now inde-pendently organized, had its beginnings in the ABS biblio-graphic reference tools, such as the ABS tuide to RecentPublications in the Social and Behavioral Sciences and"New Studies," which is a regular feature of the ABS .Alfred de trazia, founder and former editor of the ABS, isProfessor of tovernment at New York University . This ar-ticle, reviewing the URS and automated reference servicesin general, is excerpted from his address at the AmericanLibrary Association Convention in July, 1966 .

∎ The Universal Reference System (URS) is aimed at achiev-ing the desires of bibliographers, librarians, and scholars .' tt isa computerized documentation and information retrieval sys-tem employing citations of materials above a modest level ofquality, appearing in all of the social sciences, annotated, andindexed by author ; it includes a set of standard descriptors thatare derived from a master system of topics and methodologiesand from the unique facets of the works being screened .

The first volume of the URS series on "Political Science,tovernment & Public Policy" is tnternational Affairs, publishedin 1965 . 2 tnternational Affairs is a 1,200 page computerizedindex to some 3,030 selected books, articles, and pamphletson foreign politics and international relations . tts value derivesin part from the depth of its indexing ." Whereas most keyword ;indexes to bibliographies rely solely on titles (perhaps aug-mented with additional keywords), the URS input is not onlyannotated but is also tagged with an average of twenty "Stand-ard" and "Unique" descriptors per item . Moreover, from twoto four of these descriptors are identified as "Critical" descrip-tors and are given special treatment in indexing . To illustratethe nature of the punchcard input to URS, some of the 3,030entries from its "Cata!ogue" of contents are reproduced intigure 1 .

tn order to save space in the computer printout, most of theURS descriptors have been truncated in code words - prompt-ing the volume to be called a "CODEX" instead of an "index ."The program for processing the URS entries and producingthe keyword index was written for the tBM 1401/1410 com-puters. Essentially, the program is a type of keyword indexing 4

using the descriptors as keywords . Sample output from theURS tnternational Affairs CODEX is given in tigure 2 .

The section of the printout chosen for reproduction intigure 2 contains the items tagged with COMPUT/tR ("me-chanical and electronic developments for information re-trieval") as a descriptor . Of the twelve entries tagged withCOMPUT/tR, two have the code word as a "Critical" descrip-tor (listed in the second column) . Assuming the CODEXuser is interested in only these two items, he would note theiridentification numbers - AO 182 and A0610 - and obtain com-plete citations and accompanying annotations from the CODEXCatalogue (tigure 1 ) .

tEBRUARY, 1967

V

A0181-AO193

EXAMtNATtON Ot TtREE ECONOMtC SYSTEMS AS ALTERNATtVEAND COMPETtTtVE MODELS tOR TtE ECONOMtC DEVELOPMENT OtUNDERDEVtLOtED COUNTRtES . PARTtCULARLY Ot TtOSE tN AStA .SUttESTS TtAT TtE tNDtAN EXAMPLE Ot tttt PRtORtTY TO WEL-tAR L tOALS AND LtMtTATtCNS ON MARKET tORCES BY PARTtALPLANNtNt AND SOME DtRECT CONTROLS MtttT BE tOLLOWED .

CttNJAP S/AStA EC/UNOEV ECO/CEV MARKET WEALTt . . . .ECODOC/ANAL .

A0182 NORTt R .C . ET AL .CONTENT ANALYStS • A tANDBOOK WtTt APPLtCATtONS tOR TtESTUDY Ot tNTERNATtONAL CRtStS .EVANSTON- NORTtWESTERN U . PR . . 1963. 182 PP . . $2.95 .

A VALUABLE tNTRODUCTtON TO A USEtUL RESEARCt TECtNtQUE .tNCLUDES CONCRETE tLLUSTRATtONS PLUS tUtDES 'tOR DECtDtNtWtETtER . WtEN, AND WtAT tORM Ot CONTENT ANALYStS StOULD BEUSED .' TtE EXAMPLES COME tROM RESEARCt ON TtE ORtttNS OtWORLD WAR t AND ON CONTEMPORARY StNO-SOVtET RELATtONS .SPECtAL tORMS DtSCUSSED tNCLUDE • TtE CONVENTtONAL tREQUENCYCOUNT AND QUALtTATtVE tCENTtttCATtONS . O-SCRTS . PAtR COM-PARtSONS . AND EVALUATtVE ASSERTtON ANALYStS .

CttNJAP COM EUR+WW1 MOD/EUR USSR tNT/ORt ROUTtNE TEC/DEVCOMMUN PERCEPT RtttD/tLEX ALL/VALS COERCE DOMtN EDU/PROP . . . .POL QUANT TESTS CON/ANAL COMPUT/tR StMUL tEN/LAWS tEN/METt .

AOtB3 LERCtE C . O . JR . . SAtD A . A .CONCEPTS Ot tNTERNATtONAL POLtTtCS . rENtLEWOOD CLtttS • PRENTtCE-tALL . 1963, 314 PP . . $4.95 .

SYSTEMATtC DEVELOPMENT Ot TtE CONCEPTS Ot TtE STATEAND tOREttN POLtCY . TtE NOTtON Ot POLtTtCS AS TtE CRUCtALtORM Ot tNTERSTATE RELATtONSttPS, AND SUBSTANTtVE PROBLEMSOt tNTERNATtONAL POLtTtCS SUCt AS WAR . tDEOLOtY . TECtNOLOtY .TRADE . AND COMMUNtCATtON .

WOR+45 WOR-45 tNT/ORt tNT/TRADE DELtB/tP EX/STRUC LAWROUTtNE TEC/DEV ATTtT ORD/tREE PWR RESPECT COERCE ECO/TACLEttT WAR . . . . POL DOC/ANAL STERTYP tEN/LAWS .

tigure 1 . CATALOt Ot tTEMS tROM tNTERNATtONAL AttAtRS,VOLUME t Ot TtE UNtVERSAL REtERENCE SYSTEM, PAtE 14

tnternational Affairs is URS's first published volume. tt isintended that URS become not only a publisher of as manymajor and minor disciplinary and problem-oriented bibliog-raphies as there may be a need for in the social sciences, butalso make available an answering service to individual scholars,librarians, and other agencies, by largely automatic means .

Many claims are made for the system as initiated andplanned, but it would be immaterial as well as presumptuousto go into them here . Rather t should like to report and gen-eralize some of the experience that we have had in building anew operation for the time-honored world of bibliographicresearch and in introducing innovations .

CONTtNUtTY tN REtERENCE RETRtEVALtt is said that every invention has more elements of the

old than of the new and t hasten to affirm this proposition withregard to the URS. t do so in order not only to credit the past,

1

Page 2: 4 CONTtNUtTY AND tNNOVATtON tN REtERENCE RETRtEVAL …...wor+45 wor-45 com/tnd r+d soctety act/res ctotce create oeltb/tp person knowl. . . .stat deep/tnt stand/tnt samp/stz ctarts

CON/ANAL . . . . QUANTtTATtVE CONTENT ANALYStS • OBJECTtVE,SYSTEMATtC AND QUANTtTATtVE DESCRtPTtON Ot TtE MANttESTCONTENT Ot COMMUNtCATtON .

tigure 2. tNDEX Ot DOCUMENTS tROM tNTERNATtONAL AttAtRS,VOLUME t Ot TtE UNtVERSAL REtERENCE SYSTEM, PAtE 395

but to apologize for the limitations of the invention . We makea point of separating books and articles in our tndex becausethat is the way that the bibliographers have worked and thatis the way in which documents are published ; our first prod-ucts are printed and bound in conventional form because thatis the way that most bibliographies are published . We use aconsiderable number of the descriptors in our system becausethese are the locating words that researchers and librarians haveordinarily employed to index documents . We limit our capac-ities and our designs because the market for bibliographicmaterials is not yet willing to pay for their cost of developmentand production .

Yet even if we wished to move out as fast and far as pos-sible we should discover that the new invention is not givingpeople what they want. As soon as a new model of information

2

machine is offered, some people who have been satisfied witha horse and buggy want an air-conditioned amphibious verticaltakeoff Cadillac .

The idea of unlimited capital spending for the developmentof reference retrieval systems has inspired the imagination ofmany observers of the developing scene, and one of the prob-lems an innovator must contend with is the demand for com-plicated and high-cost services on a low payment plan. torexample, the type face of the Universal Reference System thusfar has been a clear but conventional computer print, allcapitals and not unlike a typewriter . There is already availablea machine that would use lower as well as upper case letters,but the reprogramming and reorganization that would be neces-sary is too much for the cost structure to bear at the moment .The several thousand dollars of extra cost involved would meannothing under a large scale government subsidy because itwould not have to be passed along to the purchaser .

Other criticisms levelled at the URS and other systemscan be met only by much more substantial costs . Thus, tointroduce automatic annotating and indexing of documentswould require as much or more perhaps than the developmentof the URS to date (about $50,000, that is) . t should say thatthere is a real question here as to the wisdom of using thecomputer to read and abstract documents, granted the bril-liance and utility in other respects of the work of Philip Stone,who has produced the teneral tnquirer System,5 and otherscientists . tn the immediate future, at least, automatic indexingand annotating are not flexible and subtle enough for our pur-poses, and the make ready time for the material to be processedby machine is in itself too costly .

The continuous process of relating innovations to the habitstructures and expectations of the using clientele does not al-ways present such difficult problems, even in the immediatesense. A couple of thousands of dollars and the inescapablerequirement of ingenious programmers and designers shouldenable us to organize the second CODEX of the URS some-what differently than the first without losing the continuity anduse of the materials already put into the system in the processof producing the first volume .

tt does not take much to organize the catalogue by theauthor's last name instead of by number, as was the case inthe first CODEX . This will eliminate the special need for anauthor's index and permit one to look up an author's nameto see how he is represented in the bibliography . Nor is theremuch difficulty involved in carrying the author and title ofthe work along with every single index entry governing adocument; here the problem is one of the utility of printingmore descriptors as opposed to printing the title .

tere is how the index of the URS Codex tt on LegislativeProcesses, Representation, and Decision-Making will probablybe set up :

tNTELLttENTStA

B67/A4001

DtLLON, B . CAUSES Ot PROTEST tN OUR TtMESUS+45

VOL/ASSN

tACE/tP

PERt/ART . . .tNT/ORt

ATTtTPEACE

EC/DEV

EC/UNDEV

SUPEREtO . . . .MYSTtC

POL

ART/METt

tUM

BtOt

A typical Codex of a field of social science (such astnternational Affairs) will contain about 1,000 pages, 1,500to 4,000 annotated document entries, perhaps 45,000 indexentries of the above type, and will rotate on a biennial schedule .Codex tt on Legislative Processes is scheduled for publicationin the summer of 1967. An updated version of tnternationalAffairs will also be published later in the new format . Ourplans now are to issue eight other "sub-codex" volumes, eachwith about 500 items collected from 1966 and 1967 references .tn the winter of 1967-1968, we intend to publish full-lengthCodexes on each of the same eight topics, including public

TtE AMERtCAN BEtAVtORAL SCtENTtST

COMMUNtST COUNTRtES (EXCEPT CttNAt . . . . SEE CON

COMPANY, LARtE OR MtDDLE-StZED (50 EMPLOYEES OR MORE) . . . .SEE Lt/CO

COMPANY, SMALL . (50 EMPLOYEES OR LESSt . . . . SEE SML/CO

COMPETENCE, PRACTtCAL tAS tOAL) . . . . SEE SKtLL

COMPUT/tR . . . . MECtANtCAL AND ELECTRONtC DEVELOPMENTS tOR tNtOR-MATtON RETRtEVAL .

COMPUT/tR8 •5 1

ATTtTSAMP

WOR+45 WOR-45 COM/tND R+D SOCtETYACT/RES CtOtCE CREATE OELtB/tP PERSONKNOWL . . . .STAT DEEP/tNT STAND/tNTSAMP/StZ CtARTS STERTYP A1322

COMPUT/tR0•5 2

PERSONPSY

tUT WOR+45 CULTURE COMMUN PERCEPT . . . .CONT/OBS REC/tNT PERS/TEST SAMPLAB/EXP tEN/METt A1023

COMPUT/tRBOSS

TEC/DEVSOCCAP/tSM

tUT USA+45 USA-45 ECO/DEV LABORSOCtETY ACT/RES PLAN ROUTtNE WORKALL/VALS ECO/TAC . . . .ECO STAT TRENDCtARTS SOC/EXP A1532

COMPUT/tR8*59

COMSTRUCT

MOD/EUR ECO/DEV SOCtETY PLAN ATTtTSOC/tSM COERCE COLD/WAR ECO/TAC

USSR EDU/PROP . . . .ART/METt ECO ttST SOCCONCPT STAT DOC/ANAL tEN/LAWStEN/METt ANTtOL A0805

COMPUT/tR8 •60

tNT/ORtJURtD

tUT WOR+45 AOJUO CONSTN CONSULT PLANSTRUCT TEC/DEV RtttD/tLEX KNOWL

SPACEtNT/LAW

ORD/tREE PWR . . . .TECtNtC tEOt MtTNEW/tDEA TREND DOC/ANAL A0451

COMPUT/tR8*60

MARKETADJUD

EUR+MMt tUT ECO/DEV tNT/TRADE NAT/tSOCtETY VOL/ASSN ADMtN CONSULT PLAN

EECtNT/LAW

STRUCT TEC/DEV ATTtT RtttD/tLEX PMREtt/TAC . . . .ECO MtT NEW/tDEA STATTREND StMUL A0591

COMPUT/tR8 •6 3

WOR+45POL/PAR

COM/tND EC/UNDEV ECO/DEV NAT/t SECTCtOtCE CONSiN CT/SYS EX/STRUC tORCESLEttS TOP/EX STRATA PMR WEALTt . . . . POLSTAT CON/ANAL CtARTS StMUL A0147

COMPUT/tRB-63

COMPUT/tR CttNJAP COM EUR+WW1 MOO/EUR tNT/ORtUSSR

ROUTtNE TEC/DEV COMMUN PERCEPTRtttD/tLEX AlL/VALS COERCE DOMtNEDU/PROP . . . . POL QUANT TESTS CON/ANALStMUL tEN/LAWS tEN/METt A0182

COMPUT/tRS-59

COMPUT/tROECtSN

tUT WOR+45 NAT/t R+D ACT/RES CtOtCECREATE ATTtT PWR . . . .POLtCY POL CONCPT

DtPLOM STYLE KNO/TEST TREND tYPO/EXPtEN/METt A0610

COMPUT/tR5•6 3

POLDECtSN

tLtT UNtV CONSULT PLAN SKtLL COERCEDETER DOMtN EDU/PROP WAR . . . .QUANTtYPO/EXP A1219

COMPUT/tR5 •6 3

PLANTEC/DEV

COM tUT USA+45 DtST/tND ECO/OEVMARKET RtttD/tLEX CAP/tSM SOC/tSM

USSR WEALTt ECO/TAC . . . . MATt STAT TRENDDOC/ANAL A1767

COMPUT/tRS-64

tORCESStMUL

USA+45 NAT/t ACT/RES TEC/DEV TOP/EXKNOWL ORD/tREE PMR COERCE . . . .PttL/SCt

WAR POL MATt TtME/SED CtARTS LAB/EXPDECtSN A0285

Page 3: 4 CONTtNUtTY AND tNNOVATtON tN REtERENCE RETRtEVAL …...wor+45 wor-45 com/tnd r+d soctety act/res ctotce create oeltb/tp person knowl. . . .stat deep/tnt stand/tnt samp/stz ctarts

opinion, law, economic regulation, etc . Our experiences inpublishing these additional volumes should yield continualimprovements in URS products .

Such changes from volume to volume constitute actionresearch with a vengeance; each new publication can be com-pared with its predecessors. Dictionary cross-referrals can beincreased; subcategories can be introduced into the master clas-sification system; and hundreds of proper names can be intro-duced into the index . One of the serious but corrigible defectsof the first CODEX was the failure to devise an inexpensivemethod of carrying forward into the final printout the refer-ences to major personalities and places treated in the documentsbeing surveyed and reported .

tn general then the problem of variety in the format ofthe catalogue and index is a matter for continuous adjustmentand all that we need is patience with the current product andresearch on innovations . tinally, there may arise a consensuson what the best format should be, or better still, the abilityto make available on order several format possibilities, anyone of which is capable of emerging from the computer printerfollowing a simple instruction .

tn this process of experimentation and living with theproduct, some complaint will simply disappear as it becomesobvious that reference retrieval is not going to bring a paradisein bibliographic research . Thus, the very richness of items inthe URS tndex has been the target of criticism among someobservers who have failed to realize that the ordinary bibliog-raphy is so scantily indexed that any given category of indexentry simply does not reflect all the works in the cataloguethat deal significantly with the index term ; this is the proverbialembarrassment of riches . The way out of this is greater qualita-tive discrimination among items and finer theoretical discrimi-nations among subconcepts in social science so that words havemore precise meanings at the same time that words of thesame meaning are coalesced . This process of experimentationand adjustment can only lead to the improvement of the waysof thinking and method in social science as a whole, as wellas in bibliographical work .

One of the major objections to the Universal ReferenceSystem has been that there is no large need for it . The PublicAffairs tnformation Service, the Book Review Digest, TheNew York Times, and several special bibliographies operate inthe field . There is no lack of material to which students can bereferred. But the computerized reference services can do usefulthings, even by the old ideals . Once the library is reorganizedwith some initial capital investment, it can provide the oldservices more completely and with less work and expense . Atleast a million students might each year find their work ofpreparing lists of titles considerably expedited .

The few creative scholars who do most of the consequentialreading and writing will be most helped, however, for theywill be able to call upon an instant service that will be manytimes as powerful as the o'd way of bibliographic research,exactly analogous to the powerful Cadillac that at a touchof a button puts several hundred horses to straining at theharness .

tt is to the advantage then of the best scholars and bestlibrarians to profit from the irrational excesses inherent in anynew movement for technological change to acquire equipmentwhich, if they tried to purchase it for themselves, would in-volve them in long and useless expositions before the budgetaryauthorities of universities, institutes, and agencies . The com-puterized bibliographic system is a soul-appeasing thearpy forthe academic mass and a necessity for the serious scholar .

tNNOVATtON tN REtERENCE RETRtEVAL

Much work on the subtlety of expression in annotatingand indexing remains for the future. When the coder of a docu-

tEBRUARY, 1967

ment is asked to summarize it and then to index it accordingto the master formula by ticking off the relevant descriptors,he acquires momentarily a concrete sense of the work . Buthe can only lend part of his appreciation of the document tothe system for the final combining, permuting and printing .The syntax, and therefore much of the meaning, is lost in thesuccessive transformations of the material thought . J . C . tardinand others have worked on the problem, and t have given itsome attention with a view towards lending enriched andprecise meaning to the annotations, index, and groups of items .

We found from examining our coders' annotations thatthey used the same verbs over and over again . A couple ofdozen verbs seemed to suffice for half the relationships thatthey needed for writing a seventy-five word annotation . Thesewould be words like "describes" and "compares" and "ana-lyzes." One step toward a more subtle rendering of the indexwould be to code such connecting words and reproduce themmechanically between the descriptor topics and methods . Onecould also experiment with the design of a study space towhich the coder could affix descriptors in proper topologicalrelationship to one another, and have the machines reproduceeach work's annotation and indexing as a kind of chart .

Our present inclination, however, especially if we are topreserve continuity with the existing programming, is to movein the direction of grouping works by shared combinations ofindicators or descriptors, printing out those groupings that arelikely to be most useful to a given bibliographic search . Thus,the machines would be programmed to shuffle through theirtapes or discs to produce lists of all articles on nationalism inunderdeveloped countries before World War tt that deal withpolitical parties and leadership and that were the product offield research by sociologists .

The major reason why we have not gone this f ;V alreadyis because the subsequent printouts in a large subject area suchas the international area would be so voluminous as to makea single-volume printing impossible . tence simpler groupingshave been resorted to, leaving some of the work of combiningto the naked eye of the reader of the CODEX. The reader doesthe task by checking each item under one of the desired de-scriptor headings, such as field research, goes directly to thearticles written before World War tt and scans the items inthe group for all the desired descriptors . This can be done atthe rate of about one hundred a minute, so the loss of time isnot excessive . Then the reader or his typist extracts the itemscontaining the combination by resort to the catalogue andprepares his own bibliography on the detailed specific subjectof concern. These latter tasks could be taken care of by fullautomation if there were sufficient demand to create a multi-tude of lists at a low price .

The question whether to provide bound volumes or listsis not so much one of technique as it is of costs . The finalform in which the product can be made available to the useris a decision to be arrived at after many considerations ofwho the users might be, how many of them there are, how muchthe tailored product will cost, whether local co-operatingunits can be set up, whether a subscription system is possible,and so forth .

We are beginning the URS with bound books because thatis the conventional way and requires the least break withtradition and habit. The problem of updating is serious onlyin the cost sense; bound volumes supplementing the originalvolume cost almost as much as publishing the whole bibliog-raphy in a second edition with deletions and additions, bothaccomplished by machine. The only expense of republishingthe whole with amendments will be the cost of the total printingand binding job of, say, a 1,200-page book as compared witha 400-page book . (Or, let us guess, between $35 and $30 .)

3

Page 4: 4 CONTtNUtTY AND tNNOVATtON tN REtERENCE RETRtEVAL …...wor+45 wor-45 com/tnd r+d soctety act/res ctotce create oeltb/tp person knowl. . . .stat deep/tnt stand/tnt samp/stz ctarts

As soon as conditions permit, a subscription and specialorder service will be established by the URS and presumablyby any other system in like circumstances . This would enablethose users who are able to afford more sophisticated andcomplete services to place orders for special listings as referredto earlier . A professor may order for his classes special bibliog-raphies of up-to-date literature, divided more or less accordingto his outline of lectures or conferences, the URS providinghim with a list of works perfectly organized to correspond toeach of his major subject headings .

As t have said, we possess this capacity as well as manyothers in the system at the present time . Only the very slowturnover of working capital delays the fulfilment of such ca-pacities . And t should add that it should be possible for anyother group to achieve the same position within a year or twowith a hundred thousand dollars, in view of the programs,equipment, experience, and skills that have become available .

Not too far away lies the prospect of console hookups toreference retrieval centers from libraries and other users .t am not so sure of the economics of this setup but t am of theopinion that should a bonanza in the way of a governmentsubsidy be discovered, so that the capitalization problem ofresearch and development might be ignored, the URS or an-other similar group might combine with groups of advancedtechnical capacity in the field of information retrieval . Theycould together establish very quickly a national system ofreference retrieval that would let a central computer receiveinstructions or requests from subscribers anywhere and fill therequest by listings on a telescreen, and when corrected, byprinting out the desired information in the office of the sub-scriber . tarold Borko of Systems Development Corporationhas been rehearsing these possibilities recently ; others mayalso be on to this kind of system .

The awesome efficiency and effectiveness of such systemsas t have envisaged here stand in sharp contrast to some ofmy cynical remarks about the uses of bibliographies . t wouldnot retract the remarks ; t believe that we should not be abashedby our creations . We know, after all, how enormous and com-plicated is the system that is used to get millionaires to theVirgin tslands for a weekend of restless play ; we know howmany millions of dollars go annually into the purchase of afew paintings and a few rare books of which copies are readilyavailable ; we know what a crazy-quilt of agencies and money

COMPUTERS, TRADtTtONAL RESE Ct, AND TtEAMERtCAN COUNCtL Ot EARNED SOCtETtES

iTtOMAS J . CONDON

With a grant from tBM, the American Council of LearnSocieties is working toward providing automated bi io-graphic services to scholars in the humanities an . ocialsciences. Dr. Thomas Condon, ExecutiveAssociat- af ACLS,describes some of the first steps being taken in t s direction .

∎ Throughout the nation the cause of the manities is sud-denly being championed ; indeed, at time almost with a ven-geance. Centers or institutes for the dy and advancementof the humanities have come int . .eing. The Eighty-ninthCongress, in an exuberant moo

at surprised many, passed

4

it takes to cure a case of poverty. With these and many otherexamples in mind, it would be altogether too self-abasing todeny the investment of money and energies required to buildsome libraries that correspond to and convey an image ofmodernity and of the future of intellectual work. We shall notexpire if all the things we wish libraries or scholars to be donot come about. But we shall be happy if they do happen.And it is fun to try to make them over in some new vision.And there is no doubt but that more useful studies will befacilitated than are presently possible .

REtERENCES

1 . Alfred de trazia, "The Universal Reference System," AmericanBehavioral Scientist, Vttt (April, 1965), 3-14 .

2. tnternational Affairs, Volume t of the Political Science, tovern-ment & Public Policy Series of the Universal Reference System(Box 262, Cooper Station, New York, N .Y . 10003 : UniversalReference System, 1965), 1205 pp .

3 . This description of the tnternational Affairs index is adaptedfrom Kenneth Janda, "tnformation Retrieval : Applications toBibliographies on tnternational and Comparative Politics," apaper presented at the Computers and the Policy Making Com-munity tnstitute, Lawrence Radiation Laboratory, April 4, 1966 .

4. See Kenneth Janda, "Keyword tndexing for the Behavioral Sciences," American Behavioral Scientist, 7 (June, 1964), 55,.58 .

5 . Philip J . Stone, et al., The teneral tnquirer: A Computer Ap-proach to Content Analysis (Cambridge, Massachusetts : M .t .T .Press, 1966) . Also see Erwin K. Scheuch and Philip J . Stone,"The teneral tnquirer Approach to an tnternational RetrievalSystem for Survey Archives," American Behavioral Scientist,7 (June, 1964), 23-28 .

6. Jean-Claude tardin, "A European Research Program in Docu-ment Retrieval," American Behavioral Scientist, 7 (June, 1964) ; •12-16. Also see Jean-Claude tardin, Syntol (New Brunswick, "New Jersey : traduate School of Library Service, Rutgers Uni-versity, 1965) .

7 . Cf. t. Borko, The Conceptual toundations of tnformationSystems (Santa Monica, California : Systems Development Cor-poration, May 6, 1965) 37 pp . and Noah S. Prywes, "Browsingin an Automated Library through Remote Access," in M . A .Sass and W . D. Wilkinson, eds ., Computer Augmentation oftuman Reasoning (Washington, D.C . : Spartan, 1965), pp .105-130 . Also see tarold Borko and Lauren B. Doyle, "TheChanging torizon of tnformation Storage and Retrieval,"American Behavioral Scientist, 7 (June, 1964), 3-8 .

legislation in 1965 establishing a public foundation for thearts and humanities . Accompanying this burst of new interestin the humanities and coming to fruition at the same time isthe growth and development of computer-oriented humanisticstudy. We are witnessing the appearance of a number of uni-versity centers or institutes for computer research in thehumanities and social sciences and hear monthly of the estab-lishment of newsletters or journals that promise to tell us whatis going on and to keep us informed . We hear repeatedly -and far too often for this writer - fulminations against thedemonry of the engineers and computer scientists for not hav-

-41