Download - How to read papers
![Page 1: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/1.jpg)
1
How to Read Research Papers?
Xiao QinDepartment of Computer Science and
Software Engineering
Auburn Universityhttp://www.eng.auburn.edu/~xqin
Some slides are adapted from notes by Nitin H. Vaidya at the University of Illinois at Urbana-Champaign
![Page 2: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/2.jpg)
Slide 2 of 38
Three Steps in a Research Project
Identify a Problem
Solve the Problem: a solution
Present the solution
![Page 3: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/3.jpg)
Slide 3 of 38
Why read papers?• To know what’s happening
• Avoid reinventing the wheel – does happen commonly,
too many wheels already
• Find interesting research topics
• Write a good “related work” section
![Page 4: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/4.jpg)
Slide 4 of 38
Why not to read papers?
• Cannot read everything
• Should not read everything
• Can suppress innovation– once you see solutions using a
particular theme, often hard to think differently
![Page 5: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/5.jpg)
Slide 5 of 38
Read or not to read,that is the question
• Read, of course
• Know what’s important
• Know what can be ignored without significant loss of information
![Page 6: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/6.jpg)
Slide 6 of 38
Where to search? • When I was a Master’s student…
• When I was a doctoral student…
• Now…
‹#›
![Page 7: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/7.jpg)
Slide 7 of 38
Where to search papers? (1) • IEEEXplore
• ACM Digital Library
‹#›
![Page 8: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/8.jpg)
Slide 8 of 38
Where to search papers? (2) • Google Scholar
• Personal Web Pages
‹#›
![Page 9: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/9.jpg)
Slide 9 of 38
Where to search papers? (3) • Top Conference Proceedings
AREA: System Technology Premium: SOSP: ACM SIGOPS Symp on OS Principles
OSDI: Usenix Symp. OS Design and Implementation Leading: ICPP: Intl Conf on Parallel Processing ICDCS: IEEE Intl Conf. Distr. Comp Systems Reputable:
GLOBECOM: Global Comm ICCC: Intl Conf on Comp Communication
![Page 10: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/10.jpg)
Slide 10 of 38
Where to search papers? (4) • Top Journals
AREA: System Technology Premium: Jnl of Parallel and Distributed Computing
IEEE Trans on Parallel and Distributed Systems Distributed Computing Leading:
Jnl of Network and Computer Applications Parallel Computing Reputable:
ACM Mobile Computing and Communicatons Review Intl Jnl of High Speed Computing
![Page 11: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/11.jpg)
Slide 11 of 38
What to read? • Major conferences
– Journals are a few years behind, but still can be useful
• Tech reports from active research groups– need to know which groups to look up
• Survey / overview papers– ACM Computing Surveys– CACM, IEEE Computer, Spectrum– more technical - IEEE Personal
Communications, …– newsletters - ACM SIGCOMM, ACM
SIGMOBILE, ...
![Page 12: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/12.jpg)
Slide 12 of 38
Manage References
![Page 13: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/13.jpg)
Slide 13 of 38
References Management SoftwareBiblioExpress
![Page 14: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/14.jpg)
Slide 14 of 38
References Management Software
• EndNote• EndNote Web• Zotero• RefWorks• Reference Manager• Mendeley• See Comparison at:http://workspace.imperial.ac.uk/library/Public/Reference_management_software_comparison.pdf
![Page 15: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/15.jpg)
Slide 15 of 38
What’s in a paper [see also how to write papers:
http://www.auburn.edu/~xzq0001/WritePapers-Part 1.ppt]
• Abstract• Introduction• Motivation• Problem description• Solution• ...• Performance Analysis• Conclusions• Future Work
![Page 16: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/16.jpg)
Slide 16 of 38
How to read a paper? Three levelsKnow why you want to read the paper• To know what’s going on (e.g., scanning
proceedings)– title, authors, abstract
• Papers in your broad research area– introduction, motivation, solution description,
summary, conclusions– sometimes reading more details useful, but
not always
• Papers you may want to improve on– read entire paper carefully
![Page 17: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/17.jpg)
Slide 17 of 38
What to note?
• Authors and research group– Need to know where to look for a paper on
particular topic• Theme of the solution
– Should be able to go back to the paper if you need more info
• Approach to performance evaluation• Note any shortcomings
![Page 18: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/18.jpg)
Slide 18 of 38
So this paper is in print ...
• Be skeptical
• If it sounds too good to be true, it often is ……
![Page 19: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/19.jpg)
Slide 19 of 38
More Advice …
![Page 20: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/20.jpg)
Slide 20 of 38
Three phases to reading
• Determine if there is anything interesting at all in the paper.
• Determine which portion of the paper contains the interesting stuff.
• Should I read the whole paper?– Read the whole paper if necessary.
![Page 21: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/21.jpg)
Slide 21 of 38
Is there anything interesting?
• Ideally, the abstract should tell you this, but frequently it does not.
• Need to jump about– Read conclusion– Read introduction– Look at the bibliography– Glance at the TOC – Table of Content (if any)
![Page 22: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/22.jpg)
Slide 22 of 38
Which portion contains interesting stuff?
• A paper typically outlines its organization at the end of the introduction. – Use this to determine which portion contains
the exciting stuff.
• Quickly scan the titles of each sections in the paper.
![Page 23: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/23.jpg)
Slide 23 of 38
Read the whole paper
• Read with the following questions in mind– How can I use this stuff?– Does this really do what the author claims to
do?– What if the assumptions and choices that the
author made are discarded (or made invalid)?– Is source code available?– More questions ……
![Page 24: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/24.jpg)
Slide 24 of 38
Context and problem statement
• What problems are the author trying to solve or trying to convince you of?
• Are they important problems?– Why?– Why not?
• What is the author’s thesis?
![Page 25: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/25.jpg)
Slide 25 of 38
Related work evaluation
• Does the author describe other work in the field?
• If so, how does this research differ from the other work?
![Page 26: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/26.jpg)
Slide 26 of 38
New idea
• What new idea is the author proposing?– Architecture– Algorithm– Mechanism– Methodology– Perspective
• Is the idea useful and practical?
26
![Page 27: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/27.jpg)
Slide 27 of 38
What to evaluate?
• What need to be evaluated to confirm the worthiness of the new idea?– Runtime– Throughput– Resource utilization– Model validation
27
![Page 28: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/28.jpg)
Slide 28 of 38
How to evaluate?
• How did the author go about conducting the evaluation?– Formalize and prove theorems– Run simulations– Artifact design and construction– Collect traces from existing systems
![Page 29: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/29.jpg)
Slide 29 of 38
Was the evaluation correct and adequate?
• How was the data collection done?• Do you agree with the analysis of data?• Do you agree with the conclusions about
the data?• Do you have any new interpretation of the
data?• Can you suggest new ways to evaluate
the data?
![Page 30: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/30.jpg)
Slide 30 of 38
Assumptions, drawbacks and extensions
• Can you think of other aspects of the idea that need to be evaluated?
• Can you think of extensions or modifications to the idea to improve it?
• How would you evaluate your improvement?
![Page 31: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/31.jpg)
Slide 31 of 38
Assumptions, drawbacks and extensions
• Can you apply the idea or method of evaluation to your own project?
• Do the authors make any assumptions that are not valid or realistic?
• Can you come up with a more general solution that does not rely on one or more of the assumptions?
![Page 32: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/32.jpg)
Slide 32 of 38
Future work
• Does the author indicate how the work should be followed up on?
• Does the paper generate new ideas?• Does the paper implicitly or explicitly
provide a new way of doing other things or of thinking about problems?
![Page 33: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/33.jpg)
Slide 33 of 38
SummaryIf you remember nothing else:• Where to search papers• Scan papers• Read papers with questions in mind
![Page 34: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/34.jpg)
Slide 34 of 38
Download the presentation slideshttp://www.slideshare.net/xqin74
Google: slideshare Xiao Qin
![Page 35: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/35.jpg)
Slide 35 of 38
Further Researchhttp://www.eng.auburn.edu/~xqin
![Page 36: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/36.jpg)
Slide 36 of 38
My webpagehttp://www.eng.auburn.edu/~xqin
![Page 37: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/37.jpg)
Slide 37 of 38
Download Slides at slidesharehttp://www.slideshare.net/xqin74
![Page 38: How to read papers](https://reader037.vdocuments.net/reader037/viewer/2022102901/5549b1edb4c905bc6d8b48a8/html5/thumbnails/38.jpg)
Slide 38 of 38
Questions