abezerianos - career seminar - lecture 1anab/teaching/careerseminar/lecture1.pdfabezerianos - career...

CareerSeminar

session 1

1

Anastasia

Assistant Professor at Université Paris-SudMember of the ILDA (Interacting with Large Data)Research discipline:

Computer ScienceEducation:

BSc, University of Piraeus, GreeceMSc, PhD, University of Toronto, Canada

Positions:Developer, Greece Researcher, National ICT Australia (NICTA)Industrial Chair at École Centrale Paris on Business IntelligenceAssistant Professor Université Paris-Sud

2

Interaction

Collaboration

Perception

Evaluation

InfoVisandVisualAnalysis

remote information layout management change blindness

information access coordination infrastructure mobiles and walls in collaboration

graph reading animation sketchiness

graph exploration text changes annotation use optimization

dual-scale reading changes in perception on walls hybrid visualizations

3

Internships

ILDA (Interacting with Large Data) https://ilda.saclay.inria.fr/

As all teams, we also offer a number of internships every yearbut also accept students with their own ideas / topics

Topics: Collaboration using large displays and/or augment reality Tangible and gestural interaction, object fabrication Information visualization, in particular :

interaction techniques for exploration, geovisualization with particular users (neuroscientists, journalists, etc)

More in Nov, but if you are particularly interested in a topic, contact us!

4

ABezerianos - Career Seminar - Lecture 1 - 8 September 2019

CareerSeminar Program

5

Our goal is to help you succeed …

Learn critical skills that help youfind and critique HCI research findingsread, write and present HCI work

… your final projects and/or theses should impress, not depress, your advisors!

You should also consider your future:

Research? Industry? Startup? Consulting?

6

Career seminar

Includes everything from philosophical discussions to practical activities

7

Career seminar

Philosophy:What is Human Computer Interaction?How do we learn from HCI research?

What is the scientific method?What constitutes proof?Which research methods does HCI use?How do we tell what’s ‘good’ and what’s not?

8


Career seminar

Philosophy:How do we learn from HCI research?

Process:How do you do research in Human-Computer Interaction?

Finding a research topicPlanning research activities: Masters and Ph.D. levelsBuild theory, design novel interaction, understand users

What kinds of jobs need an HCI degree?Daily life for different types of jobsAdvantages and disadvantages

9

How does HCI research work?


Process:How do you do research in HCI?

Publication:How do you publish your research?

What are the types of research publications?How is a research article different from other publications?What are the key publications?Bibliometrics: evaluating publications and authorsChoosing a lifetime publication strategyWhat is the submission process? What is peer review?Plagarism

10

Becoming a researcher…Philosophy:

How do we learn from HCI research?Process:

How do you do research in HCI?Publication:

How do you publish research?Politics:

How does it really work?What happens in a program committee meeting?How will people evaluate your C.V. or resume?Trade-offs between industry, startups and academiaFinding grants and other research supportFinding or creating your research community

11

Becoming a researcher…



Publication:How do you publish research?

Politics:How does it really work?

Presentations:Invited guests Who would you like to hear from?

12


Becoming a researcher…



Publication:How do you publish research?

Politics:How does it really work?

Presentations:Invited guests

Practice:Hands-on workshops

Writing:research articlesreviewsrebuttals

Presenting your workPreparing a talkAsking for a recommendationManaging your advisor

13

What would you like to include?

Any suggestions for specific topics, guest presenters or activities?

email: TAs (Eugenie and Yi) and [email protected]

Use [CareerSeminar] in the title !!

14

Course Format

15

Course Format

Audience: Masters students Ph.D. students

Approach: Presentation (Anastasia or Wendy or …)Homework discussion/presentationsHands-on activity

Emphasis on discussion and group exercises

Attendance and class participation make up 50% of your grade!If you need to miss a class, tell us in advance

16


Practical Information

When: Mondays 14 – 17Where: Room D203 PUIO (Building 640)

Web: to be emailed https://www.lri.fr/~anab/teaching/CareerSeminar/

Assignments: BOTH email AND paper copy

Email to: [email protected] (Eugenie, Yi and myself) Subject: [CareerSeminar] Assignment #1 Review

Sometimes, you will need to bring in multiple copies, so learn where the printer is!

17

Practical Information

NO CLASS next week

18

Key websites

Course information:

https://www.lri.fr/~anab/teaching/CareerSeminar/

Access to the ACM Digital Library:

https://dl.acm.org/event.cfm?id=RE151

19

Today session 1

Philosophy:Natural Sciences vs. Sciences of the Artificial

Process:Research Notebooks

Practice:Reading the literature

20


What is Computer Science?

Natural Sciences vs.

Sciences of the Artificial

21

What is Computer Science?

We are in a Computer Science departmentspecializing in Human-Computer Interaction

So what is Computer Science?

We are lucky that HCI is very important in our department

But generally, first challenge was to convince the other scientiststhat computer science is actually a science… (and that HCI is Computer Science)

22

What is computer science ?

Astronomy = Telescope Science ?

23


Astronomy ≠ Telescope ScienceAstronomy = Science of the universe

24



Astronomy ≠ Telescope ScienceBiology = Microscope Science?

25


Astronomy ≠ Science of TelescopesBiology ≠ Science of MicroscopesBiology = Life Science

26


Astronomy ≠ Science of TelescopesBiology ≠ Science of MicroscopesComputer Science ≠ Science of Computers

27


Astronomy ≠ Science of TelescopesBiology ≠ Science of MicroscopesComputer Science ≠ Science of ComputersComputer Science = Science of Information

28


Information Science

InformationAn artificial phenomenonA natural phenomenon

29

Computer Science

Information processingNotion of computation: algorithm

30

Computer Science

Information processingNotion of computation: algorithmExecution cost for an algorithm:

in timein memoryin bandwidthin communication…

31

Computer Science

Information processingNotion of computation: algorithmExecution cost for an algorithm:Problems are too complex:

Exponential cost Example:

Travelling salesman problem:The shortest path passesthrough all the points

32


Computer Science

Information processingNotion of computation: algorithmExecution cost for an algorithm:Problems are too complex:

Exponential cost Example:

Travelling salesman problem:The shortest path passesthrough all the points(several are NP complete)

33

Computer Science

InformationA natural phenomenon

DNA:information used by organismsto generate new organisms

34

Computer Science

InformationA natural phenomenon

DNA:information used by organismsto generate new organisms

Quantum waves:Carry information that produces physical effects

35

Computer Science

Aspects

Theoreticalmodels, algorithms

Empiricalexperiments, tests

Technicalarchitectures, systems

36


Human-ComputerInteraction

ArtificialIntelligence

Mediated Communication,Social Media

Competing paradigms

Computer as toolFirst person interfacesEmpower users

Computer as servantSecond person interfacesDelegate tasks

Computer as mediumThird person interfacesCommunicate

37

Pasteur’s quadrant Donald Stokes (1997)

High

Low

HighLow

Seek immediate applications

Seek fundamental

understanding

Basic science:Niels Bohr

Use-inspired basic science:Louis Pasteur

Pure applied research:Thomas EdisonNon-science

38

Evidence: Theory vs. Empirical data

39

Psychology: Theory, experiment, new experiment, …

Model

New experimentExperiment New experiment

Theory

Empirical Observation

New model Revised model

40


Astrophysics: Observation, theory, new observation

Framework Revisedframework

New observationField observation

Theory

Empirical Observation

Revisedframework

New observation

41

General scientific approach

New observationObservation

Theory

Empirical Observation New observation

Model New model Revised model

42

What happens when you build what you study?

Artifactdesign Prototype New version

43

Human-Computer Interaction crosses disciplines

Theory Model

Artifactdesign

paper prototype prototypePrototype New version

Empirical Observation New observationObservation New observation

New model Revised model

44


A

C

B

I

IIIIIIII

IV IV

III

FieldExperiments

FieldStudies

ComputerSimulations

FormalTheory

SampleSurveys

JudgementTasks

LaboratoryExperiments

ExperimentalSimulations

Particular Behavior SystemsUniversal Behavior Systems

ObtrusiveResearch

Operations

UnobtrusiveResearch

Operations

I. Settings in natural systems II. Contrived or created settings III. Behavior not setting dependent IV. No behavior observation needed

Major concern may be: A. Generality over actors B. Precise measure of behavior C. System character of context

Research Trade-offs Runkel & McGrath, 1972

45

A

C

B

I

IIIIIIII

IV IV

III

FieldExperiments

FieldStudies

ComputerSimulations

FormalTheory

SampleSurveys

JudgementTasks




ObtrusiveResearch

Operations

UnobtrusiveResearch

Operations


Major concern may be: A. Generality over actors B. Precise measure of behavior C. Behavior in context


46

A

C

B

I

IIIIIIII

IV IV

III

FieldExperiments

FieldStudies

ComputerSimulations

FormalTheory

SampleSurveys

JudgementTasks




ObtrusiveResearch

Operations

UnobtrusiveResearch

Operations




47

A

C

B

I

IIIIIIII

IV IV

III

FieldExperiments

FieldStudies

ComputerSimulations

FormalTheory

SampleSurveys

JudgementTasks




ObtrusiveResearch

Operations

UnobtrusiveResearch

Operations




48


Research Process

49

Research Process: In theory

Define a problemRead the literatureExplore alternativesPropose a plan of attackDevelop a solutionValidate the solutionPublish the findings

From: Five Research Questions

50

Research Process: In Reality

Much messier.

You write as if everything happened in the correct order,but research is about dealing with surprises

51

from an idea …

… to a paper

HCI research process

52


get an idea

participatory design toavoid toy problems


53

develop theory

Fitts’ law, human perception

get an idea



54

operationalize

extract key features

develop theory


get an idea



55

build system

develop working prototypes

operationalize


develop theory


get an idea



56


design experiment

build system


no standard benchmarks

operationalize


develop theory


get an idea



57

design experiment

build system



operationalize

run experiment


controlled lab studies,longitudinal field studies

develop theory


get an idea



58

design experiment

build system



operationalize

run experiment



develop theory

analyze results


quantitative and qualitative

get an idea



59

design experiment

build system



operationalize

run experiment



develop theory

analyze results


quantitative and qualitative

get an idea

frame paper


key insights to generalize

research process

60


Reading the Research Literature

61

Research Literature … is not ‘literature’

What is the research literature?Technical, not literary, writing

Each article focuses on making an argument:Introduce a problemIdentify who else has done related workPerform an activity that adds to the fieldProvide a clear, replicable descriptionJustify the results

62

Research literature

Why do we read the research literature?

Find an interesting research questionUnderstand or learn about a domainFind specific work related to a topic of interestFind arguments for or against methodologies, approaches, etc.Position our work among others

63

Reading the research literature

Where do you start?

Identify the key publications in your fieldConferences? Journals?

Find ‘best papers’:What makes them great?

Find influential authors:Where do they publish?

64


Searching for Related Work

Where do we find articles relevant to a particular project?

Structured search:Articles cited by a relevant paperHighly cited articlesPh.D. thesis ‘related work’ section

Opportunistic discovery:Keyword web searchOn-line conference talk or videoRecommendations Browsing authors’ or lab web pagesBrowsing journal and conference proceedings

Opportunistic

Structured

65

How to read a research article

How do you read an article?Different ways, multiple times!

First, skim it Is it worth reading?if yes, read it in depth Will you cite it? Review it? Use it?if yes, re-read and take notes

Some papers require multiple reads

66

Skimming papers

Many papers are interesting …but you cannot read them all

Skim papers quickly to decide if it is worth reading forrelevant background or related to your work

Read abstract, skim the figures, check referencesWhat are the key nouns and verbs?What is the evidence? Does the paper make sense?

Consider how you skim a paper … should affect how you write a paper

67


Ask yourself:

What was their motivation? research question? real-world problem? technical challenge?

What is their contribution? interaction technique? methodology?insight about human behavior?

How did they do it? designed system? observed people?developed new theory?

How did they justify it? implementation? experiment? field study? mathematical argument?

68



What is your opinion?Key points? Do you believe it?

What questions are you left with?What would you ask the author?

Does the paper suggest directions for future research?for the authors? for you?

How does it relate to your own work?motivation, inspiration, similarities/differences

69

Archiving and note-taking

As you read more papers, you will forget detailsTake notes and archive them in your notebook

Find a system to store research articles!Develop a clear, consistent naming scheme

For each paper:Record the reference: author, date, title, publication, pagesKey take-away message: what is relevent to your work?Additional comments: idea/solution, contribution,Add questions/comments in margins

70

Write a literature review

“Related Work” = Literature review

Select papers related to your topic, organized by:theme, methodology, technology or …

Summarize key points of each paper, according to:research question, target audience, solution, method

Explain why each paper is relevant and not sufficient Cite papers correctly

NEVER plagarize! If you reuse their words, quote them explicitly

71

Assignment #1: Find and Report on a ‘best paper’

Due: 23 Sep in two weeks

1. Choose a ‘best paper’ in HCI (at least five years old)Provide the full reference, using ACM style

2. First skim, then read the paper carefullyTake notes in your notebook

3. Summarize the paper (factual)What is the key contribution?What was the impact of the paper?

4. What do you think about the paper? (opinion)What surprised you?What did you like best?What did you not like?

72


Research Notebooks

73

Research Notebooks:

You should use one!!

74

Research Notebooks

READ References, Abstracts, KeywordsQuotable quotes … with page numbers

THINK Ideas, Observations, Problems, SurprisesCourse insights, Research meetings

DO Details of: Experiments, Analyses, ProceduresCreate: Keywords, Highlights, Index

REREAD Mark Keywords, Highlight, QuestionCreate an index

Always include the date!

75

Optional Formats

Paper More disciplinedAllows sketchingNo technical problems (battery/internet)Keep with you all the time

Electronic Faster typing (for some)Easier to readEasier to searchConvenient when already on-lineReusable text (but be careful of plagarism)

Hybrid Paper and electronic… but have one that is primary

76


Assignment #2: Start a research notebook

Due: 23 Sep (bring to class)

Create your personal research notebookChoose paper, electronic or hybrid

For the rest of the term, Keep track of what you readSketch and record ideasDATE every entryAdd KEYWORDS to every entry

Continue to use your notebook for the rest of the semesterand BRING it in class (we will be checking it periodically!)

77

Assignments IMPORTANT!!!

Written assignments are due on Monday morningsTurn it in TWICE !!!

1. Send email To: [email protected] Subject: [CareerSeminar] Assignment #1 Best Paper

2. Bring 5 printed copies of the assignment to class

Why? Electronic record of the assignmentAbility to discuss it in class

78

Influential authors

Fred Brooks The Mythical Man MonthVannevar Bush As We May ThinkJames Gleick The InformationDaniel Kahneman Thinking Fast and SlowThomas Kuhn Structure of Scientific RevolutionsBruno Latour Science in ActionRobert Merton Sociology of ScienceKarl Popper Logic of Scientific DiscoveryRunkel & McGrath Judgement Calls in ResearchClaude Shannon Information TheoryHerbert Simon Sciences of the ArtificialStrunk & White Elements of StyleTukey & Mosteller Exploratory Data AnalysisMark Weiser Ubiquitous Computing

79


abezerianos - career seminar - lecture 1anab/teaching/careerseminar/lecture1.pdfabezerianos - career...

Documents