introduction to icst 2017

Introduction to ICST 2017

- History, overview, points, Who’s Who, … -

Keizo Tatsumi Jan. 20, 2017

ICST 2017 Social Networking Chair

Translated into English on Feb. 2017

1 (C) Keizo Tatsumi 2017

Ques - Winter Special Issue -

ICST 2017

will be held from March 13 to 17 in Tokyo, Japan

2

@Waseda University, Nishiwaseda Campus

(C) Keizo Tatsumi 2017

Agenda

1. Software Testing Conferences in the World

2. The History of Testing Conference

3. ICST at a Glance

4. ICST 2017 Program Overview

5. Interaction with Foreign Attendees

6. Getting information


1. Testing Conferences in the World

Software Testing Conferences 2017

4 Software Testing Magazine http://www.softwaretestingmagazine.com/software-testing-conferences/


5

Major Conferences - Academics

ISSTA (International Symposium on Software Testing and Analysis)

Sponsor: ACM (Association for Computing Machinery)

From 1993. Successor to the testing workshop held in 1978

Participants: Researchers, practitioners. Academic rather than ICST.

Workshops: Constraints, UI test automation, Code analysis framework, etc.

ICST (International Conference on Software Testing, Verification and Validation)

Sponsor: IEEE (The Institute of Electrical and Electronics Engineers)

From 2008

Participants: Researchers, practitioners. Practical rather than ISSTA.

Workshops: Model-based testing, Mutation analysis, Combinatorial testing, etc.

ICSE workshops (International Conference on Software Engineering)

AST (Automation of Software Test)

SBST (Search-Based Software Testing)

RST (Requirements Engineering and Testing)

MET (Metamorphic Testing)


6

Major Conferences - Practitioners

STAREAST, STARWEST (Software Testing Analysis & Review Conference)

Host：SQE (Software Quality Engineering)

From 1992 Participants: Consultants, practitioners

CAST (Conference of the Association for Software Testing)

Host：AST (The Association for Software Testing)

From 2006 Participants: Consultants, practitioners

EuroSTAR (European conference on Software Testing, Analysis & Review)

Host：QualTech Ltd. From 1993 Participants: Consultants, practitioners

その他 GTAC (Google Test Automation Conference)

From 2006, Google’s in-house conference Agile Testing Days (Europe)

Started in 2009 in Germany. 1st. Agile Testing Days USA will be held in Boston in June, 2017.


▲ ▲ ▲ ▲

EDSAC(1st Neumann computer) IBM System/360 IBM System/370 Cray-1

▲ ▲ ▲ ▲ ▲

UNIVAC1(1st commercial computer) DEC PDP-1 DEC PDP-8 Apple PC IBM PC ▲

▲ ▲ ▲ Sun-1

IBM 701 IBM 704 Intel 4004MPU

▲ ▲ ▲

Program Test Methods Symposium 1st Workshop 2nd

▲ ▲ on Software Testing Workshop

Courant Symposium IEEE Symposium on Computer Software Reliability

on Debugging Techniques ▲

in Large Systems International Conference on Reliable Software

1950 1955 1960 1965 1970 1975 1980

Symposium

7

2. The History of Testing Conference

1957, Digital Computer Programming (McRacken)

•The earliest textbook on programming

•Today's debugging and testing are described in the "Program Checkout" chapter

1961, Computer Programming Fundamentals (Leeds & Weinberg)

•Written by Leeds and Weinberg of IBM

•The first book which provided the "Program Testing" chapter

1970, Debugging Techniques in Large Systems (Rustin(Ed.))

•W. Elmendorf(developer of Cause-effect

graphing, IBM) presented "Controlling the functional testing of an operating system."

1972, The Computer Program Test Methods Symposium

•First symposium on software testing

•1973, “Program Test Methods“(Hetzel(Ed.)) is the first book on software testing


Cray-1

▲ ▲ ▲ ▲ ▲

Apple PC IBM PC ▲ Apple Macintosh iPhone iPad

Sun-1 ▲ ▲

Sun SPARC Intel Pentium Pro

▲ ▲ ▲ ▲ ▲ ▲ ▲

1st Workshop 2nd 3rd ISSTA (International Symposium on Software Testing and Analysis)

on Software Testing Workshop Workshop Testing, Verification, ▲

IEEE Symposium on Computer Software Reliability and Analysis (TAV) ICST

International Conference on Reliable Software

20101980 1985 1990 1995 2000 2005

8

The History of Testing Conference

1978, Software Testing and Test Documentation Workshop

•First workshop on software testing

"This workshop, the first of its kind, brought together some 60

technical experts from all over the world..." E. Miller, Workshop Report: Software Testing and Test Documentation,

IEEE Computer, 98-107, March 1979.

•The workshop was continuously held in 1982 and 1986, and succeeded to ISSTA(International Symposium on Software Testing and Analysis).

Ed Miller Program Chairman


9

3. ICST at a Glance

1st. ICST was held in 2008

A new forum bridging research and practice in many areas related to software quality

Composed of both research and industry tracks, plus workshops on specialized topics

The IEEE International Conference on Software Testing Verification and Validation(ICST)


http://www.cs.colostate.edu/icst2008/

Past events 1. ICST 2008 Lillehammer, Norway April 9-11, 2008

2. ICST 2009 Denver, Colorado, USA April 1-4, 2009

3. ICST 2010 Paris, France April 7-9, 2010

4. ICST 2011 Berlin, Germany March 21-25, 2011

5. ICST 2012 Montreal, QC, Canada April 17-21, 2012

6. ICST 2013 Luxembourg, Luxembourg March 18-22, 2013

7. ICST 2014 Cleveland, Ohio, USA March 31- April 4, 2014

8. ICST 2015 Graz, Austria April 13-17, 2015

9. ICST 2016 Chicago, IL, USA April 10-15, 2016

10. ICST 2017 Tokyo, Japan March 13-17, 2017

10

Schedule (ICST 2013)

Workshops Workshops Main Conference

Social Program


http://www.icst.lu/site/icst2013/program/schedule

11

Session Topics and Workshops

ICST 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017

Sessions Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○

Test Case Generation ○ ○ ○ ○ ○ ○

Mutation Testing ○ ○ ○ ○ ○ ○

Web Testing ○ ○ ○ ○ ○ ○ ○

GUI Testing ○ ○ ○ ○

Regression Testing ○ ○ ○ ○ ○

Search-Based Testing ○ ○ ○

Security Testing ○ ○ ○

Bugs, Faults, and Failures ○ ○ ○ ○ ○ ○

Coverage, White-box ○ ○ ○ ○ ○ ○

Workshops Model Based Testing ○ ○ ○ ○ ○ ○ ○ ○ ○ ○

Mutation Analysis ○ ○ ○ ○ ○ ○ ○ ○ ○

Security Testing ○ ○ ○ ○ ○ ○

Search-Based Testing ○ ○ ○ ○ ○ ○ ICSEへ

Regression Testing ○ ○ ○ ○

Combinatorial Testing ○ ○ ○ ○ ○ ○

Testing the Cloud ○ ○

Test Architecture ○ ○ ○

TAIC PART ○ ○ ○ ○ ○ ○ ○

11 ITEQS ○

TBD


12

# of Attendees, # of Papers

ICST 2013 Luxemburg Attendees: 289 (40 countries)

Papers: Submit-120, Accept-30 (25%)

From Japan: Attendees-11, Speakers-6

ICST 2014 Cleveland, Ohio, USA Attendees: Main-150, WS-145


From Japan: Attendees-11名, Speakers-6

ICST 2012 Montreal, Canada Attendees: 250 (27 countries)




13

# of Attendees, # of Papers

ICST 2015 Graz, Austria Attendees: 250



ICST 2016 Chicago, IL, USA Attendees: around 200



ICST 2017 Tokyo, Japan Attendees:


From Japan:

Stay tuned !


14

4. ICST 2017 Program Overview

Program at a Glance


3/12(Sun) 3/13(Mon) 3/14(Tue) 3/15(Wed) 3/16(Thu) 3/17(Fri)

Co-located

Events Day

Workshops &

Co-located

Events Day

Main

Conference Day

Main

Conference Day

Main

Conference Day

Workshops &

Doctoral

Symposium Day

・Asian PLoP ・Mutation ・Keynote-1 ・Keynote-2 ・Keynote-3 ・A-MOST

・TAIC PART ・InSTA

・ITEQS ・ACSE

・IWCT

・IWESEP ・Banquet

・Asian PLoP

・IPSJ SIGSE (in

Japanese)

・Doctoral

Symposium

・IPSJ SIGSE (in

Japanese)

・Various

sessions

・Welcome

reception

・Various

sessions

・Various

sessions

・Open steering

committee

15

Main Conference - Keynotes

Keynote-1 (March 14) The State of Continuous Integration Testing at Google

Speaker: John Micco, Google, USA

Keynote-2 (March 15) Testing and Validation Requirements for Automated Driving Technology

Speaker: Kenji Nishikawa, Toyota Motor Corporation, Japan

Keynote-3 (March 16) Model-Based Testing and Model Inference: Better Together!

Speaker: Andreas Zeller, Saarland University, Germany


16

Main Conference - Sessions

Research Sessions 36 full papers and 8 short papers

Industry Sessions 5 papers

Testing Tools Sessions 10 papers

Tool Demonstrations 7 tools

Software Testing Contest

Poster Session 13 posters

Doctoral Symposium 7 papers


17

Workshops

A-MOST: Advances in Model Based Testing

Mutation: Mutation Analysis

TAIC PART: Testing: Academia-Industry Collaboration, Practice

and Research Techniques

IWCT: Combinatorial Testing

InSTA: Software Test Architecture

ITEQS: Testing Extra-Functional Properties & Quality Characteristics

of Software Systems

ACSE: Asian Symposium on Collaborative Software Engineering


5. Interaction with Foreign Attendees

18

Coffee Break

Welcome Reception

Banquet


Interaction with Foreign Attendees

Social Event (IWCT 2013)

19

IWCT(Combinatorial Testing Workshop) Folks With Mr. Jacek Czerwonka

(Developer of PICT) With IWCT 2012 co-chairs

Signatures of the 1st IWCT attendees on a ICST 2012 tote bag Social Event (IWCT 2016) Authors' autographs! (^^)


Interaction with Foreign Attendees

With Prof. Jeff Offutt, George Mason Univ., USA

With Dr. Antonia Bertolino, Italy

Software testing research leaders at ICST

With Prof. Mauro Pezzé, Italy

Mr. Robert Binder, CMU SEI

Oops!

I wish I had taken a picture …

Many other prominent researchers also participate in ICST.

(C) Keizo Tatsumi 2017 20

6. Getting Information

21

ICST 2017 Website

http://aster.or.jp/conference/icst2017/

ICST 2017 Facebook page

https://www.facebook.com/ICST-2017-290517964620465/

ICST 2017 twitter

https://twitter.com/ICST2017


Getting Information

22

http://aster.or.jp/activities/investigation.html

ASTER international investigation activities website

ICST Attendance Reports (2012～2016)


(In Japanese)

Why don't you attend

ICST 2017 !

Thank you!
