a systematic literature review on architectural … · a literature review study supports...

A SYSTEMATIC LITERATURE REVIEW ON ARCHITECTURAL PATTERNS

AND QUALITY ATTRIBUTES INTERACTION

Systematic Literature Review Protocol1

Version 1.7

1 Gianantonio Me, PhD Candidate at UCLM-Spain and VU-the Netherlands [email protected] [email protected]

slrProtocol_g.me / 2

Table of Contents

1 Abstract ............................................................................................................................... 3

2 RESEARCH DESIGN ............................................................................................................... 4

2.1 Background ....................................................................................................................................................... 4

2.2 Rationale for a literature review ....................................................................................................................... 4

2.2.1 Why are we performing a Systematic Literature Review? ....................................................................... 4

2.2.2 Why this literature review is important? .................................................................................................. 4

2.3 Research questions ........................................................................................................................................... 6

3 REVIEW PROTOCOL ............................................................................................................. 7

3.1 Pilot Study ......................................................................................................................................................... 7

3.1.1 Search Strings Building .............................................................................................................................. 7

3.2 SEARCH STRATEGY .......................................................................................................................................... 10

3.3 DATA SOURCES................................................................................................................................................ 10

3.4 SEARCH PROCESS ............................................................................................................................................ 11

3.4.1 Inclusion and Exclusion Criteria (Selection of Primary Studies) .............................................................. 11

3.4.2 Search Results’ Manager ......................................................................................................................... 12

3.4.3 List of included studies ............................................................................................................................ 12


1 Abstract

Background: Architectural patterns and styles represent common solutions to recurrent problems. They encompass architectural knowledge about how to achieve holistic system quality. The relation between patterns/styles and quality attributes has been regularly addressed in the literature. However, there is a lack of a consolidated and systematically built reference capturing this relation and eventually making it available for further reuse in the form of patterns-quality attributes knowledge. If captured, this knowledge can be used as an architectural decision framework where solutions (patterns) are strongly intertwined with quality (attributes). Such a framework should also contemplate variants and combinations of pattern. We decide to plan a Systematic Literature Review for depicting the state-of-the-art of Patterns and Quality Attributes Interaction. The research questions: This review aims to answer to:

a) RQ1- What type of relations exist between architectural patterns and quality attributes? b) RQ2- What types of approaches address the relations between architectural patterns and quality attributes? c) RQ3- What are the most important challenges for a quality-driven and pattern-based design?

The strategy: A preliminary set of twelve primary studies has been identified. The choice was based on previous knowledge. A search string has been tested. After capturing all the primary studies testing the same search string in different search engines, the search string will be applied extensively. First round was based only on Title and Abstract screening, second round on the whole reading. Study selection criteria: Inclusion and Exclusion criteria have been applied. Study selection procedures: For the studies that show uncertainty against the Inclusion/Exclusion criteria a review by different researchers has been planned. Study quality assessment checklists and procedures: Studies’ quality has been assessed on the basis of the coverage of knowledge elements reported for architecture patterns (e.g. the early work of Buschmann) and quality models (e.g. Standard ISO 25010:2011). Data extraction strategy: Textual analysis and structural coding (for understanding the type of connection between architectural patterns and quality attributes) have been applied; qualitative and quantitative analysis for collecting strengths and liabilities for each combination architectural pattern and quality attribute. Synthesis of the extracted data: Tables and narrative texts. Future Work Strategy: Relevance study in the industry Project timetable: June 2015-June 2016


2 RESEARCH DESIGN

2.1 Background

We developed a lightweight “theory”, literature based throughout a ground theory approach. The theory is based on the study of Harrison NB, Avgeriou P. Leveraging architecture patterns to satisfy quality attributes. In Software Architecture 2007 Jan 1 (pp. 263-270). Springer Berlin Heidelberg, plus all the references included. At this stage the theory has been developed around four main areas (Architectural Decision Making, Architectural Patterns, Quality Attributes Characterization and Patterns/Attributes interaction). A full version of the theory is beyond the scope of this SLR protocol.

2.2 Rationale for a literature review

2.2.1 Why are we performing a Systematic Literature Review?

According to Kitchenam2 there are five main reasons for undertaking a SLR:

To summarise the existing evidence concerning a treatment or technology e.g. to summarise the

empirical evidence of the benefits and limitations of a specific agile method.

To identify any gaps in current research in order to suggest areas for further investigation.

To provide a framework/background in order to appropriately position new research activities.

to examine the extent to which empirical evidence supports/contradicts theoretical hypotheses,

or even

to assist the generation of new hypotheses

The motivations of this literature review are:

Summarize: collect the evidence widespread in the literature about quality attributes and architectural

patterns with the aim of creating a catalogue/systematic repository of knowledge.

Examine: How the interaction between quality attributes and architectural patterns have been

depicted? Is the knowledge reported in the literature aligned with the early body of knowledge

depicted in the background section? How the interaction between quality attributes and architectural

patterns have been depicted?

Identify any gaps: for instance: can I know more on the variations/combinations of patterns and their

interactions with quality attributes? Is that knowledge available in the literature? Can I create a more

systematic body of knowledge?

2.2.2 Why this literature review is important?

A literature review study supports reorganization of the knowledge on architectural pattern and quality attributes.

The relevance of this literature review is that this study can provide answers to the future work planned by Harrison

and Avgeriou. Namely the following points shape the relevance of this study:

2 Kitchenham, Barbara. "Procedures for performing systematic reviews." Keele, UK, Keele University 33, no. 2004 (2004): 1-26.


Table 1-Importance for a literature review

Statement or characteristics of the literature so far3 Importance of a literature review

Early studies focus on few architecture patterns usually following the work of Buschmann

A literature review lets emerge others patterns, variants and combinations.

The number of quality attributes analyzed is not exaustive A literature review allows detection of quality characteristics and sub-characteristics according to, for instance, Standard ISO 25010:2011. In case of not contemplated quality attributes the same standard might be extended.

The interaction of the consequences of patterns has not been explored in detail.

A literature review can catch details about the consequences.

We intend to study which patterns are often used together. This helps identify potentially conflicting decisions, and help them make tradeoffs about which patterns to use.

A literature review can shed light on combinations of patterns and if those combinations alter what we already know about the quality attributes addressed by patterns.

Pattern variants have rich potential. Variants of patterns should be investigated to understand in more detail how individual variants affect the impact of generic architecture patterns on the quality attributes. Different pattern variants have somewhat different strengths and liabilities. This information can be used to help the architect choose among different variants of patterns.

A literature review support reorganization of variants of patterns.

3 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270.

Springer Berlin Heidelberg, 2007.


2.3 Research questions

It is widely known that architectural patterns and quality attributes are not independent but there are significative

interactions4. Those interactions can be represented as knowledge elements which might be considered as

regularities. In this line of reasoning, for instance, Layered architecture presents a trade-off between performance

and modifiability, where the second quality attribute is better achieved5. Architects in search of assuring a high

modifiability for their system might take decisions on the basis of the regularity above, so doing by adopting a Layer

pattern. The knowledge on the interaction between patterns and quality attribute is a foundation for architectural

decisions6. In this line of reasoning, the motivation of this study aims to assess if that type of regularities are widely

accepted in the literature or there are substantial differences in evaluating which pattern is more adequate for

achieving specific quality attributes.

RQ1- What type of relations exist between architectural patterns and quality attributes? This research question has two goals. Firstly, it aims to explore the characterization of those relations (e.g., impact, dependencies, interaction, synergies or quantitative). Secondly, the type of relations can be evaluated and classified according to frequency of various patterns and QAs and related combinations.

RQ2- What types of approaches address the relations between architectural patterns and quality attributes? This research question aims to understand and classify the various methodologies, frameworks, models, etc. available in the literature that addresses the relation between pattern and QAs.

RQ3- What are the most important challenges for a quality-driven and pattern-based design? This research question aims to identify the most important challenges for building a theory of pattern-QAs interaction. We consider challenges as specific issues that emerge from the primary studies and for which better/explicit knowledge can help in addressing them better.

4 Harrison, Neil B., and Paris Avgeriou. "How do architecture patterns and tactics interact? A model and annotation." Journal of Systems and Software 83, no. 10

(2010): 1735-1758.

5 Buschmann, F., Ja¨kel, C., Meunier, R., Rohnert, H., and Stahl, M. 1996. Pattern-Oriented Software ArchitectureVA System of Patterns. Chichester, UK: John Wiley & Sons.

6 Not of course the only factor, see for instance Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture

candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181.


3 REVIEW PROTOCOL

3.1 Pilot Study

Piloting the review protocol is essential7. A set of 12 pilot-studies8 have been identified for two purposes. The pool of

papers includes key studies and at least one study on every single architectural pattern considered for the analysis.

In this way it is possible to assess if the simple term “architectural pattern(s)” can catch specific patterns (for

instance Layered) Firstly, we have been collecting keywords for shaping the search string from the following studies.

In case of authors’ keywords were not available we select keywords by reading the abstract. Secondly, the search

string has been tested on Google Scholar and other several search engines in order to verify if the pilot set-studies

have been detected.

3.1.1 Search Strings Building

Table 2-Search string

Software Architecture Quality

( Architecture Pattern AND ( Quality attributes

OR Architectural Pattern OR Quality characteristics

OR Architecture Style OR Quality

OR Architectural Style) OR Quality properties

OR No-Functional Requirement

OR No Functional Requirement

OR Quality dimensions)

7 Brereton, Pearl , Kitchenham, Barbara A., Budgen, David, Turner, Mark and Khalil, Mohamed. Lessons from applying the systematic literature

review process within the software engineering domain. JSS 80, 2007, pp 571-583. 8 This pilot should be not mistaken with the pilot set for Architectural Patterns and Quality Attributes submitted to WICSA 2016 as full paper

for both the conference and the workshop QRASA. The pilot here is aimed to test the search string .


Table 3-Pilot for testing the search string

Search string 1

Num Reference Author Keywords Keywords extracted from the

abstract

Google

Scholar

Others

search

engines

Inclusion

Exclusion

Criteria test

1 Losavio, F., L. Chirinos, and M.

Pérez. "Attribute-Based

Techniques to Evaluate

Architectural Styles for Interactive

Systems." Journal of Object

Oriented Programming (2001).

architectural style,

architectural pattern,

attribute-based

evaluation, ABAS,

architectural design,

quality model,

interactive systems,

PAC, ISO 9126

- Found Found in

Scopus

INCLUDED

2 Bass, Len, and Bonnie E. John.

"Linking usability to software

architecture patterns through

general scenarios." Journal of

Systems and Software 66, no. 3

(2003): 187-197.

Usability;

Software architecture;

Software patterns;

Scenarios

- Found Found

with

Scopus

INCLUDED

3 Kim, Dae-Kyoo, Jungwoo Ryoo,

and Suntae Kim. "Building

Sustainable Software by

Preemptive Architectural Design

Using Tactic-Equipped

Patterns."Availability, Reliability

and Security (ARES), 2014 Ninth

International Conference on. IEEE,

2014.

- Found in

IEEE

INCLUDED

4 Svahnberg, Mikael, and Claes

Wohlin. "Consensus building when

comparing software

architectures." In Product Focused

Software Process Improvement,

pp. 436-452. Springer Berlin

Heidelberg, 2002.

- Found

with

Springer

Link

INCLUDED

5 Avgeriou, Paris, and Uwe Zdun.

"Architectural patterns revisited–a

pattern language." (2005).

Not available Quality attributes, architectural

patterns, software system

Found Found

with

Scopus

INCLUDED

6 Svahnberg, Mikael, and Claes

Wohlin. "An investigation of a

method for identifying a software

architecture candidate with

respect to quality

attributes."Empirical Software

Engineering 10, no. 2 (2005): 149-

181.

Software architectures,

quality attributes,

analytic hierarchy

process

- Found Found

with

SpringerL

ink

INCLUDED

7 Harrison, Neil B., Paris Avgeriou,

and Uwe Zdun. "On the impact of

fault tolerance tactics on

architecture

- - Found

with

ACM

INCLUDED


patterns." Proceedings of the 2nd

International Workshop on

Software Engineering for Resilient

Systems. ACM, 2010.

8 Harrison, Neil B., and Paris

Avgeriou. "How do architecture

patterns and tactics interact? A

model and annotation." Journal of

Systems and Software 83, no. 10

(2010): 1735-1758.

Software architecture

Patterns Quality

attributes Tactics

- Found found

with

Science

Direct)

INCLUDED

9 Kassab, Mohamad, Ghizlane El-

Boussaidi, and Hafedh Mili. "A

quantitative evaluation of the

impact of architectural patterns on

quality requirements." InSoftware

Engineering Research,

Management and Applications

2011, pp. 173-184. Springer Berlin

Heidelberg, 2012.

architectural patterns;

architectural tactics;

quality requirements;

architectural design

- Found Found

with

Springer

Link

INCLUDED

10 Silva, Francisco, Marcelo Lucena,

and Leonardo Lucena. "STREAM-

AP: A process to systematize

architectural patterns choice

based on NFR." In Twin Peaks of

Requirements and Architecture

(TwinPeaks), 2013 3rd

International Workshop on the,

pp. 27-34. IEEE, 2013.

Non-Functional

Requirements;

Software Architecture;

NFR Framework;

Architectural Pattern

- Found Found

with

Scopus

INCLUDED

11 Xu, Lihua, Hadar Ziv, Thomas A.

Alspaugh, and Debra J. Richardson.

"An architectural pattern for non-

functional dependability

requirements." Journal of Systems

and Software 79, no. 10 (2006):

1370-1378.

Software architecture;

Architectural patterns;

Aspects; Non-functional

requirements

- Found Found

with

Scienc

eDirect

INCLUDED

12 Seo, Chiyoung, et al. "A framework

for estimating the impact of a

distributed software system's

architectural style on its energy

consumption." Software

Architecture, 2008. WICSA 2008.

Seventh Working IEEE/IFIP

Conference on. IEEE, 2008.

- - Found

with IEEE

INCLUDED

After some attempts all 12 studies have been found (100%) with Search String 1.


3.2 SEARCH STRATEGY

The search string adopted:

(“architecture patterns” OR “architectural patterns” OR “architecture styles” OR “architectural styles”) AND ("quality

requirements" OR "quality attributes" OR "quality characteristics" OR "quality properties" OR "non functional

requirements" OR "non-functional requirements" OR “quality dimensions” )

This search string reflects two terminology problems:

1) patterns and style , often used in an interchangeable way and

2) is not available an unified terminology about “quality attributes”.9

At first, this search string gave back on Google Scholar 519010 results.

3.3 DATA SOURCES

ACM Digital Library 422 studies

IEEE 129 studies

SpringerLink 1395 studies

Scopus 499 studies

Web of Science 79 studies

Science Direct 418 studies

Table 4-Study Selection Rounds

Data Source Number of Studies

Round 1 Round 1b Round 2 Round 3 Round 4 Primary Studies

First Round Included (Title and abstract)

After Checking Duplicates*

Second Round Included (Skimming Reading)

Third Round Included (Whole reading)

Snowballing (Retrieval)**

ACM Digital Library

422 65 - - - - -

IEEE

129 49 - - - - -

SpringerLink

1395 71 - - - - -

Scopus

499 118 - - - - -

Web of Science

79 53

- - - - -

Science Direct 418 26 - - - - -

Whole Collection

2942* 382 283 160 88 11 99***

* It was possible to check automatically for duplicates only for IEEE, Scopus and Science Direct data. For the other three search engines the procedure has been done manually. ** We experienced a huge difference between the studies given by Google Scholar (5190 hits) and the other six search engines (2942 hits). In order to mitigate the risk of oversighting some important studies we performed a snowballing research by scanning all the references of the 99 primary studies. In this way we added 18 studies to the initial pool of primary studies. *** Included 12 studies of Pilot set; Excluded 1 study that has been used for building the “theory”, 12 studies are not available ( not available for free or not

available on internet).

9 Glinz, Martin. "On non-functional requirements." In Requirements Engineering Conference, 2007. RE'07. 15th IEEE International, pp. 21-26.

IEEE, 2007. 10

5190 6 November 2015


3.4 SEARCH PROCESS

3.4.1 Inclusion and Exclusion Criteria (Selection of Primary Studies)

Table 5-Inclusion and Exclusion criteria

Inclusion Criteria: Articles that satisfied the following inclusion criteria will be selected

N Description Rationale Example

I1 A study that offers knowledge elements on the interaction between at least one architectural patterns and at least one quality attribute.

We are interested in improving understanding on the interaction (type of interaction, dependencies etc.), between architectural patterns and quality attributes.

The Blackboard pattern has both a positive and negative impact on maintainability11 or “efficiency is both a strength and a liability in the Pipes and Filters pattern”12.

I2 A study that is carried out by either academics or practitioners

Interaction between architectural patterns and quality attributes is a key concern both for researchers than industries.

-

I3 A study that is written in English For practicability reasons, studies in any other languages than English were excluded.

-

EXCLUSION CRITERIA: studies that met the following criteria will be excluded:

n Description Rationale Example

E1 A study that does not provide directly and indirectly any description for the quality attributes taken in account

Description of quality attributes: in this SLR a description of a quality attribute has been considered as quality attribute characterization13. It means that a study should provide knowledge on the quality attribute in the form of quality attribute scenario. Quality attributes scenarios overcome the problems of non-operational definition and overlapping concerns 14 Directly: the quality attribute scenario can be explicitly depicted in the study Indirectly: quality attributes characterization can be referred in other studies or explained not explicitly as scenario.

“Reliability: Consistency: provide a mechanism (e.g. to replace a component interface); Attribute: presence of a mechanism; Metrics: Boolean; Goal: High” 15 In this case Reliability is directly described. “we choose to use one of the many different categorisations of quality attributes (see e.g., (McCall, 1994)), i.e., the ISO 9126 standard (ISO 9126).”16 In this second case quality attributes are indirectly described by quoting a quality model as reference. (In this case both studies do not meet the exclusion criteria. The absence of the elements described above brings to exclude the study)

E2 A study that does not provide any description directly and indirectly for the architectural patterns taken in account

Description of architectural pattern: As seen in the background section, a pattern can be described according to the context, problem and solution Directly: the architectural pattern has been described explicitly in the study, according the template Indirectly: some studies refer to the work of Buschmann, in this case the architectural pattern is implicitly described.

A direct description of an architectural pattern is “Model-View-Controller (MVC) is a widely known design pattern to integrate a user interface with the application domain. MVC was first introduced in Smalltalk’80 by Krasner and Pope [14]. Central to MVC is the separation of the representation of the application domain (the model) from the display of the application’s state (the view) and the user interaction processing (the controller).” 17 “In this study we use the following five

11 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270. Springer Berlin Heidelberg, 2007. 12 Harrison, Neil B., and Paris Avgeriou. "Leveraging architecture patterns to satisfy quality attributes." In Software Architecture, pp. 263-270. Springer Berlin Heidelberg, 2007.

13 L. Bass, P. Clements, and R. Kazman (1998) Software Architecture in Practice, Addison Wesley Longman. 14 L. Bass, P. Clements, and R. Kazman (1998) Software Architecture in Practice, Addison Wesley Longman. 15 Losavio, Francisca, Nicole Levy, Parinaz Davari, and François Colonna. "Pattern-based architectural design driven by quality properties: a platform to model scientific calculation." In Software Architecture, pp. 94-112. Springer Berlin Heidelberg, 2005. 16 Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181. 17 Syromiatnikov, Artem, and Danny Weyns. "A Journey through the Land of Model-View-Design Patterns." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 21-30. IEEE, 2014.


architecture patterns of the eight patterns presented by (Buschmann et al., 1996), namely:[..]”18 it is an example of indirect description (In this case both studies do not meet the exclusion criteria. The absence of the elements described above brings to exclude the study)

E3 A study that does not focus on architectural patterns of applications

We are interested only in architectural patterns at application level, not for instance operative systems.

Mikrokernel Operative System 19

E4 A study that focuses on pre-pattern or anti-patterns

We focus only on architectural patterns. Anti-patterns represent bad design choice and they are out of scope for the purpose of this work.

For instance “Antipatterns are poor design choices that are conjectured to make objectoriented systems harder to maintain.”20

E5 A study that the analysis is at design or idiom level

We focus only on the abstraction level of architectural patterns. Design pattern and idiom patterns deal with problems after the overall system architecture has been specified.

For instance Abstract Factory, considered in Buschmann as a design pattern21

E6 A study that is not available, it is a book or it is a workshop note.

Self-explaining -

3.4.2 Search Results’ Manager

Mendeley and in one case (specifically with the results of Springer Link) a spreadsheet has been used.

3.4.3 List of included studies

Table 6- Studies count

Studies Numbers of studies

Total number of hits detected by the search string 2942

Pilot Studies 12 (Included in 2942)

Excluded by title and abstract -2560

Duplicates Detected -99

Not Available -12

Skimming Reading Excluded -111

Full Reading Excluded -72

Snowballing Included (retrieval) 11

Total of Primary Studies 99

18

Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181. 19

Kuz, Ihor, Yan Liu, Ian Gorton, and Gernot Heiser. "camkes: A component model for secure microkernel-based embedded systems." Journal of Systems and Software 80, no. 5 (2007): 687-699 20 Khomh, Foutse, Massimiliano Di Penta, Yann-Gaël Guéhéneuc, and Giuliano Antoniol. "An exploratory study of the impact of antipatterns on class change-and fault-proneness." Empirical Software Engineering 17,

no. 3 (2012): 243-275.

21 Hsueh, Nien-Lin, Peng-Hua Chu, Jonathan Lee, and William Chu. "A quality verification model for design pattern." In Computer Software and

Applications Conference, 2007. COMPSAC 2007. 31st Annual International, vol. 1, pp. 531-534. IEEE, 2007. In Buschmann see for instance page


Table 7-Definitive List of Included Papers

Number Reference Status Note

0T Harrison NB, Avgeriou P. Leveraging architecture patterns to satisfy quality attributes. InSoftware Architecture 2007 Jan 1 (pp. 263-270). Springer Berlin Heidelberg.

- Background

1 Aarsten, Amund, Davide Brugali, and Giuseppe Menga. "Patterns for three-tier client/server applications." Proceedings of Pattern Languages of Programs (PLoP’96) (1996): 4-6.

Included Round 3

2 Stuurman, Sylvia, and Jan Van Katwijk. "Evaluation of software architectures for a control system: A case study." In Coordination Languages and Models, pp. 157-171. Springer Berlin Heidelberg, 1997.

Included Round 3

3 Grahn, Håkan, and Jan Bosch. "Some initial performance characteristics of three architectural styles." In Proceedings of the 1st international workshop on Software and performance, pp. 197-198. ACM, 1998.

Included Snowballing

4 Bosch, Jan, and Peter Molin. "Software architecture design: evaluation and transformation." In Engineering of Computer-Based Systems, 1999. Proceedings. ECBS'99. IEEE Conference and Workshop on, pp. 4-10. IEEE, 1999.

Included Round 3

5 Lundberg, Lars, Jan Bosch, Daniel Häggander, and Per-Olof Bengtsson. "Quality attributes in software architecture design." In Proceedings of the IASTED 3rd International Conference on Software Engineering and Applications, pp. 353-362. 1999.


6 Wen-Li Wang; Mei-Huei Tang; Mei-Hwa Chen, "Software architecture analysis-a case study," in Computer Software and Applications Conference, 1999. COMPSAC '99. Proceedings. The Twenty-Third Annual International , vol., no., pp.265-270, 1999

Included Round 3

7 Wang, Wen-Li, Ye Wu, and Mei-Hwa Chen. "An architecture-based software reliability model." In Dependable Computing, 1999. Proceedings. 1999 Pacific Rim International Symposium on, pp. 143-150. IEEE, 1999.

Included Round 3

8 Petriu, Dorina, Christiane Shousha, and Anant Jalnapurkar. "Architecture-based performance analysis applied to a telecommunication system."Software Engineering, IEEE Transactions on 26, no. 11 (2000): 1049-1065.

Included Round 3

9 Losavio, F., L. Chirinos, and M. Pérez. "Attribute-Based Techniques to Evaluate Architectural Styles for Interactive Systems." Journal of Object Oriented Programming (2001).

Included Pilot

10 Morisawa, Yoshitomi, and Koji Torii. "An architectural style of product lines for distributed processing systems, and practical selection method." ACM SIGSOFT Software Engineering Notes 26, no. 5 (2001): 11-20.

Included Round 3

11 Araujo, Ivan, and Michael Weiss. "Linking patterns and non-functional requirements." In PROCEEDINGS OF THE NINTH CONFERENCE ON PATTERN LANGUAGE OF PROGRAMS (PLOP 2002), SEPTEMBER 8–12, 2002. 2002.


12 Svahnberg, Mikael, and Claes Wohlin. "Consensus building when comparing software architectures." In Product Focused Software Process Improvement, pp. 436-452. Springer Berlin Heidelberg, 2002.

Included Pilot

13 Svahnberg, Mikael, Claes Wohlin, Lars Lundberg, and Michael Mattsson. "A method for understanding quality attributes in software architecture structures." In Proceedings of the 14th international conference on Software engineering and knowledge engineering, pp. 819-826. ACM, 2002.

Included Round 3

14 Bass, Len, and Bonnie E. John. "Linking usability to software architecture patterns through general scenarios." Journal of Systems and Software 66, no. 3 (2003): 187-197.

Included Pilot

15 Lopez, Marta. "Application of an evaluation framework for analyzing the architecture tradeoff analysis method SM." Journal of Systems and Software68, no. 3 (2003): 233-241.

Included Round 3

16 Silva, Otavio, Alessandro Garcia, and Carlos Lucena. "The reflective blackboard pattern: Architecting large multi-agent systems." In Software engineering for large-scale multi-agent systems, pp. 73-93. Springer Berlin Heidelberg, 2003.

Included Round 3

17 Weiss, Michael. "Pattern-driven design of agent systems: Approach and case study." In Advanced Information Systems Engineering, pp. 711-723. Springer Berlin Heidelberg, 2003.

Included Round 3

18 Wijnstra, Jan Gerben. "From problem to solution with quality attributes and design aspects." Journal of Systems and Software 66, no. 3 (2003): 199-211.

Included Round 3

19 Losavio, Francisca, Nicole Lévy, and Amar Ramdane-Cherif. "Architectural design for a wireless environment." In Embedded and Ubiquitous Computing, pp. 558-570. Springer

Included Round 3


Berlin Heidelberg, 2004.

20 Francois, Alexandre RJ. "A hybrid architectural style for distributed parallel processing of generic data streams." In Proceedings of the 26th International Conference on Software Engineering, pp. 367-376. IEEE Computer Society, 2004.

Included Round 3

21 Avgeriou, Paris, and Uwe Zdun. "Architectural patterns revisited–a pattern language." (2005).

Included Pilot

22 John, Bonnie E., Len Bass, Maria-Isabel Sanchez-Segura, and Rob J. Adams. "Bringing usability concerns to the design of software architecture." In Engineering Human Computer Interaction and Interactive Systems, pp. 1-19. Springer Berlin Heidelberg, 2005.

Included Round 3

23 Díaz-Pace, J. Andrés, and Marcelo R. Campo. "ArchMatE: from architectural styles to object-oriented models through exploratory tool support." In ACM SIGPLAN Notices, vol. 40, no. 10, pp. 117-132. ACM, 2005.

Included Round 3

24 Kolp, Manuel, T. Tung Do, Stéphane Faulkner, and TT Hang Hoang. "Architectural styles and patterns for multi-agent systems." In Design of Intelligent Multi-Agent Systems, pp. 103-132. Springer Berlin Heidelberg, 2005.

Included Round 3

25 Lee, Kwang Chun, Ho-Jin Choi, Dan Hyung Lee, and Sungwon Kang. "Quantitative measurement of quality attribute preferences using conjoint analysis." In Interactive Systems. Design, Specification, and Verification, pp. 213-224. Springer Berlin Heidelberg, 2005.

Included Round 3

26 Losavio, Francisca, Nicole Levy, Parinaz Davari, and François Colonna. "Pattern-based architectural design driven by quality properties: a platform to model scientific calculation." In Software Architecture, pp. 94-112. Springer Berlin Heidelberg, 2005.

Included Round 3

27 Niemelä, Eila, Jarmo Kalaoja, and Patricia Lago. "Toward an architectural knowledge base for wireless service engineering." Software Engineering, IEEE Transactions on 31, no. 5 (2005): 361-379.

Included Round 3

28 Reza, Hassan, Dan Jurgens, Jamie White, Jason Anderson, and Jay Peterson. "An architectural design selection tool based on design tactics, scenarios and nonfunctional requirements." In Electro Information Technology, 2005 IEEE International Conference on, pp. 6-pp. IEEE, 2005.

Included Round 3

29 Svahnberg, Mikael, and Claes Wohlin. "An investigation of a method for identifying a software architecture candidate with respect to quality attributes."Empirical Software Engineering 10, no. 2 (2005): 149-181.

Included Pilot

30 Wu, Chen, and Elizabeth Chang. "Comparison of web service architectures based on architecture quality properties." In Industrial Informatics, 2005. INDIN'05. 2005 3rd IEEE International Conference on, pp. 746-755. IEEE, 2005.

Included Round 3

31 Bellebia, D., and J. M. Douin. "Applying patterns to build a lightweight middleware for embedded systems." In Proceedings of the 2006 conference on Pattern languages of programs, p. 29. ACM, 2006.

Included Round 3

32 Bischofs, Ludger, Simon Giesecke, Michael Gottschalk, Wilhelm Hasselbring, Timo Warns, and Stefan Willer. "Comparative evaluation of dependability characteristics for peer-to-peer architectural styles by simulation." Journal of Systems and Software 79, no. 10 (2006): 1419-1432.

Included Round 3

33 Boucké, Nelis, and Tom Holvoet. "Relating architectural views with architectural concerns." In Proceedings of the 2006 international workshop on Early aspects at ICSE, pp. 11-18. ACM, 2006.

Included Round 3

34 Davidsson, Paul, Stefan Johansson, and Mikael Svahnberg. "Characterization and evaluation of multi-agent system architectural styles." In Software Engineering for Multi-Agent Systems IV, pp. 179-188. Springer Berlin Heidelberg, 2006.

Included Round 3

35 Hoareau, Didier, and Chouki Tibermacine. "Component deployment evolution driven by architecture patterns and resource requirements." Lecture notes in computer science 4344 (2006): 236.

Included Round 3

36 Morrison, Patrick, and Eduardo B. Fernandez. "Securing the Broker Pattern." In EuroPLoP, pp. 513-530. 2006.


37 Schmidt, Holger, and Ina Wentzlaff. "Preserving software quality characteristics from requirements analysis to architectural design." InSoftware Architecture, pp. 189-203. Springer Berlin Heidelberg, 2006.

Included Round 3

38 Wentzlaff, Ina, and Markus Specker. "Pattern-based development of user-friendly web applications." In Workshop proceedings of the sixth international conference on Web engineering, p. 2. ACM, 2006.

Included Round 3

39 Xu, Lihua, Hadar Ziv, Thomas A. Alspaugh, and Debra J. Richardson. "An architectural pattern for non-functional dependability requirements." Journal of Systems and

Included Pilot


Software 79, no. 10 (2006): 1370-1378.

40 Grau, Gemma, and Xavier Franch. "A goal-oriented approach for the generation and evaluation of alternative architectures." In Software Architecture, pp. 139-155. Springer Berlin Heidelberg, 2007.

Included Round 3

41 Harrison, Neil, and Paris Avgeriou. "Pattern-driven architectural partitioning: Balancing functional and non-functional requirements." In Digital Telecommunications, 2007. ICDT'07. Second International Conference on, pp. 21-21. IEEE, 2007.

Included Round 3

42 Pahl, Claus, Simon Giesecke, and Wilhelm Hasselbring. "An ontology-based approach for modelling architectural styles." In Software Architecture, pp. 60-75. Springer Berlin Heidelberg, 2007.

Included Round 3

43 Chen, Caixian, and Huijian Han. "The research on modern distance education system based on improved MVC pattern." In Computer Science and Software Engineering, 2008 International Conference on, vol. 5, pp. 462-465. IEEE, 2008.


44 Fernandez, Eduardo B., Mihai Fonoage, Michael VanHilst, and Mirela Marta. "The secure three-tier architecture pattern." In International Conference on Complex, Intelligent and Software Intensive Systems, pp. 555-560. IEEE, 2008.


45 Harirforoush, Maryam, Mirali Seyyedi, and Nooraldeen Mirzaee. "The evaluation of reliability based on the software architecture in neural networks." In Software Engineering Advances, 2008. ICSEA'08. The Third International Conference on, pp. 19-24. IEEE, 2008.

Included Round 3

46 Harrison, Neil B., and Paris Avgeriou. "Incorporating fault tolerance tactics in software architecture patterns." In Proceedings of the 2008 RISE/EFTS Joint International Workshop on Software Engineering for Resilient Systems, pp. 9-18. ACM, 2008.

Included Round 3

47 Harrison, Neil B., and Paris Avgeriou. "Analysis of architecture pattern usage in legacy system architecture documentation." In Software Architecture, 2008. WICSA 2008. Seventh Working IEEE/IFIP Conference on, pp. 147-156. IEEE, 2008.

Included Round 3

48 Mallet, Julien, and Siegfried Rouvrais. "Style-based model transformation for early extrafunctional analysis of distributed systems." In Quality of Software Architectures. Models and Architectures, pp. 55-70. Springer Berlin Heidelberg, 2008.

Included Round 3

49 Seffah, Ahmed, Taleb Mohamed, Halima Habieb-Mammar, and Alain Abran. "Reconciling usability and interactive system architecture using patterns."Journal of Systems and Software 81, no. 11 (2008): 1845-1852.

Included Round 3

50 Seo, Chiyoung, et al. "A framework for estimating the impact of a distributed software system's architectural style on its energy consumption." Software Architecture, 2008. WICSA 2008. Seventh Working IEEE/IFIP Conference on. IEEE, 2008.

Included Pilot

51 Fernandez, Eduardo B., and Jorge L. Ortega-Arjona. "The secure pipes and filters pattern." In Database and Expert Systems Application, 2009. DEXA'09. 20th International Workshop on, pp. 181-185. IEEE, 2009.

Included Round 3

52 John, Bonnie E., Len Bass, Elspeth Golden, and Pia Stoll. "A responsibility-based pattern language for usability-supporting architectural patterns." InProceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems, pp. 3-12. ACM, 2009.

Included Round 3

53 Moaven, Shahrouz, Ali Kamandi, Jafar Habibi, and Hamed Ahmadi. "Toward a Framework for Evaluating Heterogeneous Architecture Styles." InIntelligent Information and Database Systems, 2009. ACIIDS 2009. First Asian Conference on, pp. 155-160. IEEE, 2009.

Included Round 3

54 Mouratidis, Haralambos, and Paolo Giorgini. "Enhancing secure tropos to effectively deal with security requirements in the development of multiagent systems." In Safety and Security in Multiagent Systems, pp. 8-26. Springer Berlin Heidelberg, 2009.

Included Round 3

55 Ryoo, Jungwoo, Phil Laplante, and Rick Kazman. "In search of architectural patterns for software security." Computer 6 (2009): 98-100.


56 Babu, K., P. Govinda Rajulu, A. Ramamohana Reddy, and A. N. Kumari. "Selection of architecture styles using analytic network process for the optimization of software architecture." arXiv preprint arXiv:1005.4271 (2010).


57 Becker, Jörg, Martin Matzner, and Oliver Müller. "Comparing Architectural Styles for Service-Oriented Architectures–a REST vs. SOAP Case Study." In Information Systems Development, pp. 207-215. Springer US, 2010.

Included Round 3

58 Berrocal, Javier, José García-Alonso, and Juan Manuel Murillo. "Facilitating the selection of architectural patterns by means of a marked requirements model." In Software Architecture, pp. 384-391. Springer Berlin Heidelberg, 2010.

Included Round 3

59 Bode, Stephan, and Matthias Riebisch. "Impact evaluation for quality-oriented architectural decisions regarding evolvability." In Software Architecture, pp. 182-197. Springer Berlin Heidelberg, 2010.

Included Round 3

60 Galster, Matthias, Armin Eberlein, and Mahmood Moussavi. "Systematic selection of Included Round 3


software architecture styles." Software, IET 4, no. 5 (2010): 349-360.

61 Harrison, Neil B., Paris Avgeriou, and Uwe Zdun. "On the impact of fault tolerance tactics on architecture patterns." Proceedings of the 2nd International Workshop on Software Engineering for Resilient Systems. ACM, 2010.

Included Pilot

62 Harrison, Neil B., and Paris Avgeriou. "How do architecture patterns and tactics interact? A model and annotation." Journal of Systems and Software 83, no. 10 (2010): 1735-1758.

Included Pilot

63 Kumar, Kiran, and T. V. Prabhakar. "Pattern-oriented knowledge model for architecture design." In Proceedings of the 17th Conference on Pattern Languages of Programs, p. 23. ACM, 2010.

Included Round 3

64 Kumar, Kiran, and T. V. Prabhakar. "Design decision topology model for pattern relationship analysis." In Proceedings of the 1st Asian Conference on Pattern Languages of Programs, p. 3. ACM, 2010.

Included Round 3

65 Sharafi, Sayed Mehran, Golnaz Aghaee Ghazvini, and Sima Emadi. "An analytical model for performance evaluation of software architectural styles." In Software Technology and Engineering (ICSTE), 2010 2nd International Conference on, vol. 1, pp. V1-394. IEEE, 2010.

Included Round 3

66 Xu, Xiwei, Liming Zhu, Udo Kannengiesser, and Yan Liu. "An architectural style for process-intensive web information systems." In Web Information Systems Engineering–WISE 2010, pp. 534-547. Springer Berlin Heidelberg, 2010.

Included Round 3

67 Zheng, Jiang, and K. Eric Harper. "Concurrency design patterns, software quality attributes and their tactics." In Proceedings of the 3rd International Workshop on Multicore Software Engineering, pp. 40-47. ACM, 2010.

Included Round 3

68 Ameller, David, Oriol Collell, and Xavier Franch. "Reconciling the 3-layer Architectural Style with the Eclipse Plug-in-based Architecture." In Proceedings of the 1st Workshop on Developing Tools as Plug-ins, pp. 20-23. ACM, 2011.

Included Round 3

69 Banodha, Umesh, and Kanak Saxena. "Impact of Pipe and Filter Style on Medical Process Re-engineering." International Journal of Engineering Sciences 4 (2011): 398-409.


70 Pappu, Nagaraju, Satish Sukumar, and Feroz Sheikh. "A Supportability Framework." In Software Architecture (WICSA), 2011 9th Working IEEE/IFIP Conference on, pp. 137-146. IEEE, 2011.

Included Round 3

71 Reza, Hassan, and Kirk Ogaard. "Modeling of UAS Swarms Using Dynamic and Re-Configurable Software Architecture." In Systems Engineering (ICSEng), 2011 21st International Conference on, pp. 377-382. IEEE, 2011.

Included Round 3

72 Franco, Joao M., Raul Barbosa, and Mário Zenha-Rela. "Automated reliability prediction from formal architectural descriptions." In Software Architecture (WICSA) and European Conference on Software Architecture (ECSA), 2012 Joint Working IEEE/IFIP Conference on, pp. 302-309. IEEE, 2012.

Included Round 3

73 Garcia-Alonso, Jose, Javier Berrocal Olmeda, and Juan Manuel Murillo. "Architectural variability management in multi-layer web applications through feature models." In Proceedings of the 4th International Workshop on Feature-Oriented Software Development, pp. 29-36. ACM, 2012.

Included Round 3

74 Kassab, Mohamad, Ghizlane El-Boussaidi, and Hafedh Mili. "A quantitative evaluation of the impact of architectural patterns on quality requirements." InSoftware Engineering Research, Management and Applications 2011, pp. 173-184. Springer Berlin Heidelberg, 2012.

Included Pilot

75 Maciaszek, Leszek A. "An Architectural style for trustworthy adaptive service based applications." In Business System Management and Engineering, pp. 109-121. Springer Berlin Heidelberg, 2012.

Included Round 3

76 Mcheick, Hamid, Shalom Dodge, and Marcel Karam. "Service oriented specification and study of quality performance attribute." In Communications and Information Technology (ICCIT), 2012 International Conference on, pp. 80-84. IEEE, 2012.

Included Round 3

77 Yang, Hongji, Shang Zheng, William Cheng-Chung Chu, and Ching-Tsorng Tsai. "Linking functions and quality attributes for software evolution." InSoftware Engineering Conference (APSEC), 2012 19th Asia-Pacific, vol. 1, pp. 250-259. IEEE, 2012.

Included Round 3

78 Ameller D, Collell O, Franch X. The Three‐Layer architectural pattern applied to plug‐in‐based architectures: the Eclipse case. Software: Practice and Experience. 2013 Apr 1;43(4):391-402.

Included Round 3

79 Belle, Alvine Boaye, Ghizlane El-Boussaidi, Christian Desrosiers, and Hafedh Mili. "The layered architecture revisited: Is it an optimization problem?." In SEKE, pp. 344-349. 2013.

Included Round 3

80 Pruijt, Leo, Wiebe Wiersema, and Sjaak Brinkkemper. "A typology based approach to assign responsibilities to software layers." In Proceedings of the 20th Conference on Pattern Languages of Programs, p. 2. The Hillside Group, 2013.

Included Round 3


81 Silva, Francisco, Marcelo Lucena, and Leonardo Lucena. "STREAM-AP: A process to systematize architectural patterns choice based on NFR." In Twin Peaks of Requirements and Architecture (TwinPeaks), 2013 3rd International Workshop on the, pp. 27-34. IEEE, 2013.

Included Pilot

82 Solms, Fritz. "Experiences with using the systematic method for architecture recovery (SyMAR)." In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference, pp. 170-178. ACM, 2013.

Included Round 3

83 Alebrahim, Azadeh, and Maritta Heisel. "Towards Developing Secure Software Using Problem-Oriented Security Patterns." In Availability, Reliability, and Security in Information Systems, pp. 45-62. Springer International Publishing, 2014.

Included Round 3

84 Belle, Alvine Boaye, Ghizlane El Boussaidi, and Hafedh Mili. "Recovering software layers from object oriented systems." In Evaluation of Novel Approaches to Software Engineering (ENASE), 2014 International Conference on, pp. 1-12. IEEE, 2014.

Included Round 3

85 Berrocal, Javier, José García-Alonso, and Juan Manuel Murillo. "Modeling business and requirements relationships for architectural pattern selection." In Software engineering research, management and applications, pp. 167-181. Springer International Publishing, 2014.

Included Round 3

86 Chen, Xiuhong, Wenqian Zhang, Peng Liang, and Keqing He. "A replicated experiment on architecture pattern recommendation based on quality requirements." In Software Engineering and Service Science (ICSESS), 2014 5th IEEE International Conference on, pp. 32-36. IEEE, 2014.

Included Round 3

87 Chong, Chun Yong, Sai Peck Lee, and Teck Chaw Ling. "Prioritizing and fulfilling quality attributes for virtual lab development through application of fuzzy analytic hierarchy process and software development guidelines."Malaysian Journal of Computer Science 27, no. 1 (2014).


88 Costa, Bruno, Paulo F. Pires, Flávia C. Delicato, and Paulo Merson. "Evaluating a Representational State Transfer (REST) Architecture: What is the Impact of REST in My Architecture?." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 105-114. IEEE, 2014.

Included Round 3

89 Kim, Dae-Kyoo, Jungwoo Ryoo, and Suntae Kim. "Building Sustainable Software by Preemptive Architectural Design Using Tactic-Equipped Patterns."Availability, Reliability and Security (ARES), 2014 Ninth International Conference on. IEEE, 2014.

Included Pilot

90 Kosmajac, Dijana, Vladimir Vujovic, Milan Maksimovic, Nikola Davidovic, and Branko Perisic. "MasterBroker: REST oriented service broker." InIntelligent Engineering Systems (INES), 2014 18th International Conference on, pp. 227-232. IEEE, 2014.

Included Round 3

91 Parvizi-Mosaed, Alireza, Shahrouz Moaven, Jafar Habibi, and Abbas Heydarnoori. "Towards a Tactic-Based Evaluation of Self-Adaptive Software Architecture Availability." In SEKE, pp. 168-173. 2014.

Included Round 3

92 Philip, Milu Mary, and B. Vijayakumar. "Software Architectural Design for Image Retrieval System involving Data Streams and User Interactivity." InProceedings of the World Congress on Engineering and Computer Science, vol. 1. 2014.

Included Round 3

93 Syromiatnikov, Artem, and Danny Weyns. "A Journey through the Land of Model-View-Design Patterns." In Software Architecture (WICSA), 2014 IEEE/IFIP Conference on, pp. 21-30. IEEE, 2014.

Included Round 3

94 Tahmasebipour, Safieh, and Seyed Morteza Babamir. "Ranking of Common Architectural Styles Based on Availability, Security and Performance Quality Attributes." Journal of Computing and Security 1, no. 2 (2014).


95 Elahi, Abdolkarim, and Seyed Morteza Babamir. "Evaluating software architectural styles based on quality features through hierarchical analysis and Fuzzy Integral (FAHP)." In Information and Knowledge Technology (IKT), 2015 7th Conference on, pp. 1-6. IEEE, 2015.

Included Round 3

96 Grozev, Nikolay, and Rajkumar Buyya. "Performance modelling and simulation of three-tier applications in cloud and multi-cloud environments."The Computer Journal 58, no. 1 (2015): 1-22.

Included Round 3

97 Harper, Karl Eric, Jiang Zheng, Sam Ade Jacobs, Aldo Dagnino, Anton Jansen, Thomas Goldschmidt, and Adamantios Marinakis. "Industrial Analytics Pipelines." In Big Data Computing Service and Applications (BigDataService), 2015 IEEE First International Conference on, pp. 242-248. IEEE, 2015.

Included Round 3

98 Moaven, Shahrouz, Jafar Habibi, Razie Alidoosti, and Alireza Parvizi Mosaed. "Towards a Knowledge Based Approach to Style Driven Architecture Design." Procedia Computer Science 62 (2015): 236-244.

Included Round 3


99 Salama, Maria, and Rami Bahsoon. "Quality-Driven Architectural Patterns for Self-Aware Cloud-Based Software." In Cloud Computing (CLOUD), 2015 IEEE 8th International Conference on, pp. 844-851. IEEE, 2015.

Included Round 3

Use this references’ number for the rest of the protocol


3.5 ANALYSIS

3.6 Approaches and interaction types

Table 7-Approaches and types of interactions

STUDY APPROACH TYPE OF INTERACTION

1 Functionality Oriented Undetermined

2 Quality Driven Method Undetermined

3 Quantitative-Prediction-Formal Model Measurability

4 Design Method Fitness&Satisfaction

5 Design Method Trade-offs



8 Business Process-Real World Oriented Undetermined



11 Design Method Undetermined

12 Decision Making Fitness&Satisfaction

13 Views- Scenario Based Undetermined

14 Views- Scenario Based Scenario-Based

15 Quality Driven Method Trade-offs

16 Specific Domain Method Undetermined

17 Specific Domain Method Softgoals

18 Decision Making Problem Space-Solution Space Interaction


20 Evaluation Method Undetermined

21 Ontology-Pattern Language-Topology-Taxonomy Undetermined

22 Views- Scenario Based Undetermined

23 Evaluation Method Materialization

24 Specific Domain Method Business Process-Real World Oriented

25 Quantitative-Prediction-Formal Model Trade-offs


27 Knowledge Based Interaction as Knowledge

28 Views- Scenario Based Scenario-Based

29 Decision Making Undetermined



32 Decision Making Undetermined

33 Views- Scenario Based views and viewpoint

34 Decision Making Trade-offs

35 Knowledge Based Undetermined

36 Pattern QA characterization Characterization

37 Design Method Capturing

38 Ontology-Pattern Language-Topology-Taxonomy Representability

39 Quantitative-Prediction-Formal Model Undetermined


40 Decision Making Actors and dependencies

41 Design Method Functional/Non Functional


43 Technical Method Undetermined

44 Pattern QA characterization Materialization


46 Decision Making Tactics

47 Knowledge Based Undetermined


49 Quality Driven Method Scenario-Based





54 Specific Domain Method Transformation



57 Decision Making Technical

58 Functionality Oriented Functional/Non Functional


60 Decision Making Appropriateness





65 Quantitative-Prediction-Formal Model Markov Model



68 Views- Scenario Based views and viewpoint

69 Business Process-Real World Oriented Real World


71 Quantitative-Prediction-Formal Model Fitness&Satisfaction

72 Quantitative-Prediction-Formal Model Markov Model

73 Technical Method Technical

74 Quantitative-Prediction-Formal Model Tactics

75 Pattern QA characterization Undetermined


77 Functionality Oriented Undetermined



80 Ontology-Pattern Language-Topology-Taxonomy Responsibilities





85 Business Process-Real World Oriented Relationship

86 Knowledge Based Tactics



88 Evaluation Method Trade-offs












Table 8-Frequency of type of interactions

Number of studies per type

Type of Interaction described

Total number of studies

35 Undetermined 35

12 Tactics 12

8 Measurability 8

7 Fitness & Satisfaction 7

6 Interaction as knowledge 5

5 Trade-offs 5

3 Scenario-based; Characterization of patterns with a QA 6

2 Functional-Non-functional; Markov Model; Views and Viewpoint; Materialization; Technical; Real world requirements (QAs)- Systems specification (Patterns);

12

1 Responsibilities; Appropriateness; Capturing; Actors and dependencies; Relationship; Representability; Softgoals; Problem space-Solution space interaction; Transformation

9

Table 9-Frequency of approaches

Type of Approaches Number of Studies Focus on

Decision-Making 22 How to support architectural decisions: e.g. hierarchies of QAs for prioritizing decisions

Quantitative-Prediction-Formal Model 16 Support of architectural choice with quantitative assessment of QAs

Design Method 8 Holistic method, focus on the process of designing systems architecture

Knowledge Based 8 Reusable and well-known knowledge on patterns and QAs

Evaluation Method 7 The focus is on the process of evaluating architecture

Pattern QA characterization 7 Patterns are characterized by a single QA ( e.g. Security Broker)

Ontology-Pattern Language-Topology-Taxonomy

6 The focus is on the description and definition both of patterns , or quality attributes (Taxonomies)

Specific Domain Method 6 Those studies focus on a specific context, e.g. multi-agent system

Views- Scenario Based 6 Those studies extract information on patterns-QAs interaction using scenarios as particular instance of the system

Quality Driven Method 5 Those studies consider the entire process of architecting as achieving quality

Business Process-Real World Oriented 3 Those studies explore how patterns and QAs can effectively address specific real world challenges

Functionality Oriented 3 Those studies explore the link between functionalities and quality

Technical Method 2 Those studies explore the patterns and QAs in terms of how to capture technological complexity


3.7 Patterns and Quality attributes frequency

Table 10-Pattern Frequency

Pattern Frequency

Layered 33

Pipes & Filters 31

Blackboard 20

MVC 19

Broker 15

Client Server 14

Microkernel 12

Combination 10

PAC 7

Peer-to-Peer 6

Batch-Sequential 5

C2 4

Fault-Tolerance 4

Publish Subscribe 4

Reflection 4

Multi Agent Systems 3

Repository 3

REST 3

Call and Return 2

Control Loop 2

Interpreter 2

Observer 2

Self-Adaptive Patterns 2

Shared Repository 2

SOA 2

Unrecognized 2

Abstract Data Type 1

Abstract Factory 1

Active Repository 1

Agent System Pattern 1

Asynchronous Processing 1

Builder 1

Concurrent Pipelines 1

Event-Based Implicit Invocation 1

Explicit Invocation 1

Half Sync/Half Async 1

Hub-and-Spoke 1

Implicit Invocation 1

Indirection/Binding 1

Interacting Process 1

Interceptor 1


Leaders/ Followers 1

Main/Subroutine 1

Message Queuing 1

Multi-Tier 1

N3-Tier 1

New Pattern 1

Object-Oriented 1

Parallel 1

Remote Procedure Calls 1

Rule Based System 1

SOAP 1

State Transition 1

Three-Tier 1

Virtual Machine 1

Table 11- Quality attributes

Qas Frequency

Efficiency 43

Performance 82

Availability 31

Scalability 32

Portability 32

Fault-Tolerance 5

Extensibility 16

Modifiability 44

Maintainability 60

Reliability 73

Flexibility 7

Usability 39

Security 71

Functionality 18

Reusability 37

Manageability 2

Safety 2

Testability 6

Simplicity 9

Interoperability 10

Integrability 17

Losely Coupling 2

Visibility 2

Composability 2

Dependability 1

Energy efficiency 6

Evolvability 13

Standardization 2


Configurability 7

Dynamic Configurability 5

Adaptability 8

Modularity 4

Greenability 1

Understability 5

Reactivity 1

Load Balancing 1

Fairness 1

Robustness 1

Changeability 1

Exchangeability 2

Analizability 1

Location Transparency 3

Not Recognizable 6

Table 12-Key

Not present in ISO 9126 nor in 25010:2011

Present in both standard

Present Only in 25010

Present Only in 9126

3.8 Change Log

Date Changes Author 21.02.2016 h03:18 AOE

Repaired list of primary studies ( two duplicates copied and pasted by mistake ) hits number 49 moved to 87 and 121 replaced

Gianantonio Me

21.02.2016 h04:41 AOE

Version Updated on-line 1.2 Gianantonio Me

20.03.2016 h22.02 AOE

Updated list of included studies, repaired minor inconsistiencies detected by WICSA reviewer 2 Gianantonio Me

02.05.2016 h05.56 Updated list of included studies, tables on results Gianantonio Me

a systematic literature review on architectural … · a literature review study supports...

Documents