[ieee 2008 third international conference on digital information management (icdim) - london, united...

6
Comparative Study on Null Boundary and Periodic Boundary 3-Neighborhood Multiple Attractor Cellular Automata for Classification Anirban Kundu 1,2 , Alok Ranjan Pal 2 , Tanay Sarkar 2 , Moutan Banerjee 2 , Sutirtha Kr. Guha 2 , and Debajyoti Mukhopadhyay 2,3 1 Netaji Subhash Engineering College West Bengal University of Technology Calcutta 700152, India 2 Web Intelligence & Distributed Computing Research Lab (WIDiCoReL) Green Tower C-9/1, Golf Green, Calcutta 700095, India 3 Calcutta Business School Diamond Harbour Road, Bishnupur, West Bengal 743503, India {anik76in, chhaandasik, tanay.sarkar, moutanbanerjee, sutirthaguha, debajyoti.mukhopadhyay }@gmail.com Abstract This paper reports a generic analysis on Null Boundary and Periodic Boundary 3-neighborhood Multiple Attractor Cellular Automata (MACA) for showing the comparative study in classification technique. Cellular Automata (CA) is now-a-days an essential tool for researchers in the area of pattern recognition, pattern generation, testing field, fault diagnosis and so on. So, general knowledge on CA up to some extent is a must for researchers in these areas. A CA may be linear or non-linear in behavior. A linear/additive CA employs XOR/XNOR logic, while a non-linear CA employs AND/OR/NOT logic. This paper shows a graph analysis along with state transition behavior of CA cells. A Rule Vector Graph (RVG) is generated from the Rule Vector (RV) of a CA. Linear time algorithms are reported for generation of RVG. MACA provides an implicit memory to store the patterns. Search operation to identify the class of a pattern out of several classes boils down to running a CA for one time step. This demands storage of RV and seed values. MACA is based on sound theoretical foundation of CA technology. This paper only concentrates on MACA since it is responsible for classifying the various types of patterns. Keywords: Null Boundary Cellular Automata (NBCA), Periodic Boundary Cellular Automata (PBCA), State Transition, Rule Vector Graph (RVG). 1. Introduction The researcher in artificial life inherits the tradition of simulation. They model the world as a set of dynamic systems. Difficulties in evaluating behavior of a CA from the rules of CA cells or designing a CA to realize the desired behavior have restricted CA applications. In this background, an [3, 7] analytical formulation is reported in this paper to analyze state transition behavior of a CA. Many researchers in the field of artificial life have been enamored of a mathematical formalism of computing model known as CA. There are a lot of research works available for designing MACA [6]. Synthesis of MACA demands formation of a RV with group and non-group rules in specific sequence. The method to identify such a sequence is described in [1]. In CA world, classification depends on the formation of MACA. The RV of an n-cell CA is denoted as <R 0 , R 1 , · · · , R i , · · · , R n-1 >, where i th cell is configured with R i . A linear or non-linear [4-5] MACA consists of 2 n number of states where n is the size of MACA. The structure of a MACA has attractors (self-loop or single length cycle), non-reachable states, and transient states. The attractors form unique classes (basins). All other states reach the attractor basins after certain time steps. To classify a set of k classes, (k-1) numbers of attractors are used, each identifying a single class. [2, 8] reported illustrative ideas in this regard. Rest of the paper is organized as follows: in Section 2 CA Preliminaries are discussed; Section 3 978-1-4244-2917-2/08/$25.00 ©2008 IEEE 204

Upload: debajyoti

Post on 28-Feb-2017

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

Comparative Study on Null Boundary and Periodic Boundary

3-Neighborhood Multiple Attractor Cellular Automata for Classification

Anirban Kundu1,2

, Alok Ranjan Pal2, Tanay Sarkar

2, Moutan Banerjee

2, Sutirtha Kr. Guha

2, and

Debajyoti Mukhopadhyay2,3

1Netaji Subhash Engineering College

West Bengal University of Technology

Calcutta 700152, India 2Web Intelligence & Distributed Computing Research Lab (WIDiCoReL)

Green Tower C-9/1, Golf Green, Calcutta 700095, India 3Calcutta Business School

Diamond Harbour Road, Bishnupur, West Bengal 743503, India

{anik76in, chhaandasik, tanay.sarkar, moutanbanerjee, sutirthaguha, debajyoti.mukhopadhyay

}@gmail.com

Abstract

This paper reports a generic analysis on Null

Boundary and Periodic Boundary 3-neighborhood

Multiple Attractor Cellular Automata (MACA) for

showing the comparative study in classification

technique. Cellular Automata (CA) is now-a-days an

essential tool for researchers in the area of pattern

recognition, pattern generation, testing field, fault

diagnosis and so on. So, general knowledge on CA up

to some extent is a must for researchers in these areas.

A CA may be linear or non-linear in behavior. A

linear/additive CA employs XOR/XNOR logic, while a

non-linear CA employs AND/OR/NOT logic. This paper shows a graph analysis along with state

transition behavior of CA cells. A Rule Vector Graph

(RVG) is generated from the Rule Vector (RV) of a CA.

Linear time algorithms are reported for generation of

RVG. MACA provides an implicit memory to store the

patterns. Search operation to identify the class of a

pattern out of several classes boils down to running a

CA for one time step. This demands storage of RV and

seed values. MACA is based on sound theoretical

foundation of CA technology. This paper only

concentrates on MACA since it is responsible for

classifying the various types of patterns.

Keywords: Null Boundary Cellular Automata

(NBCA), Periodic Boundary Cellular Automata

(PBCA), State Transition, Rule Vector Graph (RVG).

1. Introduction

The researcher in artificial life inherits the

tradition of simulation. They model the world as a set

of dynamic systems. Difficulties in evaluating

behavior of a CA from the rules of CA cells or

designing a CA to realize the desired behavior have

restricted CA applications. In this background, an [3,

7] analytical formulation is reported in this paper to

analyze state transition behavior of a CA. Many

researchers in the field of artificial life have been

enamored of a mathematical formalism of computing

model known as CA. There are a lot of research works

available for designing MACA [6]. Synthesis of

MACA demands formation of a RV with group and

non-group rules in specific sequence. The method to

identify such a sequence is described in [1]. In CA

world, classification depends on the formation of

MACA. The RV of an n-cell CA is denoted as <R0,

R1, · · · , Ri, · · · , Rn-1>, where ith

cell is configured

with Ri. A linear or non-linear [4-5] MACA consists of

2n number of states where n is the size of MACA. The

structure of a MACA has attractors (self-loop or single

length cycle), non-reachable states, and transient

states. The attractors form unique classes (basins). All

other states reach the attractor basins after certain time

steps. To classify a set of k classes, (k-1) numbers of

attractors are used, each identifying a single class. [2,

8] reported illustrative ideas in this regard.

Rest of the paper is organized as follows: in

Section 2 CA Preliminaries are discussed; Section 3

978-1-4244-2917-2/08/$25.00 ©2008 IEEE 204

Page 2: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

presents the Analysis of CA; and, Conclusion is

depicted in Section 4.

2. CA Preliminaries

A Cellular Automata (CA) is a model which can

be used to show how the elements of a system interact

with each other. Each element of the system is

assigned a cell. The cells are of various types like 1D,

2D, 3D, etc.. In this paper, we are only concerned

about 1D CA with 3-neiborhood configuration. To

form one-dimensional cellular automata, cells are

generally connected with its neighbors in both

directions. Cellular automata can serve as a source of

random numbers which are used for encrypting

messages, running simulations and other purposes.

The configurations of a succession of CA generations

can be used as a random sequence. One-dimensional

CA is normally used for this purpose. The simplest

nontrivial CA would be one-dimensional, with two

possible states per cell (1/0), and a cell’s neighbors

defined to be the adjacent cells on either side of it.

These neighbors are known as left-neighbor & right

neighbor. A cell and its two neighbors form a

neighborhood of 3 cells, so there are 23=8 possible

patterns for a neighborhood. There are then 28=256

possible rules.

An n cell CA consists of n cells (Figure 1(a)) with

local interactions [9]. It evolves in discrete time and

space. The next state function of three neighborhood

CA cell (Figure 1(b)) can be represented as a rule as

defined in Table 1 [7]. First row of Table 1 represents

23 = 8 possible present states of 3 neighbors of i

th cell -

(i-1), i, (i+1) cells. Each of the 8 entries (3 bit binary

string) represents a min term of a 3 variable Boolean

function for a 3 neighborhood CA cell. In subsequent

discussions, each of the 8 entries in Table 1 is referred

to as a Rule Min Term (RMT).

The decimal equivalent of 8 min terms are 0, 1, 2,

3, 4, 5, 6, 7 noted within ( ) below the three bit string.

Each of the next five rows of Table 1 shows the next

state (0 / 1) of ith

cell. Hence, there can be 28 = 256

possible bit strings. The decimal counterpart of such

an 8 bit combination is referred to as a CA rule [3, 7].

The rule of a CA cell can be derived from Table 1 of

the ith

cell.

2.1. Definitions

Definition 1: Group CA - Each state in the state

transition behavior of a group CA has only one

predecessor and consequently each state is reachable

from only one state. A group CA traverses all the

states in a cycle. A group CA is a reversible CA in the

sense that the CA will always return to its initial state.

Definition 2: Non-Group CA - A non-group CA has

states that have r number of predecessors, where r = 0,

1, 2, 3, · · ·

Definition 3: Attractor Cycle - The set of states in a

cycle is referred to as an attractor cycle.

Definition 4: Rule Vector (RV) - The sequence of

rules < R0R1 · · ·Ri · · ·Rn+1 >, where ith

cell is

configured with rule Ri.

Definition 5: Rule Vector Graph (RVG) - A graph,

derived from the RV (Rule Vector) of a CA is referred

to as RVG. A node in RVG represents a set of RMTs

(Rule Min Terms) while an edge between a pair of

nodes represents the next state value (0 / 1) of a cell

for specific RMTs. Derivation of the RVG from the

RV (Rule Vector) of a CA follows.

Figure 1 Local Interaction between Cellular

Automata Cells

Table 1 Truth Table of sample rules of a CA cell showing the next state logic for the Minterms of a 3 variable

Boolean function - The 8 minterms having decimal values 0, 1, 2, 3, 4, 5, 6, 7 are referred to as Rule Minterms

(RMTs)

205

Page 3: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

3. Analysis of CA

One-dimensional (1D) Cellular Automata (CA)

over finite fields are studied in which each interior

(local) cell is updated to contain the sum of the

previous values of its two nearest (left & right)

neighbors along with its own cell value. Boundary

cells are updated according to Null Boundary

conditions. For a given initial configuration, the CA

evolves through state transitions to an attracting cycle

which is defined as attractor / basin (refer Definition

3). The number of cycles can be determined from the

minimal polynomial and characteristic polynomial of

the updated matrix which is formed by the linear CA.

For detailed theoretical study, follow [3]. But, in case

of non-linear CA, matrix can not be formed since it

does not follow any regular mathematics. So, as per

Definition 4, CA can be expressed as RV in both the

cases. Figure 1 shows an example of NBCA with RV

<0, 255, 2, 5>. Leftmost & rightmost cells are ground

as shown in the figure.

Figure 2 Example of Null Boundary CA

Figure 3 Example of Periodic Boundary CA

In case of periodic CA, we have considered the

rightmost cell as the left neighbor of leftmost cell.

Similarly, the leftmost cell is considered as the right

neighbor of rightmost cell. So, it is like a circular

linked list data structure. Figure 3 shows PBCA.

In this paper, we have mainly concentrated on the

variation of state transition of Null Boundary &

Periodic Boundary MACA for the sake of

classification techniques in various fields. The

attractors of MACA can be treated as the classifier

basins for separating different type of data or topic. It

has been found that there is a tendency for achieving

more number of attractors in a PBCA compared to

NBCA. In this paper, the overall analysis is done

based on state transition behavior and RVG of CA

cells.

3.1. State Transition based Observation

Observation 1: State Transition behaviors of Rule

Vector (RV) <2, 44, 4, 21> in Null Boundary &

Periodic Boundary mode have been shown in Figure 4.

In Null Boundary case, only one attractor (state “1”)

has been found whereas in Periodic Boundary case,

two attractors (states “1” & “5”) have been found. It is

found through exhaustive experimentation that there is

a tendency to have more number of attractors in case

of Periodic Boundary MACA compared to Null

Boundary MACA in maximum cases.

Null Boundary Periodic Boundary

Attractor - 1

Attractor - 1, 5

Figure 4 State Transition behaviors of Rule Vector (RV) <2, 44, 4, 21>

0 255 2 5

0 255 2 5

206

Page 4: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

Null Boundary Periodic Boundary

Attractor - 0

Attractor - 0

Figure 5 State Transition behaviors of Rule Vector (RV) <90, 90, 90, 90>

Observation 2: State Transition behaviors of Rule

Vector (RV) <90, 90, 90, 90> in Null Boundary &

Periodic Boundary mode have been shown in Figure 5.

In both Null Boundary & Periodic Boundary case,

only one attractor (state “0”) has been found. Here,

Null Boundary case is basically a Group CA

(Definition 1) having all the states within some cycles

of state transition. After applying the Periodic

Boundary concept on this RV, a MACA is found. So,

there is a tendency to generate a Non-group CA

(Definition 2) in case of PBCA compared to Null

Boundary CA in maximum cases. In this particular

case, a MACA has been formed in Periodic Boundary

by applying the periodic neighborhood concept upon

the initial Group CA of Null Boundary. So, it is

possible to get a MACA structure from Group CA for

formation of a classifier.

Algorithm 1 depicts the generic state transition

technique of any NBCA or PBCA.

Algorithm 1: Null / Periodic Boundary State

Transition

Input: CA Size and Rule Vector

Output: State transition diagram

Step 1: Convert decimal rule values into binary

Step 2: Create RMT Table (refer Table 1)

Step 3: Loop (start)

Step 4: Pick seedi and apply corresponding rule on it

Step 5: Store next state value

Step 6: Loop (Stop)

Step 7: Stop

Firstly, CA Size and Rule Vector are taken as

inputs. After that, conversion of decimal rule into

binary for creating RMT table (8 X CA size) has been

done. Since, 3-neighborhood Cellular Automata (CA)

has been used in our approach, that’s why it should be

23 = 8 combinations. It means {0 to 7} columns should

be there in the RMT table and the number of rows will

depend on CA size at runtime. Then, pick a seed

arbitrarily and apply corresponding rule on it. Store

the next state value within a temporary variable. The

state diagrams of NBCA and PBCA have been created

using Algorithm 1. The only difference of these two

boundary concepts is whether leftmost [0th

] &

rightmost [(n-1)st] cells are ground or interconnected.

Generally, we have to consider (i-1, i, i+1) cells for

calculating the next state value of the ith

cell of a

particular CA in 3-neighborhood condition. In Null

Boundary case, for 0th

cell, the left neighbor [(i-1)th

cell] should be ground. Similarly, for (n-1)th

cell, the

right neighbor [(i+1)th

cell] should be ground. On the

other hand, in case of Periodic Boundary, leftmost &

rightmost cells are connected to each other. Through

our experimentation, it is clear that we can get greater

than or equal number of attractors in Periodic

Boundary case as compared to Null Boundary 3-

neighborhood CA in most of the cases. So, more

number of classes can be achieved for classification of

patterns by increasing the number of attractors within

the structure of a CA. Most benefited advantage is that

we can search more number of pages in a short time

using less memory [1, 10].

3.2. RVG based Observation

An arbitrary CA is shown in Figure 6 for

representing it in RVG form. RVG consists of several

nodes and each node consists of maximum two links.

These links are known as edges. Node values are RMT

values of specific rules. A RVG always starts with a

single node containing {0, 1, 2, 3} as node value in

Null Boundary case. In 3-neighbourhood NBCA, R0

(Leftmost cell) and Rn-1 (Rightmost cell) have four

207

Page 5: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

don’t care positions in its concerned RMTs. So, in case

of R0, the effective RMT positions are 0, 1, 2 & 3.

Similarly, for Rn-1, the effective RMT positions are 0,

2, 4 & 6 as discussed in [10]. In 3-neighbourhood

NBCA, RMT values range from (0-7). So, maximum

eight values are there within the RVG. Any

combination of (0-7) can be a node value depending

on the applied rule on the particular level of RVG.

Each node can have maximum of two edges (0-edge &

1-edge). The reason behind this is each cell’s next state

value may be either ‘0’ or ‘1’. So, depending on the

probability to appear ‘0’ or ‘1’ as the next state value,

RMTs of each node is divided into two categories. So,

at any level of graph, maximum of two nodes can be

formed from each node of previous level. Figure 6

shows the RVG and corresponding RMT table of a 4-

cell CA with RV <2, 44, 4, 21> in a Null Boundary

condition.

Figure 6 Null Boundary RVG & related RMT of a 4-cell CA with RV <2, 44, 4, 21>

Figure 7 Periodic Boundary RVG & related RMT of a 4-cell CA with RV <2, 44, 4, 21>

In case of PBCA, the leftmost & rightmost cells

are interconnected. So, there is no such don’t care

RMT positions for R0 & Rn-1. The RVG of RV <2, 44,

4, 21> is shown in Figure 7 with Periodic Boundary

condition. Here, root (starting) node as well as leaf

(ending) node consists of all RMTs {0, 1, 2, 3, 4, 5, 6,

7}. So, there are some changes over the edges of the

RVG.

Observation 3: At any intermediate level of RVG, if

there is any node containing {01234567} RMTs, the

CA tends to be a MACA.

Observation 4: Number of nodes containing

{01234567} RMTs increases when Periodic Boundary

concept is imposed on the Null Boundary RVG.

Observation 5: Load balancing over the edges of

RVG is equally distributed in case of Group CA.

Observation 6: Load balancing over the edges of

RVG is not equally distributed in case of Non-group

CA like MACA.

Algorithm 2 and Algorithm 3 show how to

generate RVG for NBCA and PBCA respectively.

Rule Min Term (RMT)

111 110 101 100 011 010 001 000

0 0 0 0 0 0 1 0

0 0 1 0 1 1 0 0

0 0 0 0 0 1 0 0

0 0 0 1 0 1 0 1

R0 = 2

R1 = 44

R2 = 4

R3 = 21

01234567

01234567

01234567

01234567

01234567

0, 2, 3, 4, 5, 6, 7 / 0

0, 1, 4, 6, 7 / 0

0, 1, 3, 4, 5, 6, 7 / 0

1, 3, 5, 6, 7 / 0

1 / 1

2, 3, 5 / 1

2 / 1

0, 2, 4 / 1

2

44

4

21

208

Page 6: [IEEE 2008 Third International Conference on Digital Information Management (ICDIM) - London, United Kingdom (2008.11.13-2008.11.16)] 2008 Third International Conference on Digital

Algorithm 2: Generating RVG for NBCA

Input: RV < R0 R1 · · ·Ri · · ·Rn-1 > of ‘n’ cell CA

Output: RVG

Step 1: For a NBCA fix the Root Node as T(0, 1, 2, 3)

which represents the 0th

cell.

Step 2: For ith

level (i = 0, 1, 2, ...., (n-2)) execute Step

3 and Step 4

Step 3: For ith

cell, draw the outgoing edges from each

of input nodes generated in the previous level. Both 0-

edge and 1-edge are derived from RMT table of Rule

Ri. Two edges are marked with weight {Ti}/bi, where

{Ti}={subset of RMTs for which the next state value

of ith

cell is bi (bi € {0, 1}) as per Rule Ri}. Put a tag

on the node if 0-edge or 1-edge is missing.

Step 4: Generate next level nodes out of the subset of

RMTs {Ti} marked as weight on the edges derived in

Step 3. A node having the RMTs covered by another

node of ith

level is merged with it. The output nodes of

ith

level serve as input nodes for (i+1)th

level.

Step 5: The edges from the output nodes of (n-2)th

level (i.e., input nodes of (n-1)th

level) to the leaf node

T(0, 1, 4, 5) are derived as per the rule Rn-1.

Step 6: Stop.

Algorithm 3: Generating RVG for PBCA

Input: RV < R0 R1 · · ·Ri · · ·Rn-1 > of ‘n’ cell CA

Output: RVG

Step 1: For a PBCA fix the Root Node as T(0, 1, 2, 3,

4, 5, 6, 7) which represents the 0th

cell.

Step 2: For ith

level (i = 0, 1, 2, ...., (n-2)) execute Step

3 and Step 4

Step 3: For ith

cell, draw the outgoing edges from each

of input nodes generated in the previous level. Both 0-

edge and 1-edge are derived from RMT table of Rule

Ri. Two edges are marked with weight {Ti}/bi, where

{Ti}={subset of RMTs for which the next state value

of ith

cell is bi (bi € {0, 1}) as per Rule Ri}. Put a tag

on the node if 0-edge or 1-edge is missing.

Step 4: Generate next level nodes out of the subset of

RMTs {Ti} marked as the weight on the edges derived

in Step 3. A node having the RMTs covered by

another node of ith

level is merged with it. The output

nodes of ith

level serve as input nodes for (i+1)th

level.

Step 5: The edges from the output nodes of (n-2)th

level (i.e., input nodes of (n-1)th

level) to the leaf node

T(0, 1, 2, 3, 4, 5, 6, 7) are derived as per the rule Rn-1.

Step 6: Stop.

4. Conclusion

This paper reports analysis of MACA behavior for

classification purpose. The enhancement of pattern

classification can be performed using this analysis.

Both the state transition and graph analysis have been

discussed separately for finding out the distinguished

characteristic changes. In terms of pattern classifier,

the superiority of periodic boundary MACA with

reference to null boundary MACA is achieved with

respect to the generation of number of classes. Group

CA can also be modified into MACA structure

introducing Periodic Boundary.

References

[1] Anirban Kundu, Ruma Dutta, Debajyoti Mukhopadhyay,

“Generation of SMACA and its Application in Web

Services,” 9th International Conference on Parallel

Computing Technologies, PaCT 2007 Proceedings, Russia,

September 3-7, 2007.

[2] S. Chattopadhyay, S. Adhikari, S. Sengupta, M. Pal,

“Highly regular, modular, and cascadable design of cellular

automata-based pattern classifier,” IEEE Trans. on VLSI

Systems, Volume 8, No. 6, December 2000.

[3] P. P. Chaudhuri, D. R. Chowdhury, S. Nandi, S.

Chatterjee, “Additive Cellular Automata, Theory and

Applications, Vol.1,” IEEE Computer Society Press, Los

Alamitos, California, vol. ISBN-0-8186-7717-1, 1997.

[4] S. Das, A. Kundu, S. Sen, B. K. Sikdar, P. P. Chaudhuri,

“Non-Linear Celluar Automata Based PRPG Design

(Without Prohibited Pattern Set) In Linear Time

Complexity,” Asian Test Symposium, 78-83, 2003.

[5] S. Das, A. Kundu, B. K. Sikdar, “Nonlinear CA Based

Design of Test Set Generator Targeting Pseudo-Random

Pattern Resistant Faults,” Asian Test Symposium, 196-201,

2004.

[6] P. Maji, C. Shaw, N. Ganguly, B. K. Sikdar, P. P.

Chaudhuri, “Theory and Application of Cellular Automata

For Pattern Classification,” Fundamenta Informaticae, vol.

58, pp. 321-354, December 2003.

[7] S. Wolfram, “Theory and Application of Cellular

Automata,” World Scientific, 1986.

[8] S. Nandi, P. Chaudhuri, “Analysis of Periodic and

Intermediate Boundary 90/150 Cellular Automata,” IEEE

Transactions on Computers, 45(1), 1-11.

[9] J. V. Neumann, “The Theory of Self-Reproducing

Automata,” A. W. Burks, Ed. University of Illinois Press,

Urbana and London, 1966.

[10] Anirban Kundu, Ruma Dutta, Debajyoti

Mukhopadhyay, “Design of SMACA: Synthesis & its

Analysis through Rule Vector Graph for Web based

Application,” International Journal of Intelligent

Information and Database Systems, Vol. 2, No. 4, 2008.

209