design of single-electron systems through artificial evolution

15
INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONS Int. J. Circ. Theor. Appl. 2000; 28:585–599 Design of single-electron systems through articial evolution Adrian Thompson 1; *; and Christoph Wasshuber 2 1 Centre for Computational Neuroscience and Robotics; and Centre for the Study of Evolution; School of Cognitive and Computing Sciences; University of Sussex; Brighton; U.K. 2 4106 Springhill Estates Drive; Parker; TX 75002; U.S.A. SUMMARY We show how evolutionary methods can help in the design of single-electronic circuits with an example of evolving a simple NOR gate. Evolutionary algorithms, capturing the bare essentials of Darwinian evolution, work dierently from conventional design methods, and have the potential to explore new territory. Our preliminary evolved circuit is far from an ideal NOR gate, but has interesting properties. It was evolved to work at a temperature of 340 mK, and its performance deteriorates if the temperature is lowered, as well as if it is increased. This is contrary to the usual behaviour of single-electronic circuits, which generally improve with decreasing temperature. We hypothesize that the circuit exploits or relies upon the simulated eects of the particular thermal energies of the electrons at around 340 mK. Copyright ? 2000 John Wiley & Sons, Ltd. KEY WORDS: nanoelectronic circuit design; evolutionary algorithms; design automation; single-electron circuit simulation; physics of computation 1. INTRODUCTION This paper discusses the use of evolutionary algorithms to design single-electron systems, and describes a rst exploratory experiment. Although evolutionary design does not circumvent all of the design challenges faced in making the technology viable, we show that some of its dierences from conventional design can be helpful. An evolutionary algorithm, while very dierent from evolution in nature, captures the bare essentials of Darwinian evolution: selection acting repeatedly upon heritable variation. Such algorithms [1] have been used in engineering design and optimization since the 1960s [2], developed under the names of evolution strategies [2,3], evolutionary programming [4], genetic algorithms [5] and genetic programming [6]. * Correspondence to: Adrian Thompson, COGS, University of Sussex, Brighton BN1 9QH, U.K. E-mail: [email protected] Contract=grant sponsor: EPSRC; contract=grant number: GR=L60531 Received 17 April 2000 Copyright ? 2000 John Wiley & Sons, Ltd. Revised 19 July 2000

Upload: adrian-thompson

Post on 06-Jun-2016

213 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Design of single-electron systems through artificial evolution

INTERNATIONAL JOURNAL OF CIRCUIT THEORY AND APPLICATIONSInt. J. Circ. Theor. Appl. 2000; 28:585–599

Design of single-electron systems through arti�cial evolution

Adrian Thompson1;∗;† and Christoph Wasshuber21Centre for Computational Neuroscience and Robotics; and Centre for the Study of Evolution; School of

Cognitive and Computing Sciences; University of Sussex; Brighton; U.K.24106 Springhill Estates Drive; Parker; TX 75002; U.S.A.

SUMMARY

We show how evolutionary methods can help in the design of single-electronic circuits with an exampleof evolving a simple NOR gate. Evolutionary algorithms, capturing the bare essentials of Darwinianevolution, work di�erently from conventional design methods, and have the potential to explore newterritory. Our preliminary evolved circuit is far from an ideal NOR gate, but has interesting properties.It was evolved to work at a temperature of 340mK, and its performance deteriorates if the temperatureis lowered, as well as if it is increased. This is contrary to the usual behaviour of single-electroniccircuits, which generally improve with decreasing temperature. We hypothesize that the circuit exploitsor relies upon the simulated e�ects of the particular thermal energies of the electrons at around 340mK.Copyright ? 2000 John Wiley & Sons, Ltd.

KEY WORDS: nanoelectronic circuit design; evolutionary algorithms; design automation; single-electroncircuit simulation; physics of computation

1. INTRODUCTION

This paper discusses the use of evolutionary algorithms to design single-electron systems, anddescribes a �rst exploratory experiment. Although evolutionary design does not circumventall of the design challenges faced in making the technology viable, we show that some of itsdi�erences from conventional design can be helpful.An evolutionary algorithm, while very di�erent from evolution in nature, captures the bare

essentials of Darwinian evolution: selection acting repeatedly upon heritable variation. Suchalgorithms [1] have been used in engineering design and optimization since the 1960s [2],developed under the names of evolution strategies [2,3], evolutionary programming [4], geneticalgorithms [5] and genetic programming [6].

∗Correspondence to: Adrian Thompson, COGS, University of Sussex, Brighton BN1 9QH, U.K.† E-mail: [email protected]

Contract=grant sponsor: EPSRC; contract=grant number: GR=L60531

Received 17 April 2000Copyright ? 2000 John Wiley & Sons, Ltd. Revised 19 July 2000

Page 2: Design of single-electron systems through artificial evolution

586 A. THOMPSON AND C. WASSHUBER

Applied to electronic circuit design, an evolutionary algorithm (EA) typically proceeds asfollows. An initial population of one or more candidate circuit designs is created. These initialdesigns might be created entirely at random, or could be the product of a design or searchprocedure; perhaps they are even the results of a previous run of the evolutionary algorithmon some related or simpler problem [7]. Each individual candidate design in the populationis then evaluated to give a single scalar measure of its performance, often referred to as‘�tness’.The �tness evaluation procedure may take account of several performance criteria [8]. The

primary criterion is usually the quality of behaviour, relative to a speci�cation of the desiredbehaviour. The desired behaviour might be de�ned in terms of a target input⇒output relation-ship of the circuit, in the time or frequency domain. It is also possible to require a candidatecircuit to induce a desired behaviour into a system in which it is embedded or to which it iscoupled: for example a control circuit might be evaluated according to the behaviour of therobot it controls [9]. Non-behavioural criteria such as size, power consumption, fault-toleranceand testability can also be included in the �tness evaluation if they can be measured [10–12].The candidate circuit’s operation is often simulated in software for all these tests, but forsome microelectronic circuits recon�gurable hardware such as �eld-programmable gate arrays(FPGAs) can be used [13–15].Once all of the individual candidate designs in the population have been evaluated, some

or all of them are selected to be ‘parents’. One or more o�spring are then created fromthese parents through the application of variation operators. The main variation operators are‘mutation’, which introduces small stochastic changes, and ‘crossover’ (or recombination)which takes parts from two or more parents and brings them together into one o�spring. The�tnesses of these new o�spring designs are then evaluated, and some (or all) of the originalpopulation is replaced by some (or all) of the o�spring. The procedure of this paragraph isrepeated many times.It is essential that the �tness values in uence at least one of the three points of selection

above: the selection of parents, the selection of individuals to be replaced by o�spring, and theselection of o�spring to be those replacements. If this is done so that the �tter individuals aremore likely to survive to be parents, then the ingredients of Darwinian evolution are present.All being well, �tness values will increase over time until a circuit design adequate to thedesired purpose is produced, at which point the process is stopped.The evolutionary approach can only work when it is su�ciently likely that a pathway from

the initial circuits to a satisfactory �nal one will be found through the successive application ofthe variation operators, guided through selection according to the �tness values. This dependsnot only on the fundamental structure of the design problem, but also on the �tness evaluationmethod, the selection method(s) and the variation operators. Note that if the operators areapplied to an intermediate ‘genetic’ representation of the circuit design, then the way in whichthe actual design is encoded into this representation will in uence the operators’ e�ects. Thesearch is seldom for a globally optimum design, but instead for any one of many possibleadequate solutions.Clearly, not all of electronics design can be tackled in this way. Since around 1995 there

has been a considerable impetus of research to discern when, how, and why evolutionarytechniques can be useful in electronics design [16–22]. In particular, a sequence of experimentsat the University of Sussex, UK (summarized in References [23,24]) provides the basis for ourevolution of single-electron designs to follow. These experiments were designed to determine

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 3: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 587

how radically di�erent evolved circuits can be from those produced by conventional designmethods (see also Reference [25]).In practice, there are many important di�erences between evolutionary design and conven-

tional methods. The most fundamental is that evolution proceeds through the accumulatedaction of the variation operators, and these can be largely blind. For example, a typical mu-tation operator considers each part of the design in turn, and with a small probability appliesa random change to it. The consequences of the variation do not need to be predicted in ad-vance; evolution works by taking account of the resulting changes induced into the measuredperformance of the system. Although it is possible to introduce context-sensitive or heuristicvariation operators, it is this essentially stochastic and cumulative action of the variation op-erators that distinguishes evolution from other forms of heuristic search, and even from theiterative loop of design and testing often present in bottom-up electronics design.Hence, circuits can be designed through evolution even when there is no feasible way

of analysing how the individual interactions of the components give rise to the overall be-haviour. This may be because the dynamics of the interactions are too complex, or simplybecause a tractable analytical model of the components is not available. For example, whenone evolved microelectronic circuit was investigated [26], it was found that it had acutelyexploited the semiconductor physics of the recon�gurable FPGA chip on which it was eval-uated, even aspects that were not part of the chip’s normal operation, and which were un-known to the investigators. By doing so, through ingeniously subtle means and a complexdynamics, the circuit was very much smaller than would normally be expected. This was pos-sible because none of the conventional restrictive design rules were applied, since evolutiondoes not have the same need for simplifying constraints. A decisive conclusion of the se-quence of experiments [23,24] was: Evolution can explore beyond the scope of conventionaldesign.Adaptive control algorithms (which could be evolutionary) have been proposed for the on-

line tuning of nanoelectronic circuit parameters [27]. Evolutionary algorithms have also beenapplied to the characterization of fabricated nanoelectronic devices [28], but not to the designof nanoelectronic systems. This paper now provides a case-study, as an initial exploration,and �nishes by o�ering some conclusions. The experiments will be seen to hint at excitingprospects for the approach.

2. CASE STUDY: EVOLVING A SINGLE-ELECTRON NOR GATE

We begin by investigating the evolution of a single-electron NOR gate because a simulatorsuitable for this purpose is available [29], a NOR gate is a simple circuit but a universal logicprimitive, and single-electron NOR gates have been studied before [30]. Evolution of a smallbuilding-block to be used repeatedly in larger systems is attractive: The task is susceptible tocontemporary evolutionary algorithms, which can be allowed to exploit subtly the physics ofthe medium at a �ne level of detail, while leaving the higher-level logical composition of thebuilding blocks to more conventional methods.The designs were represented as a two-dimensional array of nodes. The size was kept �xed

at 7 rows× 4 columns. Between each pair of nodes was a component selected from the set{NONE, CAPACITOR, JUNCTION, WIRE}, where JUNCTION refers to a tunnel junction. Associated witheach capacitor or junction was a real-valued capacitance in the range [4:0× 10−19; 1:0× 10−13]F.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 4: Design of single-electron systems through artificial evolution

588 A. THOMPSON AND C. WASSHUBER

Figure 1. The input waveforms for a �tness evaluation (dotted and dashed) and theideal output Videal(t) (solid).

Also associated with each junction was a tunnel resistance in the range [5:0× 104; 1:0× 109].NONE indicated the absence of a component between two nodes. A WIRE between two nodeswas a virtual construct, signifying that the connected nodes should be amalgamated intoone when the circuit is to be evaluated. Taking an example from the experiment to follow,Figure 3 shows the representation of a circuit as manipulated by the evolutionary algorithm,while Figure 4 shows the actual design so represented.The top row of nodes was supplied with a constant bias voltage Vb in the range [−1:0× 10−4;

−1:0× 10−6]V. The bottom row of nodes was connected to 0V. No components were allowedbetween the nodes in the top row, or between the nodes in the bottom row.The two inputs to the NOR gate were always attached to the same nodes, as seen at the

left in Figure 3. Also shown is the �xed position of the ‘preferred’ output node. The actualoutput was taken from a valid output node closest in Manhattan distance to the preferredoutput node. A node was a valid output node if there was a connected path to it from eachof the inputs that was at no point shorted to Vb or 0 V. In the case of multiple valid outputnodes of equal minimum distance from the preferred position, the one furthest to the right(and furthest down if there was still a tie) was chosen.Although the array of nodes was �xed in size, the use of NONE and WIRE components,

together with the output position selection method, gave considerable freedom for circuits tobe of di�erent sizes within the boundaries.Underlying the choice of circuit representation was the notion that elements that interact

should be adjacent to each other, since the usual action of a ‘wire’ is di�cult to achieve [31].To this end, regular cellular architectures have been proposed, e.g. Reference [32]. Withina primitive (which may be repeated in some sort of array), the representation scheme adoptedhere is more exible than a regular array, yet interacting elements can still be brought nextto each other through a topology-preserving deformation of the layout once nodes connectedby a virtual WIRE have been amalgamated.The �tness of a candidate circuit was evaluated by applying the voltage waveforms shown

in Figure 1 to the inputs, while monitoring the voltage at the output node. The input voltagesources were coupled to the circuit through �xed series capacitors of 3:333× 10−13 F ina small attempt to model the situation where the inputs would be driven by the outputs of

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 5: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 589

similar adjacent NOR gates; the output node was loaded by a 1pF capacitor to ground. Thesearrangements can be seen in Figures 3 and 4.Also shown in Figure 1 is the ideal (target) output voltage waveform Videal(t). If the actual

observed output of a candidate circuit was Vout(t), then its �tness over the trial of length Twas calculated as

Fitness=−1

T |Vtrue − Vfalse|∫ T

0|Vout(t)− Videal(t)| dt (1)

or −1:0× 106 if the individual was not viable. An individual was unviable if no valid outputnode could be found, or if an input was shorted to 0 V or Vb. The �tness of a viable circuit,given by the equation, is just −1× the normalized mean error of the output voltage over thetrial, so the perfect circuit would score 0.0.The voltages Vtrue and Vfalse de�ning the logic levels of both the inputs and the ideal output

could be varied by evolution (along with Vb) as part of the description of an individual circuit.They could assume any values, subject to the constraint that |Vtrue−Vfalse|¿ 0:75Vb, and theywere initially randomly chosen from the interval [Vb; 0:0] V (again subject to the constraint).The input waveforms have non-zero rise and fall times, whereas the ideal output respondsinstantly at a logic threshold of (Vtrue + Vfalse)=2. This provides a selection pressure for theevolution of noise margins.The circuits were simulated using the SIMON package [33,34,29], with the parameter set-

tings given in the footnote.† The �rst phases of the experiment were conducted at absolutezero temperature (0K), and neglected co-tunnelling (only �rst-order tunnelling was simulated).In Phase 2 we will go on to describe how the temperature can be increased and higher-ordertunnelling accounted for.

2.1. Experiment phase 0

To start the experiment, an absolutely random search was conducted to �nd a prototypedesign with which to seed evolution. Each random individual was generated by selecting thecomponent between each pair of nodes uniformly at random from {NONE, CAPACITOR, JUNCTION,WIRE}, then choosing the associated capacitances, resistances, Vb; Vtrue and Vfalse uniformly atrandom from their permitted ranges. 58470 random circuits were evaluated, and the best onechosen. At this very early stage, the �tness values could be dominated by worthless transientcharging=discharging, so the evaluations were preceded by the simulation of an initial settlingtime of 0:3125 �s. During the settling time, the input voltages were both at Vfalse and theoutput was irrelevant. This settling time was not necessary during the evolutionary phases tofollow.

2.2. Experiment phase 1

The evolutionary algorithm was a fairly standard generational genetic algorithm (GA) [35].A �xed-size population of 30 candidate circuit designs was maintained. Once their �tnesses

†All simulations used the quasi-stationary Monte-Carlo mode. For evolutionary �tness evaluations, where speed isimportant, somewhat noisy simulation was used, with 3000 events simulated per timestep of 5 ns. For Figures 5, 6and 9–11, higher resolution tests were performed, using 10 000 events per 0:5 ns timestep. The nodes always hadzero initial charge, and a di�erent random-number seed was supplied to the simulator for each �tness trial.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 6: Design of single-electron systems through artificial evolution

590 A. THOMPSON AND C. WASSHUBER

had been evaluated, all except the single �ttest member were replaced by o�spring (a ‘gen-eration’). Individuals were selected (with replacement) to parent o�spring with a probabilityproportional to the rank order of their �tness within the population, such that the �ttestmember’s expected number of o�sping was 2.0, the median-�ttest’s expected number was1.0, and the least �t would get none. Baker’s stochastic universal selection method [36] wasused.For each o�spring individual, there was a probability of 0.7 that it would be generated

through a crossover operation on two parents. Crossover was done by selecting uniformly atrandom a pair of rows and a pair of columns in the array of nodes. The rectangular regioncircumscribed by these limits would be taken from one parent, and the remainder from theother. If crossover was not performed (probability 0.3), then just one parent was taken.To �nish the formation of an o�spring, it would be mutated as follows. Taking each

component in turn, with a small probability it would be altered to a di�erent uniformlyrandomly chosen component type. This probability was set such that the expected number ofcomponent-type mutations per individual was 0.7. Then, considering each component positionin turn, with a small probability the capacitance value associated with that position would beperturbed (whether or not the component at that position happened to be currently of a typethat used the capacitance value). The same perturbation procedure was then repeated for theresistance values. The probabilities of perturbations were set such that the expected numberof capacitances altered per individual was 2.8, and the expected number of resistances alteredwas also 2.8. Finally, the global voltages associated with the circuit (Vb; Vfalse and Vtrue) weretaken in turn and with a probability of 0.1 each, were perturbed.The perturbations to the real-valued parameters were performed using the ‘Breeder-GA

(BGA)’ mutation operator [37]. This operator takes the range of the variable as a parameter,and generates small perturbations with a higher probability than large ones. If, after mutation,|Vtrue − Vfalse| broke the separation constraint, the two voltages were symmetrically movedfurther apart until they were valid. In the case of resistances and capacitances, which bothrange over many orders of magnitude, the log of the variable (and its range) was taken, theBGA mutation applied, and then the antilog of the result became the variable’s new value.Starting from a population of identical copies of the best circuit found through random

search (Phase 0), the GA’s operation consisted of many iterations of the generational cycleof �tness evaluations, selection of parents, o�spring formation, and replacement of all butthe currently �ttest individual by the new o�spring. Figure 2 shows how the �tness rapidlyincreased at �rst, and then was slowly �ne-tuned over a much longer period.The GA was stopped after 8000 generations, and the best individual at that time is shown

in Figures 3 and 4. The behaviour shown in Figure 5 is very close to the ideal, but it is alsoseen to be completely destroyed if we now enable the simulation of higher-order tunnellingevents. If the temperature is increased (Figure 6), the behaviour is completely lost at only30 mK.In a similar earlier experiment at zero temperature [38] it was found that if evolution

was continued from this point, but now with second-order tunnelling enabled, it took manygenerations to regain the original �tness. If third-order tunnelling was then enabled in thesimulation, then again much more evolution was needed. Given that simulation of higher-ordertunnelling is extremely computationally expensive, the approach of gradually increasing theorder of simulated tunnelling events, at zero temperature, does not appear fruitful. Attempts toconduct the experiment at a temperature of 500mK, even simulating only �rst order tunnelling,

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 7: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 591

Figure 2. Evolution at 0 K: �tness of the best individual in the population.

Figure 3. The circuit evolved at 0 K, in the representation manipulated by the evolutionary algorithm.The large dots are nodes, and the ‘preferred output’ node is shown circled.

met with total failure: no initial circuits could be found (either through random search, or bythe GA) that were above baseline �tness.The way forward is suggested by noticing that the loss of behaviour with increasing tem-

perature seen in Figure 6 is gradual, although rapid.

2.3. Phase 2

Taking the �nal population of Phase 1, evolution was continued, still with only �rst-ordertunnelling simulated. Whenever the �tness of the best individual reached a threshold of −0:25,the temperature was increased by 10mK. It can be seen in Figure 7 that although these small

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 8: Design of single-electron systems through artificial evolution

592 A. THOMPSON AND C. WASSHUBER

Figure 4. The circuit evolved at 0 K, as seen by the simulator: Nodes joined by ‘virtual wires’ havebeen amalgamated, and shorted or dangling components have been removed.

temperature increases usually caused some loss in �tness, the population had enough residualperformance for the evolutionary process to work on, in adapting the individuals to the newconditions.Due to time constraints, the temperature was held constant once it reached 340 mK, to

allow a recognisable NOR-gate to be formed. When the experiment was terminated, the bestcircuit (Figure 8) certainly would not work in a computational circuit, but can be seen to beroughly approximating the target NOR response.The circuit has some interesting properties. Its response deteriorates only slightly if second-

order tunnelling events are now included in the simulation, and there is no further degradationif third-order events are also modelled. Co-tunnelling and increased temperature both smear

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 9: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 593

Figure 5. The input=output relationship of the circuit evolved at 0 K (see Figure 4). Thedark solid line is the output considering only �rst order tunnelling events as used in thesimulations to evaluate �tness during evolution. The gray solid line is the output when

second-order (or second and third-order) events are also simulated.

Figure 6. The thermal response of the circuit evolved at 0 K (see Figure 4).

out the Coulomb blockade in a very similar way; higher-order tunnel events are thus lumpedinto a larger e�ective temperature.The thermal response of the circuit, considering only �rst-order tunnelling, is fascinating.

Figure 10 shows that the behaviour deteriorates not only when the temperature is increased, butalso when it is decreased. The best performance is seen at 340 mK—the temperature duringthe �nal stage of evolution. The simulation does not model thermal drift of the parametervalues, so this curve means that the circuit exploits or relies upon the simulated e�ects of theparticular thermal energies of the electrons at around 340mK. Further work would be neededto verify that these observations are physically realistic: perhaps this unusual circuit exercisesthe simulator outside of its normal validated domain of operation.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 10: Design of single-electron systems through artificial evolution

594 A. THOMPSON AND C. WASSHUBER

Figure 7. Continued evolution, at increasing temperature. The solid upper line is best �tness (left axis),and the lower dashed line is temperature (right axis). The temperature was increased by 10mK whenever

the �tness reached −0:25, then was held constant upon reaching 340 mK.

Although we have not produced an ideal NOR gate, its thermal response indicates thatevolution has been exploring the utilization of the (simulated) physical medium in ways notnormally imagined.

3. CONCLUSION

We argued that evolutionary design is di�erent from the usual processes in which humandesigners or conventional CAD tools engage. One consequence is that it is possible to evolvedesigns that take unusual leverage from the physics of their medium of implementation. Thiscan be done even if there is no tractable analytical model to predict how the overall behaviourwill emerge from the interactions of the components. At least for small systems, it can alsobe done with little prior conception of what kinds of design might be appropriate or e�ective.These properties are alluring for contemporary single-electronics, and the experiments wereencouraging.A representation scheme was developed that allows more exibility than a regular ar-

ray, yet maintains adjacency of interacting components. Some freedom was available to ex-plore circuits of di�erent sizes, and with their output in di�erent positions. The bias volt-age and the signal levels could co-evolve with the circuit structure. A method was foundfor the evolution of circuits to perform at non-zero temperature, which also appears tolessen the impact of co-tunnelling events, which we would rather not have to simulate dur-ing evolution. The resulting circuit does not serve as a good NOR gate, but does exhibitthe ability of evolutionary techniques to navigate into intriguing unchartered territories ofdesign.Some important issues were not part of this �rst study. Perhaps the possibility of signal

representation schemes other than voltage levels would be fruitful (e.g. Reference [39]), andthe issues surrounding the composition of evolved primitives into larger systems are worthcloser attention. We ignored the e�ects of background charge and component tolerances, drift,and control, although parallel work has addressed the challenge of robustness in evolutionarymicroelectronics design [24].

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 11: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 595

Figure 8. The best circuit so far for 340 mK.

It may be that a better NOR gate was not obtained because the �tness evaluations werequite noisy (visible in Figure 7). By increasing the resolution of the simulation,‡ and usinga slightly di�erent �tness function that penalizes larger errors more heavily, a circuit with theimproved response shown in Figure 11 was obtained after a further 375 generations. Whenthis circuit is simulated with multiple tunnelling events enabled, however, the response is nobetter than that seen in the main experiment (Figure 9). Hence, although we might speculatethat multiple tunnelling events may have less of an e�ect as the circuit becomes more closelyadapted to the target response, or that evolution at temperatures higher than 340mK mightalso reduce this problem, it remains to be seen what experimental conditions are necessaryfor the evolution of a really practical NOR gate.

‡Ten thousand events were now simulated per 1ns timestep during evolutionary trials.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 12: Design of single-electron systems through artificial evolution

596 A. THOMPSON AND C. WASSHUBER

Figure 9. The input=output relationship of the circuit evolved at 340mK (see Figure 8). Top: Simulationonly of �rst-order tunnelling events. Middle: Simulation including second-order tunnelling. Bottom:

Simulation including third-order tunnelling.

Most of the future directions mentioned above imply the use of more computationallyexpensive �tness evaluations. The set of experiments reported here (Phases 0–2) took about3 weeks on a dual-processor 466MHz PC. The computational demands are not necessarilyterminal, as evolutionary algorithms parallelize very well to loosely coupled MIMD parallelmachines, such as cost-e�ective Beowulf-style clusters [40].Nanoelectronics design seeks to employ subtle physics to do useful work. Natural evolution

has done this in biology, and so can evolutionary algorithms in arti�cial media. Our exper-

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 13: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 597

Figure 10. The thermal response of the circuit evolved for 340 mK (see Figure 8).

Figure 11. An improved input=output relationship at 340 mK, but only ifmultiple tunnelling events are neglected.

iments tentatively suggest that evolutionary methods may be a useful exploratory tool intonovel kinds of design that may help to make such new technologies viable.

ACKNOWLEDGEMENTS

Thompson’s work was funded under EPSRC grant GR=L60531. Special thanks to Phil Husbands forsupporting this work within the Sussex Centre for Computational Neuroscience & Robotics.

REFERENCES

1. B�ack T, Fogel D, Michalewicz Z. (eds). Handbook of Evolutionary Computation. Institute of PhysicsPublishing, 1997.

2. Rechenberg I. Cybernetic solution path of an experimental problem. Royal Aircraft Establishment, LibraryTranslation 1122, 1965. Reprinted In ‘Evolutionary Computation—The Fossil Record’, Fogel DB (ed.), chapter8. IEEE Press, 1998; 297–309.

3. Schwefel H-P, Rudolph G. Contemporary evolution strategies. In Advances in Arti�cial Life: Proceedings ofthe 3rd European Conference on Arti�cial Life, Mor�an F, Moreno A, Merelo JJ, Chacon P (eds), LectureNotes in Arti�cial Intelligence, vol. 929. Springer: Berlin, 1995; 893–907.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 14: Design of single-electron systems through artificial evolution

598 A. THOMPSON AND C. WASSHUBER

4. Fogel LJ, Owens AJ, Walsh MJ. Arti�cial Intelligence Through Simulated Evolution. Wiley: New York, 1966.5. Holland JH. Adaptation in Natural and Arti�cial Systems. University of Michigan Press: Ann Arbor, 1975.6. Koza JR. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MITPress: Cambridge, MA, 1992.

7. Husbands P, Harvey I, Cli� D, Miller G. Arti�cial evolution: a new path for arti�cial intelligence? Brain andCognition 1997; 34:130–159.

8. Fonseca CM, Fleming PJ. An overview of evolutionary algorithms in multiobjective optimisation. EvolutionaryComputation 1995; 3(1):1–16.

9. Thompson A. Evolving electronic robot controllers that exploit hardware resources. In Advances in Arti�cialLife: Proceedings of the 3rd European Conference on Arti�cial Life (ECAL95), Mor�an F, Moreno A, MereloJJ, Chacon P (eds), Lecture Notes in Arti�cial Intelligence, vol. 929. Springer: Berlin, 1995; 640–656.

10. Kalganova T, Miller J. Evolving more e�cient digital circuits by allowing circuit layout evolution andmulti-objective �tness. In Proceedings of the 1st NASA=DoD Workshop on Evolvable Hardware, Stoica A,Keymeulen D, Lohn J (eds). IEEE Computer Society, 1999; 54–63.

11. Zebulum RS, Pacheco MA, Vellasco M. A multi-objective optimisation methodology applied to the synthesisof low-power operational ampli�ers. In Proceedings of the XIII International Conference on Microelectronicsand Packaging, Chueiri IJ, dos Reis Filho CA (eds), vol. I. The Brazilian Microelectronics Society, 1998; 264–271.

12. Thompson A. Evolving inherently fault-tolerant systems. Proceedings of the Institute of Mechanical Engineers,Part I 1997; 211:365–371.

13. Thompson A. Silicon evolution. In Genetic Programming 1996: Proceedings of the 1st Annual Conference(GP96), Koza JR, Goldberg DE, Fogel DB, Riolo RL (eds). MIT Press: Cambridge, MA, 1996; 444–452.

14. Layzell P. Reducing hardware evolution’s dependency on FPGAs. In Proceedings of the 7th InternationalConference on Microelectronics for Neural; Fuzzy and Bio-inspired Systems (MicroNeuro’99). IEEE Comp.Soc. Press, 1999; 171–178.

15. Stoica A, Salazar-Lazaro C, Keymeulen D, Hayworth K. Evolution of CMOS circuits in simulations and directlyin hardware on a programmable chip. In Proceedings of the Genetic and Evolutionary Computation Conference(GECCO-99), Banzhaf W, Daida J, Eiben AE et al. (eds). Morgan Kaufmann, 1999; 1198–1203.

16. Sanchez E, Tomassini M. (eds). Towards Evolvable Hardware: The Evolutionary Engineering Approach,Lecture Notes in Computer Science, vol. 1062. Springer: Berlin, 1996.

17. Higuchi T, Iwata M, Weixin L. (eds). Proceedings of the 1st International Conference on Evolvable Systems:From Biology to Hardware, Lecture Notes in Computer Science, vol. 1259. Springer: Berlin, 1997.

18. Sipper M, Mange D, P�erez-Uribe A. (eds). Proceedings of the 2nd International Conference on EvolvableSystems (ICES98), Lecture Notes in Computer Science, vol. 1478. Springer: Berlin, 1998.

19. Miller J, Thompson A, Thomson P, Fogarty T (eds). Proceedings of the 3rd International Conference onEvolvable Systems (ICES2000): From Biology to Hardware, Lecture Notes in Computer Science, vol. 1801.Springer: Berlin, 2000.

20. Yao X. (Guest ed). Special section on evolvable hardware. Communications of the ACM 1999; 42(4):47–79.21. Sipper M, Mange D. (Guest eds). Special issue on biology to hardware and back. IEEE Transactions on

Evolutionary Computation 1999; 3(3).22. Stoica A, Keymeulen D, Lohn J. (eds). Proceedings of the 1st NASA=DoD Workshop on Evolvable Hardware.

IEEE Computer Society, 1999.23. Thompson A, Layzell P, Zebulum RS. Explorations in design space: unconventional electronics design through

arti�cial evolution. IEEE Transactions on Evolutionary Computation 1999; 3(3): 167–196.24. Thompson A, Layzell P. Evolution of robustness in an electronics design. In Proceedings of the 3rd International

Conference on Evolvable Systems (ICES2000): From Biology to Hardware, Miller J, Thompson A, ThomsonP, Fogarty T (eds), Lecture Notes in Computer Science, vol. 1801. Springer: Berlin, 2000; 218–228.

25. Koza JR, Bennett III FH, Keane MA et al. Searching for the impossible using genetic programming. InProceedings of the Genetic and Evolutionary Computation Conference (GECCO-99), Banzhaf W, Daida J,Eiben AE et al. (eds). Morgan Kaufmann, 1999; 1083–1091.

26. Thompson A, Layzell P. Analysis of unconventional evolved electronics. Communications of the ACM 1999;42(4):71–79.

27. Rendell RW, Ancona MG. Adaptive computation by interacting quantum dots. Superlattices and Microstructures1996; 20(4):479–491.

28. Klimeck G, Salazar-Lazaro CH, Stoica A, Cwik T. ‘Genetically engineered’ nanoelectronics. In Proceedings ofthe 1st NASA=DoD Workshop on Evolvable Hardware, Stoica A, Keymeulen D, Lohn J (eds). IEEE ComputerSociety, 1999; 247–248.

29. Wasshuber C, Kosina H, Selberherr S. SIMON—a simulator for single-electron tunnel devices and circuits.IEEE Transactions on Computer-Aided Design 1997; 16:937–944.

30. Chen RH, Korotkov AN, Likharev KK. Single-electron transistor logic. Applied Physics Letters 1996;68(14):1954–1956.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599

Page 15: Design of single-electron systems through artificial evolution

DESIGN OF SINGLE-ELECTRON SYSTEMS 599

31. Korotkov AN, Chen RH, Likharev KK. Possible performance of capacitively-coupled single-electron transistorsin digital circuits. Journal of Applied Physics 1995; 78(4):2520–2530.

32. Ancona MG. Design of computationally useful single-electron digital circuits. Journal of Applied Physics 1996;79(1):526–539.

33. The Single-Electron Repository. http:==home1.gte.net=kittypaw=.34. Wasshuber, C. About single-electron devices and circuits. Ph.D. Thesis, Technical University of Wien,

�Osterreichischer Kunst- und Kulturverlag, 1997.35. Goldberg DE. Genetic Algorithms in Search; Optimization & Machine Learning. Addison-Wesley. Reading,

MA, 1989.36. Baker JE. Reducing bias and ine�ciency in the selection algorithm. In Genetic Algorithms and their

Applications: Proceedings of the 2nd International Conference on Genetic Algorithms (ICGA) Grefenstette JJ(ed.). Lawrence Erlbaum Associates: London, 1987; 14–21.

37. M�uhlenbein H, Schlierkamp-Voosen D. Predictive models for the breeder genetic algorithm. EvolutionaryComputation 1993; 1(1):25–49.

38. Thompson A. Evolutionary design for novel technologies. In IEE Colloquium on Evolutionary HardwareSystems. Savoy Place: London, 1999; 4=1.

39. Rendell RW. Adaptive control of single-electron circuit signatures for computation. In Proceedings of the ECS98-19 Quantum Con�nement V: Nanostructures, Cahay M, Lockwood DJ, Leburton J-P, Bandyopadhyay S(eds). Electrochemical Society, 1999; 574–581.

40. Bennett III FH, Koza JR, Shipman J, Sti�elman O. Building a parallel computer system for $18,000 that performsa half-peta op per day. In Proceedings of Genetic and Evolutionary Computation Conference (GECCO-99),Banzhaf W, Daida J, Eiben AE et al. (eds). Morgan Kaufmann, 1999; 1484–1490.

Copyright ? 2000 John Wiley & Sons, Ltd. Int. J. Circ. Theor. Appl. 2000; 28:585–599