contacts: artificial botany · 2009-08-31 · concept abstract artificial botany is an ongoing...

22
ARTIFICIAL BOTANY REAL-TIME A/V INSTALLATION CONTACTS: fuse* c/o FUSE*FACTORY Via Nuova 9, 41011 Campogalliano (MO) Italy [email protected] fuseworks.it Link fuseworks/artificial-botany

Upload: others

Post on 08-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

ARTIFICIAL BOTANYREAL-TIME A/V INSTALLATION

CONTACTS:fuse*c/o FUSE*FACTORYVia Nuova 9,41011 Campogalliano (MO)[email protected]

Link fuseworks/artificial-botany

Page 2: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

CONTENTS

01. ARTIFICIAL BOTANY Concept Process Credits

02. TECHNICAL RIDER Setup A Setup B Setup C Artificial Botany DLXXVI

02030411

1314161820

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·2Artificial Botany

01/31/20

Page 3: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

CONCEPT

ABSTRACT

Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through the use of machine learning algorithms. Before the invention of photography, botanical illustration was the only way to visually record the many species of plants. These images were used by physicists, pharmacists, and botanical scientists for identification, analysis, and classification.While these works are no longer scientifically relevant today, they have become an inspiration for artists who pay homage to life and nature using contemporary tools and methodologies. Artificial Botany draws from public domain archive images of illustrations by the greatest artists of the genre, including Maria Sibylla Merian, Pierre-Joseph Redouté, Anne Pratt, Mariann North, and Ernst Haeckel.

Developing as an organism in an interweaving of forms that are transmitted and flow into each other, the plant is the symbol of nature’s creative power. In this continuous activity of organizing and shaping forms two opposing forces in tension are confronted: on one hand, the tendency to the shapeless, the fluidity of passing and changing; on the other, the tenacious power to persist, the principle of crystallization of the flow, without which it would be lost indefinitely. In the dynamic of expunction and contraction that marks the development of the plant, beauty manifests itself in that moment of balance which is impossible to fix, caught in its formation and already in the point of fading into the next one.

ORIGINAL BOTANICAL ILLUSTRATIONS

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·3Artificial Botany

01/31/20

Page 4: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

PROCESS

The illustrations collected from digital archives have become the learning material for a particular machine learning system called GAN (Generative Adversarial Network), which through a training phase is able to recreate new artificial images with morphological elements extremely similar to the images of inspiration but with details and features that seem to bring out a real human representation. The machine in this sense re-elaborates the content by creating a new language, capturing the information and artistic qualities of man and nature.

GAN NETWORK STRUCTURE

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·4Artificial Botany

01/31/20

Page 5: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

PROCESS

The recent advances in the generative models realm makes it really intriguing to exploit their ability to create novel content from a given set of images. Following this direction we focused our attention on the study of Generative Adversarial Neworks (GANS).

They represent a technique made up of two networks that are in competition with one another’s in a zero-sum game framework. GANs typically run unsupervised, teaching itself how to mimic any given distribution of data, which means that once trained they are able to replicate novel content starting from a specific dataset.

This distribution is often called the latent space of the model. It is usually high dimensional, though much lower than the dimensions of the raw medium. E.g. When dealing with full colour (e.g. RGB) images with 1024x1024 pixel resolution, we are dealing with roughly 3 million dimensions (i.e. features — 1024x1024x3), whereas we might use a latent space of only 512 dimensions.

The first step in establishing a GAN is to identify the desired end output and gather an initial training dataset based on those parameters. This data is then randomized and input into the generator until it acquires basic accuracy in producing outputs.

In an unconditioned generative model, there is no control on model of the data being generated. However, by conditioning the model on additional information it is possible to direct the data generation process. Such conditioning could be based on class labels, on some part of data for inpainting like, or even on data from different modality.

GAN TRAINING STEPS

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·5Artificial Botany

01/31/20

Page 6: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

PROCESS

INTERACTION

SENSOR

SOUNDBAR

REAL-TIME CONTENT

Artificial Botany works on different levels of interaction with the audience. The relationship with the viewer is modulated with the help of a set of possible sensors.According to the configuration of the installation different sensors and data can be used to connect the real world with the digital artwork.Motion tracking cameras, emotion detector sensors and data collected from social media are just a few of the potential tools that can be used.

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·6Artificial Botany

01/31/20

Page 7: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

a bunch of flowers that are in a vase

PROCESS

INTERACTION

GENERATED IMAGE

GENERATED CAPTION

Another declination of this piece involved the speculative interaction between two AI system interacting with one another.The text underlying each artwork is generated by the exploitation of another neural network algorithm. This type of system is called “image to text translation” and while commonly it’s used to classify images, here it has been tested by asking it to recognize other artificial-generated images frame by frame.

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·7Artificial Botany

01/31/20

Page 8: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

PROCESS

ARTIFICIAL BOTANICAL ILLUSTRATIONSfuse* ©

[email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·8Artificial Botany

01/31/20

Page 9: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

ARTIFICIAL BOTANICAL ILLUSTRATIONS

PROCESS

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·9Artificial Botany

01/31/20

Page 10: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

ARTIFICIAL BOTANICAL ILLUSTRATIONS

Page 11: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

ARTIFICIAL BOTANICAL ILLUSTRATIONS

Page 12: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

CREDITS

Production: fuse*Art Direction, Executive Production: Mattia Carretti, Luca CamelliniConcept: Mattia Carretti, Luca Camellini, Samuel Pietri, Riccardo BazzoniSoftware: Luca Camellini, Samuel PietriSound Design: Riccardo BazzoniHardware Engineering: Matteo Mestucci

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·12Artificial Botany

01/31/20

Page 13: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

TECHNICAL RIDER

Artificial Botany can be set up in different ways according to the space availability and characteristics of the venue.

- Installation | Proposal AGenerative Audio Visual Installation2x 4K Monitors2 + 1 audio channelsDuration: realtime software, 20 minutes cycle

- Installation | Proposal BGenerative Audio Visual Installation3x 4K Monitors/LED Screens2 + 1 audio channelsDuration: realtime software, 20 minutes cycle

- Installation | Proposal CGenerative Audio Visual InstallationSingle 4k Projection2 + 1 audio channelsDuration: realtime software, 20 minutes cycle

- Artificial Botany DLXXVIAudio Visual Installation5x LCD Monitors2 + 1 audio channelsDuration: video, 3 minutesTrailer vimeo/DLXXVI

- Sedition CollectionAudio Visual Installation3x fullHD Monitors2+ 1 audio channelsDuration: video, 3 minutes cycleTrailer sedition/AB-Collection

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·13Artificial Botany

01/31/20

Page 14: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL A

SOUND SYSTEM

2x 4k MonitorsSuggested: Samsung FrameResolution: 3840 x 2160Refresh Rate: 60Hz (60fps)

Video SystemRatio: 9:16Ideal Size: 65”

Sound System2x Speakers 1x Sub

Hardware2x Workstation with high-end GPU

MONITOR

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·14Artificial Botany

01/31/20

Page 15: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL A

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·15Artificial Botany

01/31/20

Page 16: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL B

MONITOR

SOUND SYSTEM

3x 4k MonitorsSuggested: Samusung “The Wall”Resolution: 3840 x 2160Refresh Rate: 60Hz (60fps)

Video SystemRatio: 9:16Ideal Size: 150”

Sound System2x Speakers 1x Sub

Hardware3x Workstation with high-end GPU

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·16Artificial Botany

01/31/20

Page 17: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL B

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·17Artificial Botany

01/31/20

Page 18: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL C

PROJECTION SURFACE

PROJECTOR

SOUND SYSTEM

1x 4k ProjectorSuggested: ChristieIdeal Brightness: 18k ANSI Lumen (15k minimum) Resolution: 3840 x 2160Refresh Rate: 60Hz (60fps)

1x Front Projection ScreenRatio: 16:9Ideal Size: 5 meters width

Sound System2x Speakers 1x Sub

Hardware1x Workstation with high-end GPU

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·18Artificial Botany

01/31/20

Page 19: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

PROPOSAL C

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·19Artificial Botany

01/31/20

Page 20: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

ARTIFICIAL BOTANY DLXXVI

ARTIFICIAL BOTANY DLXXVI

fuse* © [email protected]

ProjectClientDate

Via Nuova 9 Campogalliano MO

·20Artificial Botany

01/31/20

Page 21: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through

INSTALLATION

Page 22: CONTACTS: ARTIFICIAL BOTANY · 2009-08-31 · CONCEPT ABSTRACT Artificial Botany is an ongoing project exploring the latent expressive capacity of botanical illustrations through