cooperative experiment ‘I,Malvolio’ (2)

After confirm the storyboard of “I,Malvolio” ,we design to how to achieve it.At first,we intend to make real interaction between dancer and animation.But we don’t know how to achieve interaction and interactive software.So we use a stupid way to make it that is a fake interaction.We decided to record the dancer dance first,then I will use computer make animation base on this video.After complete the animation,we will use projector project the animation on dancer’s body when he is dancing. So it will look like they are interactive if dancer won’t make mistake.Although this is a fake interaction,but the final effect is same.

So,Jake was record Lin dance first.

Then I use After Effect to make a simple test in order to figure out the practicability of our plan.

屏幕快照 2014-03-01 上午1.54.26

屏幕快照 2014-03-01 上午1.54.34

Our ideal result is like this:

Therefore, Jake used the projector projected on Lin when he is dancing.Because i use software to make animation in a 2D condition,so Jake need to use 3D mapping software iSadora to adjust animation’s shape in order to fix the deformation problem.To make sure the real world animation look same as the computer one.So firstly we just try to used projector project the video above on the table which against the wall,this is a simulation of real performance.See what happen when a 2D animation project on two sides,figure the rectangle will change to which shape.If the rectangle deformation cannot use iSadora restore,we need to make a deformation animation first base on the real world.

After our test,we found the rectangle is not too deformation.So we can make a normal 2D animation first,and use iSadora adjust the shape when it is projecting.

experiment 1-Flip book


The first flip book appeared in September, 1868, when it was patented by John Barnes Linnett under the name kineograph (“moving picture”).This is the first time how animation perform.

The original flip book,audience use their hand to flip those book and make the animation move.This is the incipient interaction between audience and animation.Their interaction make this work change,and they can control the animation’s speed.But the image of animation can not change. Audience can only watch them and make them move. Audience can not change the composition,or content of the animation.Thus,the aesthetic of this work was designed and determined by artist.

So i think how about they can see as they want,in a simple way.When audience flip the book,use another hand to block parr of the flip book,they can see different image.So audience’s hand create a simple interaction with animation,which will determined the visual,aesthetic of this work.












However,there is some problem with this experiment.

1.Why audiences will do this?

2.Is that suitable use this way to control the aesthetics of artwork?

3.What is aesthetics mean?

4.Why will everyone agree watch the filpbook in this way will be aesthetics?

5.How aesthetics exist in the artwork?

MA Project Proposal

1.Working Title:

The aesthetic created by interaction


Aim:research about how audience’s engagement,such as their behavior,create an aesthetic visual effect to video or animation.

-To see how important aesthetic visual for video.

-To see how digital technology influence and combine with video,such as animation.

-To learn how the interaction of audience become a part of digital artwork.

-Explore can interaction bring aesthetic visual effect to the artwork?


Historical-From the earliest silent films era,video and animation,they attract audiences via strong visual impact which also full of aesthetics.Those fascinating moving images are created by artists and director.They know how to use light and shadow,composition,even hue to create the most aesthetic and impact video.Because most of them had learned and trained about aesthetics.

Contemporary-Since the existence of digital technology,it provide more possibilities and methods for video to create aesthetic visual effect.These effect are dramatic and high-tech which traditional skill can not achieve.Besides,digital technology also provide a new art form,interaction.Increasing advent of interactive artwork,such as human-computer interaction,audience become a particular part of artwork.Artist began try their works out with the public before completion,because an interactive work is not complete without participants.(‘The art of interaction’)But most of the  interactive artwork are focus on engagement,for example,the way artwork interact with audience,is that engagement sustained.Indeed,interaction is a good way to for audience to actually get in touch with artwork,also can deeper understand the intention of artist.However,in some sense,it is these interaction make the artwork lost some of their aesthetics,because most audiences are amateurs.Thus,most interactive digital art tend to focus on behaviors and response of  computer system.

Theoretical-Interaction is an innovate way to express art,but as an art form,aesthetics is still the intention of it.Thus,I intend to explore how interaction create aesthetic visual effect.It can not only keep their intention that express ideas of beauty,but also can help audience to know the essence of artwork in an actual physical way.



Learn and explore the essence of aesthetic visual in video.

Find out a theme of video,such as SAMSARA.

Use animation as the video form,such as black and white animation.

Explore new ways to express visual of animation,such as use digital projection technique to persent on some subject,3D mapping.


learn about the basis knowledge of interactive technology,make some experiment,such as use of intel’s new galileo microprocessor board.

learn about how to use HCI technology.

research about how can interaction create aesthetics in anyway.


Temporary idea is make an installation that combine with animation,it can also interact with audience,create aesthetic visual via interaction.

6.Work Plan:

Total 45 weeks

1 -10  weeks      research,find out the theme and form of animation and initial idea;research and learn some interactive technology

11-30  weeks     experiment and find out the finalize proposal

31-45  weeks     prepare for the project and exhibit in final show




The art of interaction–‘Digital Creativity’