Robert-Depot - User contributions [en]

FRSynth - Emilio Marcelino

2010-06-04T00:43:37Z

GregoryParsons:

== '''Motivation''' ==

My goal to start this project was to include a variety of personal interests into one piece, particularly color/sound/motion.

== '''Interaction'''==

The user interacts with my piece by sitting/standing in front of the webcam the program tracks the facial movement controlling the mouse. Depending on the location of the face on the screen the frequency of the sound wave is altered. Making a facial recognition synthesizer.

== '''Function'''==

The project will allow the users to test their creativity both visually and auditorily in a live/performance style

== '''Visualization''' ==

[http://www.youtube.com/watch?v=SClGZ5a6-uI link Final Project Video]

== '''Final Code'''==

http://imgur.com/Z6Nqa.png
http://imgur.com/ueyfN.png
http://imgur.com/x0UfE.png

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

AudioPlayer player;
Minim minim;
AudioInput in;
AudioOutput out;
SawWave sine;
FFT fft;

float[] xpos = new float[50];
float[] ypos = new float[50];

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;
float posX = 0;
float posY = 0;

void setup()
{
size(640, 480);

//noCursor();
minim = new Minim(this);
out = minim.getLineOut(Minim.STEREO);
// create a sine wave Oscillator, set to 440 Hz, at 0.5 amplitude, sample rate from line out
sine = new SawWave(440, 0.1, out.sampleRate());
// set the portamento speed on the oscillator to 200 milliseconds
sine.portamento(200);
// add the oscillator to the line out
out.addSignal(sine);
minim.debugOn();

player = minim.loadFile("beat.mp3", 2048);

for (int i = 0; i < xpos.length; i++)
{
xpos[i] = 0;
ypos[i] = 0;
}

// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"
}

void draw()
{

player.play();
// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );
opencv.flip( OpenCV.FLIP_HORIZONTAL );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
if ((posX != 0) && (posY != 0))
{
drawCircles(posX, posY);
}
}

// with portamento on the frequency will change smoothly
float freq = map(posY, 0, height, 1500, 60);
sine.setFreq(freq*.5);
// pan always changes smoothly to avoid crackles getting into the signal
// note that we could call setPan on out, instead of on sine
// this would sound the same, but the waveforms in out would not reflect the panning
float pan = map(posX, 0, width, -1, 1);
sine.setPan(pan);
}

// Circle splatter machine
void drawCircles(float posX, float posY)
{
background(000);

for (int i = 0; i <xpos.length - 1; i++)
{
xpos[i] = xpos[i + 1];
ypos[i] = ypos[i + 1];
}

xpos [xpos.length - 1] = posX;
ypos [ypos.length - 1] = posY;

for (int i = 0; i < xpos.length; i++)
{
noStroke();
fill(random(255),random(255),random(255) - i * 5);
ellipse(xpos[i],ypos[i],i,i);
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
out.close();
minim.stop();

super.stop();
}

Happy Days - Gregory Parsons

2010-06-03T23:15:48Z

GregoryParsons:

== '''Motivation''' ==

We have a growing shortage of fresh water in the world, and as populations rise and sources become more contaminated the problem accelerates. We often do not take into consideration our day to day affect on the planet, and often will ignore obvious means to reduce our footprint. I want to provide a means for a viewer to understand this relationship and begin to think about what they could do to counter their affect.

== '''Interaction'''==

I want the viewer of my project to question their existence within the imagery that is displayed on the screen. The longer that they 'interact' with the project the more of an affect they will have on it. Using face tracking as the main stimulus for change the project will react based the length of time that the user's face is tracked by the camera.

== '''Function'''==

The affect on the project will change with the amount of time the viewer is in front of the camera, for instance the sun that represents the viewer will drop water bottles onto the landscape, and the longer they are in front of the camera the more "smog" that will be visible on the screen.

== '''Visualization''' ==

http://acsweb.ucsd.edu/~gparsons/notracking.png
http://acsweb.ucsd.edu/~gparsons/tracking.png
http://acsweb.ucsd.edu/~gparsons/smog.png

== '''Final Documentation''' ==

I feel the project was successful and it turned out well polished. I feel that the user interaction was smooth, and over a long period of running it the project reacted well.

== '''Final Video Documentation''' ==

[http://www.youtube.com/watch?v=TVhZmXEU4P0 link Video Documentation]

== '''Final Code''' ==

<code>

/**
* Final Project; Greg Parsons
* VIS145B
*
* Face Tracking from OpenCV with actions modified for my needs, rest original programming
*
* The project is designed as a means to promote the viewers thought about their impact on the enviornment.
*
**/

import hypermedia.video.*;
import ddf.minim.*;
import oscP5.*;
import netP5.*;

//declare a new object of opencv
OpenCV opencv;

//wiimote
float wiimote1Pitch;
float wiimote1Roll;
float wiimote1Yaw;
float wiimote1Accel;
int wiimote1ButtonA;

//osc and wiimote
OscP5 oscP5;
NetAddress myRemoteLocation;

//image values
PImage bg;
PImage cloud1;
PImage cloud2;
PImage trash;
PImage waterbottle;
PImage star;
PImage starsad;
PImage starquesy;
PImage stardead;

//smog
PGraphics smog;

//audio
AudioPlayer player;
Minim minim;

//organic values
int c1 = -120;
int c2 = 550;
int h1 = 50;
int h2 = 100;
float posX = 0;
float posY = 0;
int numWb = 0;
int counter = 0;
int splashCounter = 0;
int wbDissapearCounter = 0;
int wbDelayCounter = 0;
int smogOpacity = 0;
int wiiACounter = 0;
int creationCounter = 0;
boolean faceDetected = false;
int wbcount=0;

//creating waterbottle objects
WaterBottle[] waterBottle = new WaterBottle[200];

void setup()
{
size(1024, 768, P2D);
frameRate(30);
noCursor();

//declaring images
bg = loadImage("background2.png");
cloud1 = loadImage("cloud1.png");
cloud2 = loadImage("cloud2.png");
waterbottle = loadImage("waterbottle.png");
star = loadImage("star.png");
starsad = loadImage("starsad.png");
starquesy = loadImage("starquesy.png");
stardead = loadImage("stardead.png");

//wiimote
oscP5 = new OscP5(this, 12000);
myRemoteLocation = new NetAddress("localhost", 12000);

//audio
minim = new Minim(this);
// load a file, give the AudioPlayer buffers that are 2048 samples long
player = minim.loadFile("Cartoon Accent 28.mp3", 2048);

//opencv logic
opencv = new OpenCV( this );
opencv.capture( width/2, height/2 ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

//creatinh smog graphic element
smog = createGraphics(width, height, P3D);
}

void draw()
{

wbcount++;
image(bg, 0, 0);
// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.flip( OpenCV.FLIP_HORIZONTAL );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

float posX = 0;
float posY = 0;

//assign the position of the detected face to usable int values
for( int i=0; i<faces.length; i++ )
{
posX = faces[i].x*2;
posY = faces[i].y*2;

//create a counter for the amount of waterbottles that is created for each new position of posX, posY and create a water bottle
if (numWb > 199)
{
numWb = 0;
}
if(wbcount>3) {
waterBottle[numWb] = new WaterBottle(posX, posY);
numWb++;
wbcount=0;
}
}

System.out.println(numWb);

//debugging code for checking position of the detected face (if it is acting up and not throwing out 0,0 positions)
//System.out.println("posX = " + posX + " posY = " + posY);
//System.out.println(numWb);

if (counter > 1)
{
for (int i = 0; i < numWb; i++)
{
waterBottle[i].displayWaterBottle();
}
}

if (counter > 1)
{
for (int i = 0; i < numWb; i++)
{
waterBottle[i].update();
}
}

//cloud movement and new position for clouds after full cycle
if (c1 < 1300) {
c1++;
}
else {
c1 = -400;
h1 = round(random(400));
}

if (c2 < 1300) {
c2++;
}
else {
c2 = -400;
h2 = round(random(400));
}

//drawing the clouds on the screen with moving variables
image(cloud1, c1, h1);
image(cloud2, c2, h2);

//logic for face either detected or not
if ((posX != 0) && (posY != 0)) {
faceDetected = true;
}
else
{
faceDetected = false;
}

//drawing the smog
smog.beginDraw();

if (smogOpacity < 252)
{
smog.background(139, 131, 134, smogOpacity);
}
else if (smogOpacity > 252)
{
smog.background(255, 36, 0, smogOpacity);
}

smog.endDraw();
image(smog, 0, 0);

//actions for face detected or not detected
if (faceDetected == true)
{

if (smogOpacity < 120)
{
image(star, posX, posY, star.width/3, star.height/3);
}
else if ((smogOpacity > 120) && (smogOpacity < 200))
{
image(starsad, posX, posY, star.width/3, star.height/3);
}
else if ((smogOpacity > 200) && (smogOpacity < 252))
{
image(starquesy, posX, posY, star.width/3, star.height/3);
}
else if (smogOpacity > 255)
{
image(stardead, 500, 500, star.width/3, star.height/3);
}

if (smogOpacity < 350)
{
smogOpacity = smogOpacity+2;
}

if (smogOpacity < 255)
{
if (splashCounter == 1)
{
player.play();
}

if (splashCounter == 10)
{
splashCounter = 0;
player.rewind();
}

//System.out.println(splashCounter);

splashCounter++;
}
}
else
{
if (smogOpacity > -150)
{
smogOpacity--;
}

if ((numWb > 1) && (wbDissapearCounter == 1))
{
numWb--;
}

if (wbDissapearCounter > 3)
{
wbDissapearCounter = 0;
}

wbDissapearCounter++;
}

//debug
//System.out.println(smogOpacity);

//System.out.println(faceDetected);
counter++;

if (wiimote1ButtonA == 1)
{
numWb = numWb/2;
smogOpacity = smogOpacity-6;
wiimote1ButtonA = 0;
}

}

//waterbottle class
class WaterBottle {
float wbPosX, wbPosY;

WaterBottle(float posX, float posY) {
wbPosX = posX;
wbPosY = posY;
}

//updates the position of the Y value to cause the bottles to fall
void update() {
if (wbPosY < 468)
{
wbPosY = wbPosY + 10;
}
}

//creates the bottle images
void displayWaterBottle() {
image(waterbottle, wbPosX, wbPosY);
}

}

//wiimote
void oscEvent(OscMessage theOscMessage) {
if(theOscMessage.checkAddrPattern("/wii/1/accel/pry")==true){
wiimote1Pitch = theOscMessage.get(0).floatValue();
wiimote1Roll = theOscMessage.get(1).floatValue();
wiimote1Yaw = theOscMessage.get(2).floatValue();
wiimote1Accel = theOscMessage.get(3).floatValue();
}
if(theOscMessage.checkAddrPattern("/wii/1/button/A")==true){
wiimote1ButtonA = theOscMessage.get(0).intValue();
}

}

//opencv actions at the end of the runtime
public void stop() {
opencv.stop();
player.close();
minim.stop();

super.stop();
}

</code>

Happy Days - Gregory Parsons

2010-06-03T23:03:07Z

GregoryParsons:

== '''Motivation''' ==

We have a growing shortage of fresh water in the world, and as populations rise and sources become more contaminated the problem accelerates. We often do not take into consideration our day to day affect on the planet, and often will ignore obvious means to reduce our footprint. I want to provide a means for a viewer to understand this relationship and begin to think about what they could do to counter their affect.

== '''Interaction'''==

I want the viewer of my project to question their existence within the imagery that is displayed on the screen. The longer that they 'interact' with the project the more of an affect they will have on it. Using face tracking as the main stimulus for change the project will react based the length of time that the user's face is tracked by the camera.

== '''Function'''==

The affect on the project will change with the amount of time the viewer is in front of the camera, for instance the sun that represents the viewer will drop water bottles onto the landscape, and the longer they are in front of the camera the more "smog" that will be visible on the screen.

== '''Visualization''' ==

http://acsweb.ucsd.edu/~gparsons/notracking.png
http://acsweb.ucsd.edu/~gparsons/tracking.png
http://acsweb.ucsd.edu/~gparsons/smog.png

== '''Final Documentation''' ===

== '''Final Code''' ==

<code>

/**
* Final Project; Greg Parsons
* VIS145B
*
* Face Tracking from OpenCV with actions modified for my needs, rest original programming
*
* The project is designed as a means to promote the viewers thought about their impact on the enviornment.
*
**/

import hypermedia.video.*;
import ddf.minim.*;
import oscP5.*;
import netP5.*;

//declare a new object of opencv
OpenCV opencv;

//wiimote
float wiimote1Pitch;
float wiimote1Roll;
float wiimote1Yaw;
float wiimote1Accel;
int wiimote1ButtonA;

//osc and wiimote
OscP5 oscP5;
NetAddress myRemoteLocation;

//image values
PImage bg;
PImage cloud1;
PImage cloud2;
PImage trash;
PImage waterbottle;
PImage star;
PImage starsad;
PImage starquesy;
PImage stardead;

//smog
PGraphics smog;

//audio
AudioPlayer player;
Minim minim;

//organic values
int c1 = -120;
int c2 = 550;
int h1 = 50;
int h2 = 100;
float posX = 0;
float posY = 0;
int numWb = 0;
int counter = 0;
int splashCounter = 0;
int wbDissapearCounter = 0;
int wbDelayCounter = 0;
int smogOpacity = 0;
int wiiACounter = 0;
int creationCounter = 0;
boolean faceDetected = false;
int wbcount=0;

//creating waterbottle objects
WaterBottle[] waterBottle = new WaterBottle[200];

void setup()
{
size(1024, 768, P2D);
frameRate(30);
noCursor();

//declaring images
bg = loadImage("background2.png");
cloud1 = loadImage("cloud1.png");
cloud2 = loadImage("cloud2.png");
waterbottle = loadImage("waterbottle.png");
star = loadImage("star.png");
starsad = loadImage("starsad.png");
starquesy = loadImage("starquesy.png");
stardead = loadImage("stardead.png");

//wiimote
oscP5 = new OscP5(this, 12000);
myRemoteLocation = new NetAddress("localhost", 12000);

//audio
minim = new Minim(this);
// load a file, give the AudioPlayer buffers that are 2048 samples long
player = minim.loadFile("Cartoon Accent 28.mp3", 2048);

//opencv logic
opencv = new OpenCV( this );
opencv.capture( width/2, height/2 ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

//creatinh smog graphic element
smog = createGraphics(width, height, P3D);
}

void draw()
{

wbcount++;
image(bg, 0, 0);
// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.flip( OpenCV.FLIP_HORIZONTAL );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

float posX = 0;
float posY = 0;

//assign the position of the detected face to usable int values
for( int i=0; i<faces.length; i++ )
{
posX = faces[i].x*2;
posY = faces[i].y*2;

//create a counter for the amount of waterbottles that is created for each new position of posX, posY and create a water bottle
if (numWb > 199)
{
numWb = 0;
}
if(wbcount>3) {
waterBottle[numWb] = new WaterBottle(posX, posY);
numWb++;
wbcount=0;
}
}

System.out.println(numWb);

//debugging code for checking position of the detected face (if it is acting up and not throwing out 0,0 positions)
//System.out.println("posX = " + posX + " posY = " + posY);
//System.out.println(numWb);

if (counter > 1)
{
for (int i = 0; i < numWb; i++)
{
waterBottle[i].displayWaterBottle();
}
}

if (counter > 1)
{
for (int i = 0; i < numWb; i++)
{
waterBottle[i].update();
}
}

//cloud movement and new position for clouds after full cycle
if (c1 < 1300) {
c1++;
}
else {
c1 = -400;
h1 = round(random(400));
}

if (c2 < 1300) {
c2++;
}
else {
c2 = -400;
h2 = round(random(400));
}

//drawing the clouds on the screen with moving variables
image(cloud1, c1, h1);
image(cloud2, c2, h2);

//logic for face either detected or not
if ((posX != 0) && (posY != 0)) {
faceDetected = true;
}
else
{
faceDetected = false;
}

//drawing the smog
smog.beginDraw();

if (smogOpacity < 252)
{
smog.background(139, 131, 134, smogOpacity);
}
else if (smogOpacity > 252)
{
smog.background(255, 36, 0, smogOpacity);
}

smog.endDraw();
image(smog, 0, 0);

//actions for face detected or not detected
if (faceDetected == true)
{

if (smogOpacity < 120)
{
image(star, posX, posY, star.width/3, star.height/3);
}
else if ((smogOpacity > 120) && (smogOpacity < 200))
{
image(starsad, posX, posY, star.width/3, star.height/3);
}
else if ((smogOpacity > 200) && (smogOpacity < 252))
{
image(starquesy, posX, posY, star.width/3, star.height/3);
}
else if (smogOpacity > 255)
{
image(stardead, 500, 500, star.width/3, star.height/3);
}

if (smogOpacity < 350)
{
smogOpacity = smogOpacity+2;
}

if (smogOpacity < 255)
{
if (splashCounter == 1)
{
player.play();
}

if (splashCounter == 10)
{
splashCounter = 0;
player.rewind();
}

//System.out.println(splashCounter);

splashCounter++;
}
}
else
{
if (smogOpacity > -150)
{
smogOpacity--;
}

if ((numWb > 1) && (wbDissapearCounter == 1))
{
numWb--;
}

if (wbDissapearCounter > 3)
{
wbDissapearCounter = 0;
}

wbDissapearCounter++;
}

//debug
//System.out.println(smogOpacity);

//System.out.println(faceDetected);
counter++;

if (wiimote1ButtonA == 1)
{
numWb = numWb/2;
smogOpacity = smogOpacity-6;
wiimote1ButtonA = 0;
}

}

//waterbottle class
class WaterBottle {
float wbPosX, wbPosY;

WaterBottle(float posX, float posY) {
wbPosX = posX;
wbPosY = posY;
}

//updates the position of the Y value to cause the bottles to fall
void update() {
if (wbPosY < 468)
{
wbPosY = wbPosY + 10;
}
}

//creates the bottle images
void displayWaterBottle() {
image(waterbottle, wbPosX, wbPosY);
}

}

//wiimote
void oscEvent(OscMessage theOscMessage) {
if(theOscMessage.checkAddrPattern("/wii/1/accel/pry")==true){
wiimote1Pitch = theOscMessage.get(0).floatValue();
wiimote1Roll = theOscMessage.get(1).floatValue();
wiimote1Yaw = theOscMessage.get(2).floatValue();
wiimote1Accel = theOscMessage.get(3).floatValue();
}
if(theOscMessage.checkAddrPattern("/wii/1/button/A")==true){
wiimote1ButtonA = theOscMessage.get(0).intValue();
}

}

//opencv actions at the end of the runtime
public void stop() {
opencv.stop();
player.close();
minim.stop();

super.stop();
}

</code>

Happy Days - Gregory Parsons

2010-05-30T23:43:40Z

GregoryParsons:

Happy Days - Gregory Parsons

2010-05-30T23:42:04Z

GregoryParsons:

Happy Days - Gregory Parsons

2010-05-30T23:41:33Z

GregoryParsons:

Happy Days - Gregory Parsons

2010-05-30T23:40:48Z

GregoryParsons: New page: == '''Motivation''' == We have a growing shortage of fresh water in the world, and as populations rise and sources become more contaminated the problem accelerates. We often do not take i...

Classes/2010/VIS145B

2010-05-30T22:39:06Z

GregoryParsons: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Untitled (for now) - Joeny Thipsidakhom]]
* [[uMV | uMV - Tony Lu]]
* [[Stone Face | Stone Face - Jennifer Sunga]]
* [[This Music: Prohibited | This Music: Prohibited - Kelley Kim]]
* [[Blockman | Blockman - Javier Lee]]
* [[What do you see? | What do you see? - Christina Sanchez]]
* [[Happy Days - Gregory Parsons]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Classes/2010/VIS145B

2010-05-20T23:59:33Z

GregoryParsons: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]
* [[Social Creature | Social Creature - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]
== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T23:08:36Z

GregoryParsons:

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.

== '''Video''' ==

[http://www.youtube.com/watch?v=vmtfh574R3o Video Documentation]

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Code Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T23:07:45Z

GregoryParsons: /* Video */

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.
=== '''Video''' ===

[http://www.youtube.com/watch?v=vmtfh574R3o Video Documentation]

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Code Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T23:07:28Z

GregoryParsons: /* Video */

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.
=== '''Video''' ===

[http://www.youtube.com/watch?v=vmtfh574R3o link Video Documentation]

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Code Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T23:06:47Z

GregoryParsons:

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.
=== '''Video'''===

[http://www.youtube.com/watch?v=vmtfh574R3o link title]

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Code Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T21:46:17Z

GregoryParsons: /* Audio Frequency Based */

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.

Images coming soon.

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Code Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T21:45:29Z

GregoryParsons: /* Documentation */

== '''Motivation''' ==

Sticking to our primary interests in color, movement and scale, we decided to create a project that would require a computer, a microphone, and a mouse. With these three components we would be able to create a graffiti drawing program. Later came another interest in using the webcam to create a drawing program. So we replaced the mouse element with the webcam.

== '''Interaction'''==

To interact with our piece the individual will have to have a webcam, a microphone and a computer with Processing. When running the sketch we will use head tracking to replace the mouse and when speaking or blowing into the microphone, the program will draw.

Basically... speaking and moving your head simultaneously will allow you to draw within Processing.

== '''Function'''==

We will add the webcam head tracking sketch to the original microphone/mouse sketch to create a microphone and webcam drawing program.

== '''Visualization''' ==

http://imgur.com/HEDZl.jpg

== '''Documentation''' ==

The project worked well as a display piece and functioned while under demand. After discussion with the class we agree that the project is stronger as a volume level reacting rather than frequency reacting design. It would be interesting to further develop the project and implement it into a gallery setting. Where people would walk past it and have it react. It would be better to fine tune it so that it can be used on a larger set of screens with smaller drawings so that it would not have to be reset after a short amount of use, this would allow more people and a longer amount of time for interaction.

Images coming soon.

== '''Code Audio Level Based'''==

<code>
import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

float m = 0;
for(int i = 0; i < in.bufferSize() - 1; i++) {
if ( abs(in.mix.get(i)) > m ) {
m = abs(in.mix.get(i));
System.out.println(in.mix.get(i));

}
}
m*=150;
drawCircles(posX, posY, m, 10);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, float radius, int level)
{
noStroke();
float tt = 200 * level / 6.0;
fill (tt, 0, 116);//tt, 0, 116
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

=== '''Audio Frequency Based''' ===

<code>

import hypermedia.video.*;
import ddf.minim.*;
import ddf.minim.analysis.*;
import ddf.minim.signals.*;

Minim minim;
AudioInput in;
FFT fft;

OpenCV opencv;

// contrast/brightness values
int contrast_value = 0;
int brightness_value = 0;

float loudestFreqAmp = 0;
float loudestFreq = 0;
int timerCounter = 0;

void setup()
{
size(640, 480, P2D);
frameRate(30);
noCursor();
minim = new Minim(this);
minim.debugOn();
background(255);
noStroke();
// get a line in from Minim, default bit depth is 16
in = minim.getLineIn(Minim.STEREO, 1024);
fft = new FFT(in.bufferSize(), in.sampleRate());

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

}

void draw()
{

// grab a new frame
// and convert to gray
opencv.read();
opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
java.awt.Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
//image( opencv.image(), 0, 0 );

// draw face area(s)
// noFill();
// stroke(255,0,0);
// for( int i=0; i<faces.length; i++ ) {
// rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
// }

int posX = 0;
int posY = 0;

for( int i=0; i<faces.length; i++ ) {
posX = faces[i].x;
posY = faces[i].y;
}

fft.window(FFT.HAMMING);
for(int i = 0; i < fft.specSize(); i++)
{
// draw the line for frequency band i, scaling it by 4 so we can
//see it a bit better
if (fft.getBand(i) > loudestFreqAmp && fft.getBand(i) > 10)
{
loudestFreqAmp = fft.getBand(i);
loudestFreq = i * 4;

// draw the thing
drawCircles(posX, posY, (int)loudestFreqAmp, 10);

timerCounter = 0;
System.out.println(loudestFreq + "---" + loudestFreqAmp);
}
}
loudestFreqAmp = 0;

fft.forward(in.mix);

if(timerCounter >= 20)
{
background(255);
timerCounter = 0;
}

timerCounter++;

}

void keyPressed() {
if (key == 'a') {
background(255);
}
}

// Circle splatter machine
void drawCircles(float x, float y, int radius, int level)
{
noStroke();
float tt = 116 * level / 6.0;
fill (tt, 45, 255);
ellipse(x, y, radius*2, radius*2);
if (level > 1) {
level = level - 1;
int num = int (random(2, 5));
for(int i=0; i<num; i++) {
float a = random(0, TWO_PI);
float nx = x + cos(a) * 6.0 * level;
float ny = y + sin(a) * 6.0 * level;
drawCircles(nx, ny, radius/2, level);
}
}
}

void stop()
{
// always close Minim audio classes when you are done with them
in.close();
minim.stop();

super.stop();
}

</code>

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T21:44:04Z

GregoryParsons: /* Documentation */

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T21:43:38Z

GregoryParsons: /* Documentation */

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T21:42:29Z

GregoryParsons: /* Documentation */

Students/GregoryParsons

2010-05-20T15:49:53Z

GregoryParsons:

Course page
[[Time and Process Based Digital Media]]

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

'''Midterm Project'''

Sound Sketch with Emilio Marcelino, and Ben Brickley

'''Final Project'''

Coming soon to a wiki near you (this one).

-G

Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley

2010-05-20T15:46:52Z

GregoryParsons:

Motion Animation - Greg Parsons

2010-04-29T22:40:12Z

GregoryParsons:

----

Midterm Project

;Motivation:
: I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create a project that is manipulated by movements from the viewer of the project.
;Interaction:
: The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
;Function:
: My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth movement in the image using some form of algorithmic processing.
;Visualization:
: I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in class if needed.

----

Code for Demo:

Copy this into a new processing project to test.

<pre>
* Greg Parsons VIS145B Midterm Test
*
* Project Uses Frame Differencing to detect motion, sees it and draws a picture
*
*/

//videocapture
import processing.video.*;
float x, y;
int numPixels;
int[] previousFrame;
int[] diffFrame;
Capture video;

//treecursion
float curlx = 0;
float curly = 0;
float f = sqrt(2)/2.;
float deley = 20;
float growth = 0;
float growthTarget = 0;

int movementDiff = constrain(10, 5, 15);
int movementDiffNegative = constrain(10, -5, -10);

void setup() {
//video capture
size(640, 480, P2D); //P2D from treecursion
video = new Capture(this, width, height, 24);
numPixels = video.width * video.height;
previousFrame = new int[numPixels];
diffFrame = new int[numPixels];
loadPixels();
smooth();
//treecursion
addMouseWheelListener(new java.awt.event.MouseWheelListener() {
public void mouseWheelMoved(java.awt.event.MouseWheelEvent evt) {
mouseWheel(evt.getWheelRotation());
}
}
);
}

void draw() {

//video capture
if (video.available()) {

// When using video to manipulate the screen, use video.available() and
// video.read() inside the draw() method so that it's safe to draw to the screen
video.read(); // Read the new frame from the camera
video.loadPixels(); // Make its pixels[] array available

int movementSum = 0; // Amount of movement in the frame
for (int i = 0; i < numPixels; i++) { // For each pixel in the video frame...
color currColor = video.pixels[i];
color prevColor = previousFrame[i];
// Extract the red, green, and blue components from current pixel
int currR = (currColor >> 16) & 0xFF; // Like red(), but faster
int currG = (currColor >> 8) & 0xFF;
int currB = currColor & 0xFF;
// Extract red, green, and blue components from previous pixel
int prevR = (prevColor >> 16) & 0xFF;
int prevG = (prevColor >> 8) & 0xFF;
int prevB = prevColor & 0xFF;
// Compute the difference of the red, green, and blue values
int diffR = abs(currR - prevR);
int diffG = abs(currG - prevG);
int diffB = abs(currB - prevB);
// Add these differences to the running tally
movementSum += diffR + diffG + diffB;
// Render the difference image to the screen
//diffFrame = color(diffR, diffG, diffB);
diffFrame[i] = round(sqrt(diffR*diffR + diffG*diffG + diffB*diffB));
// pixels[i] = currColor;
// pixels[i] = color(diffFrame[i]);
// The following line is much faster, but more confusing to read
//pixels[i] = 0xff000000 | (diffR << 16) | (diffG << 8) | diffB;
// Save the current color into the 'previous' buffer
previousFrame[i] = currColor;
}
// To prevent flicker from frames that are all black (no movement),
// only update the screen if the image has changed.
if (movementSum > 0) {
updatePixels();
// println(movementSum); // Print the total amount of movement to the console
}
}

int v = round(x+y*width);
if (diffFrame[v] > 5)
{

if ((diffFrame[v] > 5) && (diffFrame[v] < 15))
{
movementDiff = movementDiff + 3;
}
else if ((diffFrame[v] > 15) && (diffFrame[v] < 50))
{
movementDiff = movementDiff - 3;
}

movementDiffNegative = (movementDiff * -1);

System.out.println("the movement diff is" + movementDiff + "the movementDiffNegative is" + movementDiffNegative);
//treecursion
background(250);
stroke(0);
curlx += (radians(360./height*movementDiff)-curlx)/deley;
curly += (radians(360./height*movementDiffNegative)-curly)/deley;
translate(width/2,height/3*2);
line(0,0,0,height/2);
branch(height/4.,17);
growth += (growthTarget/10-growth+1.)/deley;
println(diffFrame[v]);
}

}

void mouseWheel(int delta)
{
growthTarget += delta;
}

//treecursion
void branch(float len,int num)
{
len *= f;
num -= 1;
if((len > 1) && (num > 0))
{
pushMatrix();
rotate(curlx);
line(0,0,0,-len);
translate(0,-len);
branch(len,num);
popMatrix();

// pushMatrix();
// line(0,0,0,-len);
// translate(0,-len);
// branch(len);
// popMatrix();
len *= growth;
pushMatrix();
rotate(curlx-curly);
line(0,0,0,-len);
translate(0,-len);
branch(len,num);
popMatrix();
//len /= growth;
}
}

</pre>

Motion Animation - Greg Parsons

2010-04-29T22:38:56Z

GregoryParsons: New page: ---- Midterm Project ;Motivation: : I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technol...

----

Midterm Project

;Motivation:
: I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create a project that is manipulated by movements from the viewer of the project.
;Interaction:
: The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
;Function:
: My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth movement in the image using some form of algorithmic processing.
;Visualization:
: I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in class if needed.

----

Code for Demo:

Copy this into a new processing project to test.

<nowiki>/**
* Greg Parsons VIS145B Midterm Test
*
* Project Uses Frame Differencing to detect motion, sees it and draws a picture
*
*/

//videocapture
import processing.video.*;
float x, y;
int numPixels;
int[] previousFrame;
int[] diffFrame;
Capture video;

//treecursion
float curlx = 0;
float curly = 0;
float f = sqrt(2)/2.;
float deley = 20;
float growth = 0;
float growthTarget = 0;

int movementDiff = constrain(10, 5, 15);
int movementDiffNegative = constrain(10, -5, -10);

void setup() {
//video capture
size(640, 480, P2D); //P2D from treecursion
video = new Capture(this, width, height, 24);
numPixels = video.width * video.height;
previousFrame = new int[numPixels];
diffFrame = new int[numPixels];
loadPixels();
smooth();
//treecursion
addMouseWheelListener(new java.awt.event.MouseWheelListener() {
public void mouseWheelMoved(java.awt.event.MouseWheelEvent evt) {
mouseWheel(evt.getWheelRotation());
}
}
);
}

void draw() {

//video capture
if (video.available()) {

// When using video to manipulate the screen, use video.available() and
// video.read() inside the draw() method so that it's safe to draw to the screen
video.read(); // Read the new frame from the camera
video.loadPixels(); // Make its pixels[] array available

int movementSum = 0; // Amount of movement in the frame
for (int i = 0; i < numPixels; i++) { // For each pixel in the video frame...
color currColor = video.pixels[i];
color prevColor = previousFrame[i];
// Extract the red, green, and blue components from current pixel
int currR = (currColor >> 16) & 0xFF; // Like red(), but faster
int currG = (currColor >> 8) & 0xFF;
int currB = currColor & 0xFF;
// Extract red, green, and blue components from previous pixel
int prevR = (prevColor >> 16) & 0xFF;
int prevG = (prevColor >> 8) & 0xFF;
int prevB = prevColor & 0xFF;
// Compute the difference of the red, green, and blue values
int diffR = abs(currR - prevR);
int diffG = abs(currG - prevG);
int diffB = abs(currB - prevB);
// Add these differences to the running tally
movementSum += diffR + diffG + diffB;
// Render the difference image to the screen
//diffFrame = color(diffR, diffG, diffB);
diffFrame[i] = round(sqrt(diffR*diffR + diffG*diffG + diffB*diffB));
// pixels[i] = currColor;
// pixels[i] = color(diffFrame[i]);
// The following line is much faster, but more confusing to read
//pixels[i] = 0xff000000 | (diffR << 16) | (diffG << 8) | diffB;
// Save the current color into the 'previous' buffer
previousFrame[i] = currColor;
}
// To prevent flicker from frames that are all black (no movement),
// only update the screen if the image has changed.
if (movementSum > 0) {
updatePixels();
// println(movementSum); // Print the total amount of movement to the console
}
}

int v = round(x+y*width);
if (diffFrame[v] > 5)
{

if ((diffFrame[v] > 5) && (diffFrame[v] < 15))
{
movementDiff = movementDiff + 3;
}
else if ((diffFrame[v] > 15) && (diffFrame[v] < 50))
{
movementDiff = movementDiff - 3;
}

movementDiffNegative = (movementDiff * -1);

System.out.println("the movement diff is" + movementDiff + "the movementDiffNegative is" + movementDiffNegative);
//treecursion
background(250);
stroke(0);
curlx += (radians(360./height*movementDiff)-curlx)/deley;
curly += (radians(360./height*movementDiffNegative)-curly)/deley;
translate(width/2,height/3*2);
line(0,0,0,height/2);
branch(height/4.,17);
growth += (growthTarget/10-growth+1.)/deley;
println(diffFrame[v]);
}

}

void mouseWheel(int delta)
{
growthTarget += delta;
}

//treecursion
void branch(float len,int num)
{
len *= f;
num -= 1;
if((len > 1) && (num > 0))
{
pushMatrix();
rotate(curlx);
line(0,0,0,-len);
translate(0,-len);
branch(len,num);
popMatrix();

// pushMatrix();
// line(0,0,0,-len);
// translate(0,-len);
// branch(len);
// popMatrix();
len *= growth;
pushMatrix();
rotate(curlx-curly);
line(0,0,0,-len);
translate(0,-len);
branch(len,num);
popMatrix();
//len /= growth;
}
}

</nowiki>

Students/GregoryParsons

2010-04-29T22:37:27Z

GregoryParsons:

Classes/2010/VIS145B

2010-04-29T22:36:58Z

GregoryParsons: /* Midterm Projects */

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*personal wiki page
*source code on wiki
*image/video documentation as appropriate.
*explanatory writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 - Midterm Critiques ===
*Due: Midterm Projects
*In Class:
**Critique of midterm projects.

=== Week 7 ===
Student presentations
=== Week 8 ===
Student presentations
=== Week 9 ===
Student presentations
=== Week 10 - Final Critiques ===
In-class Critiques.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | Untitled - Joel and Jenny Chang]]
* [[Carnival Ride (Midterm Project)| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Motion Animation - Greg Parsons]]

'''Joel + Jenny, Christina + Jennifer''': Your teams named their pages the same thing. Instead of "Midterm Project", call it "Midterm Project - Carnival Ride", or "Midterm Project Joel + Jenny" or something...

'''Ben, Emilio, and Gregory''': please move your project proposals from your personal pages to an actual midterm project page, and link to it from this section.

'''Everyone''': Be sure you have put your names on your project pages if it is not readily apparent who made them!

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Students/GregoryParsons

2010-04-29T21:27:20Z

GregoryParsons:

Course page
[[Time and Process Based Digital Media]]

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

-G

_________
Midterm Project

;Motivation:
: I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create a project that is manipulated by movements from the viewer of the project.
;Interaction:
: The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
;Function:
: My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth movement in the image using some form of algorithmic processing.
;Visualization:
: I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in class if needed.

Students/GregoryParsons

2010-04-29T21:26:51Z

GregoryParsons:

Course page
[[Time and Process Based Digital Media]]

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

-G

_________
Midterm Project

;Motivation:
: I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class :sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create :a project that is manipulated by movements from the viewer of the project.
;Interaction:
: The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image :based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
;Function:
: My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth :movement in the image using some form of algorithmic processing.
;Visualization:
: I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in :class if needed.

Students/GregoryParsons

2010-04-29T20:50:47Z

GregoryParsons:

Course page
[[Time and Process Based Digital Media]]

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

-G

_________
Midterm Project

Motivation:
I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create a project that is manipulated by movements from the viewer of the project.
Interaction:
The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
Function:
My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth movement in the image using some form of algorithmic processing.
Visualization:
I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in class if needed.

Students/GregoryParsons

2010-04-29T20:50:24Z

GregoryParsons:

Course page
[[Time and Process Based Digital Media]]

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

-G

_________
Midterm Project

Motivation
I was interested in the demonstrations of computer vision presented during the first week of lecture. Using the in class sampling of the technologies I was impressed by how I was able to manipulate a project using frame differencing. I would like to create a project that is manipulated by movements from the viewer of the project.
Interaction
The interaction of the project will be enacted with a webcam, recording movement in a scene and manipulating a graphical image based on the data collected from the difference in frames. In total the project would react to the viewers movements in some way.
Function
My programming experience is limited to the past two quarters of instruction. But I would like to be able to achieve smooth movement in the image using some form of algorithmic processing.
Visualization
I have a semi-working project that I created this weekend using a visual example from OpenProcessing.org that I will show in class if needed.

Students/GregoryParsons

2010-04-13T21:02:57Z

GregoryParsons:

Students/GregoryParsons

2010-04-13T21:01:50Z

GregoryParsons:

Senior-ish student, ICAM VisArts Major.

Interests: Film, Product Design, Device Interactivity, Web Design, Photography, Audio / Video, Video Games, Reading...

-G

Classes/2010/VIS145B

2010-04-13T20:59:05Z

GregoryParsons: /* Student Pages */

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*personal wiki page
*source code on wiki
*image/video documentation where appropriate.
*explanatory writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Computer Vision / Human Perception ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Discuss: CV methods—thresholding, blob-detection, facial recognition, motion/flow estimation.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. http://www.eyewriter.org/ -> Saccade.
*OpenCV [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
*Read/Respond: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 ===
=== Week 4 ===
*Due: Midterm proposals.
=== Week 5 ===
Midterm critiques.
=== Week 6 ===
=== Week 7 ===
Student presentations
=== Week 8 ===
Student presentations
=== Week 9 ===
Student presentations
=== Week 10 ===
Final critiques.
=== Finals Week ===
Final documentation due.
== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*Discuss telematic perfromance.
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/ Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]

=== How-To ===
Register to create a log-in in the upper right.

wiki-text of the form: <code><nowiki>[[Students/RobertTwomey | RobertTwomey]]</nowiki></code>

will come out looking like this: [[Students/RobertTwomey | RobertTwomey]], which is a link to your new personal page on the wiki. Click on it and begin editing away.

There is editing help here http://en.wikipedia.org/wiki/Help:Editing and here http://en.wikipedia.org/wiki/Wikipedia:Cheatsheet. Image uploading help is here http://en.wikipedia.org/wiki/Wikipedia:Uploading_images. Of course you can always view the source of my page (or any other page) to learn how to do things.

If your embedded photo is HUGE, try some of these tips:

* <code><nowiki>[[Image:File.jpg]]</nowiki></code> to use the full version of the file
* <code><nowiki>[[Image:File.png|200px|thumb|left|alt text]]</nowiki></code> to use a 200 pixel wide rendition in a box in the left margin with 'alt text' as description
* <code><nowiki>[[Media:File.ogg]]</nowiki></code> for directly linking to the file without displaying the file

Students/GregoryParsons

2010-04-13T20:58:43Z

GregoryParsons: New page: Here is my page! -G

Here is my page!

-G

Classes/2010/VIS145B

2010-04-13T20:58:27Z

GregoryParsons: /* Student Pages */

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*personal wiki page
*source code on wiki
*image/video documentation where appropriate.
*explanatory writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Computer Vision / Human Perception ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Discuss: CV methods—thresholding, blob-detection, facial recognition, motion/flow estimation.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. http://www.eyewriter.org/ -> Saccade.
*OpenCV [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
*Read/Respond: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 ===
=== Week 4 ===
*Due: Midterm proposals.
=== Week 5 ===
Midterm critiques.
=== Week 6 ===
=== Week 7 ===
Student presentations
=== Week 8 ===
Student presentations
=== Week 9 ===
Student presentations
=== Week 10 ===
Final critiques.
=== Finals Week ===
Final documentation due.
== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*Discuss telematic perfromance.
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/ Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | GregoryParsons]]

=== How-To ===
Register to create a log-in in the upper right.

wiki-text of the form: <code><nowiki>[[Students/RobertTwomey | RobertTwomey]]</nowiki></code>

will come out looking like this: [[Students/RobertTwomey | RobertTwomey]], which is a link to your new personal page on the wiki. Click on it and begin editing away.

There is editing help here http://en.wikipedia.org/wiki/Help:Editing and here http://en.wikipedia.org/wiki/Wikipedia:Cheatsheet. Image uploading help is here http://en.wikipedia.org/wiki/Wikipedia:Uploading_images. Of course you can always view the source of my page (or any other page) to learn how to do things.

If your embedded photo is HUGE, try some of these tips:

* <code><nowiki>[[Image:File.jpg]]</nowiki></code> to use the full version of the file
* <code><nowiki>[[Image:File.png|200px|thumb|left|alt text]]</nowiki></code> to use a 200 pixel wide rendition in a box in the left margin with 'alt text' as description
* <code><nowiki>[[Media:File.ogg]]</nowiki></code> for directly linking to the file without displaying the file