Robert-Depot - User contributions [en]

Eye Motion Experiment - Javi Lee

2010-06-04T21:18:20Z

Jal012: /* Documentation */

== Description ==

*Motivation

My main motivation for this project was to experiment and document on the processes of the human mind differentiating between males and females. I wanted to see what each gender would specifically look at when shown an image. My hypothesis would be that when shown an image of a sexy female, the males would naturally look at the breast and the butt, whereas the females would look more at the face and the abs. I wanted to see if males and females minds are the same or if they were indeed different.

In order to see how this experiment would work, I wanted to hook up each participant to an eye tracking webcam. This webcam would track the iris of the eye and display that path on the screen. This track will be clear and visible for the audience standing behind the participant to see. The participant will only see the images but will not be able to see the screen where his eyes will be tracking. I wanted to display an array of images, not limited to people, and see what aspect of the images each gender concentrates on.

*Technical Description

I wanted to use Processing to create a code that will track the eyeball. This code will also draw the path that the eyeball takes. In order to track the eyeball, I wanted to create some kind of glasses that is connected to a webcam that will track the iris of the eyeball.

Unfortunately this one did not work.

==Documentation==

import java.util.ArrayList;

import processing.core.PApplet;
import processing.video.Capture;

public class ICU extends PApplet {
final int JESSICA = 0, MAGGIE = 1, HYORI = 2, NAMIE = 3;
final int KIM = 4;
int item = JESSICA;
boolean usingMouse = false; //to use mouse for preso, if needed!

Capture video;// regular processing libary
int pupilThreshold = 100;
int glintThreshold = 240;
int edge = 50;
int reach = 5;
int minPupilArea = 75;
long elapsedTime;
float calibrationSlope;
int calibrationIntercept;
Rectangle pupil;
Rectangle glint;
CoordinatesTranslator calibrator;

PImage img, imgJessica, imgMaggie, imgHyori, imgNamie;
long lastVideo = 0;

//variables for easing
float crosshairLocationOnScreenX;
float crosshairLocationOnScreenY;
float targetX, targetY;
float easing = 0.05;
boolean debug = true;
PImage testImage;
boolean leaveTrails;
static public void main(String _args[]) {
PApplet.main(new String[] {
"tracking.Eyetrack" }
);
}
int num = 20;
// Images must be in the "data" directory to load correctly
float mx[] = new float[num]; float my[] = new float[num]; float easing = 0.05; int radius = 8; int edge = 0; int inner = edge + radius;

public void setup() {
size(600, 800);
noStroke();
smooth();
//ellipseMode(RADIUS);
//rectMode(CORNERS);
println( Capture.list());
video = new Capture(this, width, height, Capture.list()[4] );
//video.settings();
testImage = loadImage("mm.jpg");
size(testImage.width,testImage.height);
calibrator = new CoordinatesTranslator();
image(testImage,0,0);

smooth();

img = loadImage("korean-girls-kang-su-yeon.jpg");
imgJessica = loadImage("Jessica_alba.jpg");
imgMaggie = loadImage("maggie_q_1.jpg");
imgHyori = loadImage("lee_hyori.jpg");
imgNamie = loadImage("namie_amuro_1.jpg");

noCursor();

imageMode(CENTER);

}

public void draw() {
background(225);
drawTarget();
stroke(225,0,0);
noFill();
//draw crosshairs on screen, and add easing for smoother transitions float dx = drawX - crosshairLocationOnScreenX;
if (abs(mouseX - mx) > 0.1) {
mx = mx + (mouseX - mx) * easing;
}
if (abs(mouseY - my) > 0.1) {
my = my + (mouseY- my) * easing;
}

mx = constrain(mx, inner, width - inner);
my = constrain(my, inner, height - inner);
//fill(76);
//rect(edge, edge, width-edge, height-edge);
fill(0);
ellipse(mx, my, radius, radius);

int which = frameCount % num;
mx[which] = mouseX;
my[which] = mouseY;

for (int i = 0; i < num; i++) {
//which+1 is the smallest (the oldest in the array)
int index = (which+1 + i) % num;
ellipse(mx[index], my[index], i, i); }
if(abs(dx) > 1) {
crosshairLocationOnScreenX += dx * easing;
}

//targetY = drawY;
float dy = drawY - crosshairLocationOnScreenY;
if(abs(dy) > 1) {
crosshairLocationOnScreenY += dy * easing;
}

if (video.available() && (millis() > lastVideo + 10)) {
lastVideo = millis();
video.read();
long startTime = millis();
elapsedTime = millis() - startTime;
if (debug) {
background(0);
image(video, 0, 0);
}
else{
if (leaveTrails == false) image(testImage,0,0);
if (calibrating) { image(testImage,0,0); }
if (pupil != null) {
ellipse(pupil.x+pupil.width/2,pupil.y+pupil.height/2,40,40);
//drawX = int(map(pupil.x+pupil.width/2, 0, video.width, 0, width));
//drawY = int(map(pupil.y+pupil.height/2, 0, video.height, 0, height));*/
//drawX = adjustedPoint[0];
//drawY = adjustedPoint[1];*/
//println(adjustedPoint[0]+", "+adjustedPoint[1]);
}
}
pupil = findPupil();
glint = null;
if (pupil != null) glint = findGlint(pupil);
//if the glint and the pupil are present
if (glint != null && pupil != null) { // if we got both
// find out where the pupil is relative to the glint
int rawX = pupil.x+ pupil.width/2 - glint.x + glint.width/2;
int rawY =glint.y + glint.height/2- pupil.y + pupil.height/2 ;
//if the system is calibrating
if (calibrator.isCurrentlyCalibrating()) { // check if we are in calibration mode
Point placeToLook = calibrator.getScenePoint(); // get where they are supposed to look at
//draw the dots for the user to look at for calibration purposes
placeToDrawTarget = placeToLook;
if (placeToDrawTarget.x > 0 &&
calibrator.isCurrentlyCalibrating()) {
stroke(0);
fill(0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 28, 28);// draw it so they look
stroke(255);
fill(255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 22, 22);// draw it so they look
stroke(40,40,255);
fill(40,40,255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 16, 16);// draw it so they look
stroke(255,0,0);
fill(255,0,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 10, 10);// draw it so they look
stroke(255,255,0);
fill(255,255,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 7, 7);// draw it so they look
}
//CHANGE THIS TO ELMO

calibrator.doCalibrationRoutine(true,rawX, rawY);
println("calibrating");

}
//if the system is not calibrating,
else {
//use the calibrator to find out where the x,y from camera corolate to on image
int[] adjustedPoint = calibrator.translate(rawX, rawY);
println("Adjusted x" + adjustedPoint[0] + " adjusted y" + adjustedPoint[1]);

//if the mouse is not being used, draw the crosshairs at adjusted points
if(!usingMouse) {
drawX = adjustedPoint[0];
drawY = adjustedPoint[1];
}
}

}

}

}

public Rectangle findPupil() {
// /FIND THE PUPIL
ArrayList boxes = new ArrayList();
for (int row = edge; row < video.height - edge * 2; row++) {
for (int col = edge; col < video.width - edge * 2; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for dark things
if (brightness(thisPixel) < pupilThreshold) {
video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < boxes.size(); i++) {
Rectangle existingBox = (Rectangle) boxes.get(i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) boxes.add(new Rectangle(col, row, 0, 0));
}
}
}

consolidate(boxes, 0, 0);

// OF EVERYTHING YOU FIND TAKE THE ONE CLOSEST TO THE CENTER
Rectangle pupil = findClosestMostBigOne(boxes, video.width / 2, video.height / 2, minPupilArea);
if (debug) {
// show the the edges of the search
fill(0, 0, 0, 0);
stroke(0, 255, 0);
rect(edge, edge, video.width - 2 * edge, video.height - 2 * edge);
// show all the pupil candidates
stroke(0, 0, 0);
for (int i = 0; i < boxes.size(); i++) {
Rectangle thisBox = (Rectangle) boxes.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
}
// show the winning pupil candidate in red
if (pupil != null) {
stroke(255, 0, 0);
rect(pupil.x, pupil.y, pupil.width, pupil.height);
}
}
return pupil;
}

public Rectangle findGlint(Rectangle _pupil) {
// ADJUST THE BOUNDS OF YOUR SEARCH TO BE AROUND AND UNER THE PUPIL
int glintEdgeL = Math.max(0, _pupil.x - _pupil.width * 2);
int glintEdgeR = Math.min(video.width - 1, _pupil.x + _pupil.width + _pupil.width * 2);
int glintTop = _pupil.y;
int glintBottom = Math.min(video.height - 1, _pupil.y + _pupil.height + _pupil.height * 2);

ArrayList glintsCandidates = new ArrayList();
for (int row = glintTop; row < glintBottom; row++) {
for (int col = glintEdgeL; col < glintEdgeR; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for bright things
if (brightness(thisPixel) > glintThreshold) {
if (debug) video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle existingBox = (Rectangle) glintsCandidates.get (i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) glintsCandidates.add(new Rectangle (col, row, 0, 0));
}
}
}
// FIND THE GLINT THAT IS CLOSEST TO THE PUPIL
Rectangle glint = findClosestMostBigOne(glintsCandidates,
_pupil.x + _pupil.width, _pupil.y + _pupil.height / 2, 0);
stroke(0, 0, 255);

if (debug) {// show all the candidate
// show the edges of the search for the glint
stroke(0, 75, 200);
rect(glintEdgeL, glintTop, glintEdgeR - glintEdgeL, glintBottom - glintTop);
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle thisBox = (Rectangle) glintsCandidates.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
} // show the winner in red
if (glint != null) {
stroke(255, 0, 0);
rect(glint.x, glint.y, glint.width, glint.height);
}
}

return glint;
}

public void consolidate(ArrayList _shapes, int _consolidateReachX, int _consolidateReachY) {
// check every combination of shapes for overlap
// make the repeat loop backwards so you delete off the bottom of the stack
for (int i = _shapes.size() - 1; i > -1; i--) {
// only check the ones up
Rectangle shape1 = (Rectangle) _shapes.get(i);
Rectangle inflatedShape1 = new Rectangle(shape1); // copy the existing box
inflatedShape1.grow(_consolidateReachX,
_consolidateReachY); // widen it's reach

for (int j = i - 1; j > -1; j--) {
Rectangle shape2 = (Rectangle) _shapes.get(j);
if (inflatedShape1.intersects(shape2)) {
shape1.add(shape2);
// System.out.println("Remove" + j);
_shapes.remove(j);
break;
}
}
}
}

public Rectangle findClosestMostBigOne(ArrayList _allRects, int _x, int _y, int _minArea) {
if (_allRects.size() == 0) return null;
int winner = 0;
float closest = 1000;

for (int i = 0; i < _allRects.size(); i++) {
Rectangle thisRect = (Rectangle) _allRects.get(i);
if (thisRect.width * thisRect.height < _minArea) continue;
float thisDist = dist(_x, _y, thisRect.x + thisRect.width / 2, thisRect.y + thisRect.height / 2);
if (thisDist < closest) {
closest = thisDist;
winner = i;
}
}
return (Rectangle) _allRects.get(winner);
}
void stop() {
}
}

Censored

2010-06-04T20:08:57Z

Jal012: /* Documentation */

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==

[[Image:vis147bfinal.jpg|none|thumb|400px|left|Best Invention for lonely days.]]

[[Image:vis147b1.jpg|none|thumb|400px|left|Best Invention for lonely days.]]

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

File:Vis147b1.jpg

2010-06-04T20:08:19Z

Jal012:

Censored

2010-06-04T20:08:05Z

Jal012:

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==

[[Image:vis147bfinal.jpg|none|thumb|200px|left|Best Invention for lonely days.]]

[[Image:vis147b1.jpg|none|thumb|200px|left|Best Invention for lonely days.]]

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

Censored

2010-06-04T20:04:16Z

Jal012: New page: ==Description== *Motivation I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see...

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

Classes/2010/VIS145B

2010-06-04T20:01:58Z

Jal012: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings/Assignments/Homework - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Eye Motion Experiment - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Camera Keyboard - Joeny Thipsidakhom]]
* [[uMV | uMV - Tony Lu]]
* [[Stone Face | Stone Face - Jennifer Sunga]]
* [[This Music: Prohibited | This Music: Prohibited - Kelley Kim]]
* [[Censored | Censored: Too Vulgar - Javier Lee]]
* [[What do you see? | What do you see? - Christina Sanchez]]
* [[Happy Days - Gregory Parsons]]
* [[Adios Chancellor! - Ben Brickley]]
* [[FRSynth - Emilio Marcelino]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Blockman

2010-06-04T19:53:42Z

Jal012: /* Documentation */

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==
[[Image:vis147bfinal.jpg|none|thumb|500px|left|Censored: Too Vulgar.]]

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

File:Vis147bfinal.jpg

2010-06-04T19:53:07Z

Jal012:

Blockman

2010-06-04T19:52:12Z

Jal012: /* Documentation */

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==
[[Image:vis147bfinal.jpg|none|thumb|200px|left|Censored: Too Vulgar.]]

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

Blockman

2010-06-04T19:43:47Z

Jal012: /* Code */

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. Unfortunately, I found out last minute that my original code was invalid because I tried incorporating original processing code into an OpenCV code so i had to rethink my final project. In a way, all the work i put into the first idea actually helped me create my final product. I was able to use the face-tracking code to track the face and cover then censor the face for being too vulgar. This is a comment on the FCC's censorship on T.V. and a look into the future and comment on what they could end up censoring.

*Interactive paradigm

This would be in a gallery where people would interact by walking by. As they walk by they see that they are being projected onto the wall in front of them and as they turn to face the camera's the program will censor out their faces. It will read "Censored: Too Vulgar."

*Technical Description

I used processing to create a program that will create a black sphere where the face would be and "censor" it out. I used the face tracking code and basically created a sphere inside the box that the face-tracking code creates. The webcam captures the video images and allows the user to see the footage being displayed with the censored faces.

==Documentation==

==Code==

import hypermedia.video.*;
import java.awt.Rectangle;

OpenCV opencv;
PFont font;
float ball_x;
float ball_y;
float ball_dir = 0;
float ball_size; // Radius
float dy = 0; // Direction
float dx = 0;
int dist_wall = 15;
int i;

//color c1 = color(102, 102, 0);

void setup() {

size(450, 450);

opencv = new OpenCV(this);
opencv.capture( width, height );
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load the FRONTALFACE description file
image( opencv.image(), 0, 0 ); // and display image
ellipseMode(RADIUS);
noStroke();
smooth();
ball_y = height/2;
ball_x = 1;

}

void draw() {

opencv.read();
image( opencv.image(), 0, 0 );
ball_x += dx;
ball_y += dy;
if(ball_x > width+ball_size) {
ball_x = -width/2 - ball_size;
ball_y = random(0, height);
dy = 0;
}
if (ball_x <= ball_size) ball_x=ball_size;
if (ball_x >= width-ball_size) ball_x=width-ball_size;
if (ball_y <= ball_size) ball_y=ball_size;
if (ball_y >= height-ball_size) ball_y=height-ball_size;

// detect anything ressembling a FRONTALFACE
Rectangle[] faces = opencv.detect();

// draw detected face area(s)
noFill();
stroke(255,0,0);
for( int i=0; i<faces.length; i++ ) {
rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
ball_x = faces[i].x + (faces[i].width/2);
ball_y = faces[i].y + (faces[i].height/2);
ball_size = (faces[i].width/4) + (faces[i].height/4);

fill(0);
ellipse(ball_x, ball_y, ball_size, ball_size);
font = loadFont("Courier-20.vlw");
textFont(font);
text("CENSORED: TOO VULGAR", (ball_x-faces[i].height/2), (ball_y-faces[i].width/2));
fill(0);

}

Blockman

2010-06-04T19:37:46Z

Jal012: /* Documentation */

Blockman

2010-06-04T19:37:32Z

Jal012: /* Description */

Eye Motion Experiment - Javi Lee

2010-06-03T01:10:06Z

Jal012: /* Documentation */

== Description ==

*Motivation

My main motivation for this project was to experiment and document on the processes of the human mind differentiating between males and females. I wanted to see what each gender would specifically look at when shown an image. My hypothesis would be that when shown an image of a sexy female, the males would naturally look at the breast and the butt, whereas the females would look more at the face and the abs. I wanted to see if males and females minds are the same or if they were indeed different.

In order to see how this experiment would work, I wanted to hook up each participant to an eye tracking webcam. This webcam would track the iris of the eye and display that path on the screen. This track will be clear and visible for the audience standing behind the participant to see. The participant will only see the images but will not be able to see the screen where his eyes will be tracking. I wanted to display an array of images, not limited to people, and see what aspect of the images each gender concentrates on.

*Technical Description

I wanted to use Processing to create a code that will track the eyeball. This code will also draw the path that the eyeball takes. In order to track the eyeball, I wanted to create some kind of glasses that is connected to a webcam that will track the iris of the eyeball.

Unfortunately this one did not work.

==Documentation==
import java.util.ArrayList;

import processing.core.PApplet;
import processing.video.Capture;

public class ICU extends PApplet {
final int JESSICA = 0, MAGGIE = 1, HYORI = 2, NAMIE = 3;
final int KIM = 4;
int item = JESSICA;
boolean usingMouse = false; //to use mouse for preso, if needed!

Capture video;// regular processing libary
int pupilThreshold = 100;
int glintThreshold = 240;
int edge = 50;
int reach = 5;
int minPupilArea = 75;
long elapsedTime;
float calibrationSlope;
int calibrationIntercept;
Rectangle pupil;
Rectangle glint;
CoordinatesTranslator calibrator;

PImage img, imgJessica, imgMaggie, imgHyori, imgNamie;
long lastVideo = 0;

//variables for easing
float crosshairLocationOnScreenX;
float crosshairLocationOnScreenY;
float targetX, targetY;
float easing = 0.05;
boolean debug = true;
PImage testImage;
boolean leaveTrails;
static public void main(String _args[]) {
PApplet.main(new String[] {
"tracking.Eyetrack" }
);
}
int num = 20;
// Images must be in the "data" directory to load correctly
float mx[] = new float[num]; float my[] = new float[num]; float easing = 0.05; int radius = 8; int edge = 0; int inner = edge + radius;

public void setup() {
size(600, 800);
noStroke();
smooth();
//ellipseMode(RADIUS);
//rectMode(CORNERS);
println( Capture.list());
video = new Capture(this, width, height, Capture.list()[4] );
//video.settings();
testImage = loadImage("mm.jpg");
size(testImage.width,testImage.height);
calibrator = new CoordinatesTranslator();
image(testImage,0,0);

smooth();

img = loadImage("korean-girls-kang-su-yeon.jpg");
imgJessica = loadImage("Jessica_alba.jpg");
imgMaggie = loadImage("maggie_q_1.jpg");
imgHyori = loadImage("lee_hyori.jpg");
imgNamie = loadImage("namie_amuro_1.jpg");

noCursor();

imageMode(CENTER);

}

public void draw() {
background(225);
drawTarget();
stroke(225,0,0);
noFill();
//draw crosshairs on screen, and add easing for smoother transitions float dx = drawX - crosshairLocationOnScreenX;
if (abs(mouseX - mx) > 0.1) {
mx = mx + (mouseX - mx) * easing;
}
if (abs(mouseY - my) > 0.1) {
my = my + (mouseY- my) * easing;
}

mx = constrain(mx, inner, width - inner);
my = constrain(my, inner, height - inner);
//fill(76);
//rect(edge, edge, width-edge, height-edge);
fill(0);
ellipse(mx, my, radius, radius);

int which = frameCount % num;
mx[which] = mouseX;
my[which] = mouseY;

for (int i = 0; i < num; i++) {
//which+1 is the smallest (the oldest in the array)
int index = (which+1 + i) % num;
ellipse(mx[index], my[index], i, i); }
if(abs(dx) > 1) {
crosshairLocationOnScreenX += dx * easing;
}

//targetY = drawY;
float dy = drawY - crosshairLocationOnScreenY;
if(abs(dy) > 1) {
crosshairLocationOnScreenY += dy * easing;
}

if (video.available() && (millis() > lastVideo + 10)) {
lastVideo = millis();
video.read();
long startTime = millis();
elapsedTime = millis() - startTime;
if (debug) {
background(0);
image(video, 0, 0);
}
else{
if (leaveTrails == false) image(testImage,0,0);
if (calibrating) { image(testImage,0,0); }
if (pupil != null) {
ellipse(pupil.x+pupil.width/2,pupil.y+pupil.height/2,40,40);
//drawX = int(map(pupil.x+pupil.width/2, 0, video.width, 0, width));
//drawY = int(map(pupil.y+pupil.height/2, 0, video.height, 0, height));*/
//drawX = adjustedPoint[0];
//drawY = adjustedPoint[1];*/
//println(adjustedPoint[0]+", "+adjustedPoint[1]);
}
}
pupil = findPupil();
glint = null;
if (pupil != null) glint = findGlint(pupil);
//if the glint and the pupil are present
if (glint != null && pupil != null) { // if we got both
// find out where the pupil is relative to the glint
int rawX = pupil.x+ pupil.width/2 - glint.x + glint.width/2;
int rawY =glint.y + glint.height/2- pupil.y + pupil.height/2 ;
//if the system is calibrating
if (calibrator.isCurrentlyCalibrating()) { // check if we are in calibration mode
Point placeToLook = calibrator.getScenePoint(); // get where they are supposed to look at
//draw the dots for the user to look at for calibration purposes
placeToDrawTarget = placeToLook;
if (placeToDrawTarget.x > 0 &&
calibrator.isCurrentlyCalibrating()) {
stroke(0);
fill(0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 28, 28);// draw it so they look
stroke(255);
fill(255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 22, 22);// draw it so they look
stroke(40,40,255);
fill(40,40,255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 16, 16);// draw it so they look
stroke(255,0,0);
fill(255,0,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 10, 10);// draw it so they look
stroke(255,255,0);
fill(255,255,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 7, 7);// draw it so they look
}
//CHANGE THIS TO ELMO

calibrator.doCalibrationRoutine(true,rawX, rawY);
println("calibrating");

}
//if the system is not calibrating,
else {
//use the calibrator to find out where the x,y from camera corolate to on image
int[] adjustedPoint = calibrator.translate(rawX, rawY);
println("Adjusted x" + adjustedPoint[0] + " adjusted y" + adjustedPoint[1]);

//if the mouse is not being used, draw the crosshairs at adjusted points
if(!usingMouse) {
drawX = adjustedPoint[0];
drawY = adjustedPoint[1];
}
}

}

}

}

public Rectangle findPupil() {
// /FIND THE PUPIL
ArrayList boxes = new ArrayList();
for (int row = edge; row < video.height - edge * 2; row++) {
for (int col = edge; col < video.width - edge * 2; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for dark things
if (brightness(thisPixel) < pupilThreshold) {
video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < boxes.size(); i++) {
Rectangle existingBox = (Rectangle) boxes.get(i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) boxes.add(new Rectangle(col, row, 0, 0));
}
}
}

consolidate(boxes, 0, 0);

// OF EVERYTHING YOU FIND TAKE THE ONE CLOSEST TO THE CENTER
Rectangle pupil = findClosestMostBigOne(boxes, video.width / 2, video.height / 2, minPupilArea);
if (debug) {
// show the the edges of the search
fill(0, 0, 0, 0);
stroke(0, 255, 0);
rect(edge, edge, video.width - 2 * edge, video.height - 2 * edge);
// show all the pupil candidates
stroke(0, 0, 0);
for (int i = 0; i < boxes.size(); i++) {
Rectangle thisBox = (Rectangle) boxes.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
}
// show the winning pupil candidate in red
if (pupil != null) {
stroke(255, 0, 0);
rect(pupil.x, pupil.y, pupil.width, pupil.height);
}
}
return pupil;
}

public Rectangle findGlint(Rectangle _pupil) {
// ADJUST THE BOUNDS OF YOUR SEARCH TO BE AROUND AND UNER THE PUPIL
int glintEdgeL = Math.max(0, _pupil.x - _pupil.width * 2);
int glintEdgeR = Math.min(video.width - 1, _pupil.x + _pupil.width + _pupil.width * 2);
int glintTop = _pupil.y;
int glintBottom = Math.min(video.height - 1, _pupil.y + _pupil.height + _pupil.height * 2);

ArrayList glintsCandidates = new ArrayList();
for (int row = glintTop; row < glintBottom; row++) {
for (int col = glintEdgeL; col < glintEdgeR; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for bright things
if (brightness(thisPixel) > glintThreshold) {
if (debug) video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle existingBox = (Rectangle) glintsCandidates.get (i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) glintsCandidates.add(new Rectangle (col, row, 0, 0));
}
}
}
// FIND THE GLINT THAT IS CLOSEST TO THE PUPIL
Rectangle glint = findClosestMostBigOne(glintsCandidates,
_pupil.x + _pupil.width, _pupil.y + _pupil.height / 2, 0);
stroke(0, 0, 255);

if (debug) {// show all the candidate
// show the edges of the search for the glint
stroke(0, 75, 200);
rect(glintEdgeL, glintTop, glintEdgeR - glintEdgeL, glintBottom - glintTop);
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle thisBox = (Rectangle) glintsCandidates.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
} // show the winner in red
if (glint != null) {
stroke(255, 0, 0);
rect(glint.x, glint.y, glint.width, glint.height);
}
}

return glint;
}

public void consolidate(ArrayList _shapes, int _consolidateReachX, int _consolidateReachY) {
// check every combination of shapes for overlap
// make the repeat loop backwards so you delete off the bottom of the stack
for (int i = _shapes.size() - 1; i > -1; i--) {
// only check the ones up
Rectangle shape1 = (Rectangle) _shapes.get(i);
Rectangle inflatedShape1 = new Rectangle(shape1); // copy the existing box
inflatedShape1.grow(_consolidateReachX,
_consolidateReachY); // widen it's reach

for (int j = i - 1; j > -1; j--) {
Rectangle shape2 = (Rectangle) _shapes.get(j);
if (inflatedShape1.intersects(shape2)) {
shape1.add(shape2);
// System.out.println("Remove" + j);
_shapes.remove(j);
break;
}
}
}
}

public Rectangle findClosestMostBigOne(ArrayList _allRects, int _x, int _y, int _minArea) {
if (_allRects.size() == 0) return null;
int winner = 0;
float closest = 1000;

for (int i = 0; i < _allRects.size(); i++) {
Rectangle thisRect = (Rectangle) _allRects.get(i);
if (thisRect.width * thisRect.height < _minArea) continue;
float thisDist = dist(_x, _y, thisRect.x + thisRect.width / 2, thisRect.y + thisRect.height / 2);
if (thisDist < closest) {
closest = thisDist;
winner = i;
}
}
return (Rectangle) _allRects.get(winner);
}
void stop() {
}
}

Blockman

2010-06-02T17:16:41Z

Jal012: /* Description */

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I wanted to see if I could make object move on the screen by just using my body or shadow. I was influenced by Camille Utterback's "Text Rain" and wanted to see if I could make objects move within the screen using my body. In the same way, I wanted to allow the participant of this project to be able to move the objects around the screen and "create", in a way, their own art piece WITHIN my art piece.

*Interactive paradigm

I wanted to take the physical space and turn it into art studio where the artist can create their artwork. The user will be able to move blocks and other objects on the screen by using their shadow to carry them and place them. They will be creating their own individual art piece within my art project.

*Technical Description

I will use processing to create a program that will create objects on the screen that will react to the shadow or the image of the user. It can be carried by the user or pushed and placed into any position. I can use the webcam on the computer to capture the image and use the code to use the captured image and interact with it.

==Documentation==

Eye Motion Experiment - Javi Lee

2010-06-02T17:10:23Z

Jal012: /* Description */

Eye Motion Experiment - Javi Lee

2010-06-02T17:09:43Z

Jal012: New page: == Description == *Motivation My main motivation for this project was to experiment and document on the processes of the human mind differentiating between males and females. I wanted to...

Classes/2010/VIS145B

2010-06-02T16:59:11Z

Jal012: /* Midterm Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings/Assignments/Homework - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Eye Motion Experiment - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Untitled (for now) - Joeny Thipsidakhom]]
* [[uMV | uMV - Tony Lu]]
* [[Stone Face | Stone Face - Jennifer Sunga]]
* [[This Music: Prohibited | This Music: Prohibited - Kelley Kim]]
* [[Blockman | Blockman - Javier Lee]]
* [[What do you see? | What do you see? - Christina Sanchez]]
* [[Happy Days - Gregory Parsons]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Blockman

2010-05-26T21:34:13Z

Jal012:

==Description==
*Motivation

I wanted to create an interactive piece that I might actually have a chance at finishing. I wanted to see if I could make object move on the screen by just using my body or shadow.

*Interactive paradigm

I wanted to take the physical space and turn it into art lab where the artist can create their artwork. The user will be able to move blocks and other objects on the screen by using their shadow to carry them and place them.

*Technical Description

I will use processing to create a program that will create objects on the screen that will react to the shadow or the image of the user. It can be carried by the user or pushed and placed into any position. The camera of the computer should be able to take the image or outline of the user.

Blockman

2010-05-26T21:27:12Z

Jal012: New page: ==Description==

==Description==

Classes/2010/VIS145B

2010-05-26T21:26:51Z

Jal012: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Untitled (for now) - Joeny Thipsidakhom]]
* [[uMV | uMV - Tony Lu]]
* [[Stone Face | Stone Face - Jennifer Sunga]]
* [[This Music: Prohibited | This Music: Prohibited - Kelley Kim]]
* [[Blockman | Blockman - Javier Lee]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Wii - remote composer - Javi Lee

2010-05-26T21:23:54Z

Jal012: /* Visualization */

== Description ==
*Motivation

I wanted to explore the difference between the minds of men and women. I wanted to see what the males prefer over the preferences of the female and vice versa. In a way to explore the psychological development of the human brain and if gender has a factor to it.

*Interactive paradigm

I wanted to take the physical space and turn it into experiment lab. The user will not be able to see that the program is tracking what he/she is looking at but the observers will be able to see.

*Technical Description

I want to use Processing to display the tracks of where the eyeball will be looking at. It will display pictures and the participant will just look at the pictures. I wanted to put an eyeball tracker that will track where the eye is looking at. In this way it will track what the participants are looking at.

==Visualization==
*Functional Diagram
program code:

import java.util.ArrayList;

import processing.core.PApplet;
import processing.video.Capture;

public class ICU extends PApplet {
final int JESSICA = 0, MAGGIE = 1, HYORI = 2, NAMIE = 3;
final int KIM = 4;
int item = JESSICA;
boolean usingMouse = false; //to use mouse for preso, if needed!

Capture video;// regular processing libary
int pupilThreshold = 100;
int glintThreshold = 240;
int edge = 50;
int reach = 5;
int minPupilArea = 75;
long elapsedTime;
float calibrationSlope;
int calibrationIntercept;
Rectangle pupil;
Rectangle glint;
CoordinatesTranslator calibrator;

PImage img, imgJessica, imgMaggie, imgHyori, imgNamie;
long lastVideo = 0;

//variables for easing
float crosshairLocationOnScreenX;
float crosshairLocationOnScreenY;
float targetX, targetY;
float easing = 0.05;
boolean debug = true;
PImage testImage;
boolean leaveTrails;
static public void main(String _args[]) {
PApplet.main(new String[] {
"tracking.Eyetrack" }
);
}
int num = 20;
// Images must be in the "data" directory to load correctly
float mx[] = new float[num]; float my[] = new float[num]; float easing = 0.05; int radius = 8; int edge = 0; int inner = edge + radius;

public void setup() {
size(600, 800);
noStroke();
smooth();
//ellipseMode(RADIUS);
//rectMode(CORNERS);
println( Capture.list());
video = new Capture(this, width, height, Capture.list()[4] );
//video.settings();
testImage = loadImage("mm.jpg");
size(testImage.width,testImage.height);
calibrator = new CoordinatesTranslator();
image(testImage,0,0);

smooth();

img = loadImage("korean-girls-kang-su-yeon.jpg");
imgJessica = loadImage("Jessica_alba.jpg");
imgMaggie = loadImage("maggie_q_1.jpg");
imgHyori = loadImage("lee_hyori.jpg");
imgNamie = loadImage("namie_amuro_1.jpg");

noCursor();

imageMode(CENTER);

}

public void draw() {
background(225);
drawTarget();
stroke(225,0,0);
noFill();
//draw crosshairs on screen, and add easing for smoother transitions float dx = drawX - crosshairLocationOnScreenX;
if (abs(mouseX - mx) > 0.1) {
mx = mx + (mouseX - mx) * easing;
}
if (abs(mouseY - my) > 0.1) {
my = my + (mouseY- my) * easing;
}

mx = constrain(mx, inner, width - inner);
my = constrain(my, inner, height - inner);
//fill(76);
//rect(edge, edge, width-edge, height-edge);
fill(0);
ellipse(mx, my, radius, radius);

int which = frameCount % num;
mx[which] = mouseX;
my[which] = mouseY;

for (int i = 0; i < num; i++) {
//which+1 is the smallest (the oldest in the array)
int index = (which+1 + i) % num;
ellipse(mx[index], my[index], i, i); }
if(abs(dx) > 1) {
crosshairLocationOnScreenX += dx * easing;
}

//targetY = drawY;
float dy = drawY - crosshairLocationOnScreenY;
if(abs(dy) > 1) {
crosshairLocationOnScreenY += dy * easing;
}

if (video.available() && (millis() > lastVideo + 10)) {
lastVideo = millis();
video.read();
long startTime = millis();
elapsedTime = millis() - startTime;
if (debug) {
background(0);
image(video, 0, 0);
}
else{
if (leaveTrails == false) image(testImage,0,0);
if (calibrating) { image(testImage,0,0); }
if (pupil != null) {
ellipse(pupil.x+pupil.width/2,pupil.y+pupil.height/2,40,40);
//drawX = int(map(pupil.x+pupil.width/2, 0, video.width, 0, width));
//drawY = int(map(pupil.y+pupil.height/2, 0, video.height, 0, height));*/
//drawX = adjustedPoint[0];
//drawY = adjustedPoint[1];*/
//println(adjustedPoint[0]+", "+adjustedPoint[1]);
}
}
pupil = findPupil();
glint = null;
if (pupil != null) glint = findGlint(pupil);
//if the glint and the pupil are present
if (glint != null && pupil != null) { // if we got both
// find out where the pupil is relative to the glint
int rawX = pupil.x+ pupil.width/2 - glint.x + glint.width/2;
int rawY =glint.y + glint.height/2- pupil.y + pupil.height/2 ;
//if the system is calibrating
if (calibrator.isCurrentlyCalibrating()) { // check if we are in calibration mode
Point placeToLook = calibrator.getScenePoint(); // get where they are supposed to look at
//draw the dots for the user to look at for calibration purposes
placeToDrawTarget = placeToLook;
if (placeToDrawTarget.x > 0 &&
calibrator.isCurrentlyCalibrating()) {
stroke(0);
fill(0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 28, 28);// draw it so they look
stroke(255);
fill(255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 22, 22);// draw it so they look
stroke(40,40,255);
fill(40,40,255);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 16, 16);// draw it so they look
stroke(255,0,0);
fill(255,0,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 10, 10);// draw it so they look
stroke(255,255,0);
fill(255,255,0);
ellipse(placeToDrawTarget.x - 4, placeToDrawTarget.y - 4, 7, 7);// draw it so they look
}
//CHANGE THIS TO ELMO

calibrator.doCalibrationRoutine(true,rawX, rawY);
println("calibrating");

}
//if the system is not calibrating,
else {
//use the calibrator to find out where the x,y from camera corolate to on image
int[] adjustedPoint = calibrator.translate(rawX, rawY);
println("Adjusted x" + adjustedPoint[0] + " adjusted y" + adjustedPoint[1]);

//if the mouse is not being used, draw the crosshairs at adjusted points
if(!usingMouse) {
drawX = adjustedPoint[0];
drawY = adjustedPoint[1];
}
}

}

}

}

public Rectangle findPupil() {
// /FIND THE PUPIL
ArrayList boxes = new ArrayList();
for (int row = edge; row < video.height - edge * 2; row++) {
for (int col = edge; col < video.width - edge * 2; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for dark things
if (brightness(thisPixel) < pupilThreshold) {
video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < boxes.size(); i++) {
Rectangle existingBox = (Rectangle) boxes.get(i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) boxes.add(new Rectangle(col, row, 0, 0));
}
}
}

consolidate(boxes, 0, 0);

// OF EVERYTHING YOU FIND TAKE THE ONE CLOSEST TO THE CENTER
Rectangle pupil = findClosestMostBigOne(boxes, video.width / 2, video.height / 2, minPupilArea);
if (debug) {
// show the the edges of the search
fill(0, 0, 0, 0);
stroke(0, 255, 0);
rect(edge, edge, video.width - 2 * edge, video.height - 2 * edge);
// show all the pupil candidates
stroke(0, 0, 0);
for (int i = 0; i < boxes.size(); i++) {
Rectangle thisBox = (Rectangle) boxes.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
}
// show the winning pupil candidate in red
if (pupil != null) {
stroke(255, 0, 0);
rect(pupil.x, pupil.y, pupil.width, pupil.height);
}
}
return pupil;
}

public Rectangle findGlint(Rectangle _pupil) {
// ADJUST THE BOUNDS OF YOUR SEARCH TO BE AROUND AND UNER THE PUPIL
int glintEdgeL = Math.max(0, _pupil.x - _pupil.width * 2);
int glintEdgeR = Math.min(video.width - 1, _pupil.x + _pupil.width + _pupil.width * 2);
int glintTop = _pupil.y;
int glintBottom = Math.min(video.height - 1, _pupil.y + _pupil.height + _pupil.height * 2);

ArrayList glintsCandidates = new ArrayList();
for (int row = glintTop; row < glintBottom; row++) {
for (int col = glintEdgeL; col < glintEdgeR; col++) {
int offset = row * video.width + col;
int thisPixel = video.pixels[offset];
//look for bright things
if (brightness(thisPixel) > glintThreshold) {
if (debug) video.pixels[offset] = 0;
// be pessimistic
boolean foundAHome = false;
// look throught the existing
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle existingBox = (Rectangle) glintsCandidates.get (i);
// is this spot in an existing box
Rectangle inflatedBox = new Rectangle(existingBox); // copy the existing box
inflatedBox.grow(reach, reach); // widen it's reach
if (inflatedBox.contains(col, row)) {
existingBox.add(col, row);
foundAHome = true; // no need to make a new one
break; // no need to look through the rest of the boxes
}
}
// if this does not belong to one of the existing boxes make a new one at this place
if (foundAHome == false) glintsCandidates.add(new Rectangle (col, row, 0, 0));
}
}
}
// FIND THE GLINT THAT IS CLOSEST TO THE PUPIL
Rectangle glint = findClosestMostBigOne(glintsCandidates,
_pupil.x + _pupil.width, _pupil.y + _pupil.height / 2, 0);
stroke(0, 0, 255);

if (debug) {// show all the candidate
// show the edges of the search for the glint
stroke(0, 75, 200);
rect(glintEdgeL, glintTop, glintEdgeR - glintEdgeL, glintBottom - glintTop);
for (int i = 0; i < glintsCandidates.size(); i++) {
Rectangle thisBox = (Rectangle) glintsCandidates.get(i);
rect(thisBox.x, thisBox.y, thisBox.width, thisBox.height);
} // show the winner in red
if (glint != null) {
stroke(255, 0, 0);
rect(glint.x, glint.y, glint.width, glint.height);
}
}

return glint;
}

public void consolidate(ArrayList _shapes, int _consolidateReachX, int _consolidateReachY) {
// check every combination of shapes for overlap
// make the repeat loop backwards so you delete off the bottom of the stack
for (int i = _shapes.size() - 1; i > -1; i--) {
// only check the ones up
Rectangle shape1 = (Rectangle) _shapes.get(i);
Rectangle inflatedShape1 = new Rectangle(shape1); // copy the existing box
inflatedShape1.grow(_consolidateReachX,
_consolidateReachY); // widen it's reach

for (int j = i - 1; j > -1; j--) {
Rectangle shape2 = (Rectangle) _shapes.get(j);
if (inflatedShape1.intersects(shape2)) {
shape1.add(shape2);
// System.out.println("Remove" + j);
_shapes.remove(j);
break;
}
}
}
}

public Rectangle findClosestMostBigOne(ArrayList _allRects, int _x, int _y, int _minArea) {
if (_allRects.size() == 0) return null;
int winner = 0;
float closest = 1000;

for (int i = 0; i < _allRects.size(); i++) {
Rectangle thisRect = (Rectangle) _allRects.get(i);
if (thisRect.width * thisRect.height < _minArea) continue;
float thisDist = dist(_x, _y, thisRect.x + thisRect.width / 2, thisRect.y + thisRect.height / 2);
if (thisDist < closest) {
closest = thisDist;
winner = i;
}
}
return (Rectangle) _allRects.get(winner);
}
void stop() {
}
}

Wii - remote composer - Javi Lee

2010-05-26T21:21:09Z

Jal012: /* Description */

Wii - remote composer - Javi Lee

2010-04-30T00:54:52Z

Jal012: /* Description */

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Depending on where it 'lands' on the screen it will play a note. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved. (note = the sound will be saved for the duration of the button being pressed. The longer the button is pressed, the longer the note is going to be played and saved.)

==Visualization==
*Functional Diagram
[[Image:vis145bpic.png|none|300px]]

Wii - remote composer - Javi Lee

2010-04-30T00:07:05Z

Jal012: /* Visualization */

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==
*Functional Diagram
[[Image:vis145bpic.png|none|300px]]

File:Vis145bpic.png

2010-04-30T00:06:31Z

Jal012:

Wii - remote composer - Javi Lee

2010-04-30T00:03:12Z

Jal012: /* Visualization */

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==
*Functional Diagram
[[Image:vis145bpic.ai|none|300px]]

Wii - remote composer - Javi Lee

2010-04-29T23:31:43Z

Jal012:

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==
*Functional Diagram

Wii - remote composer - Javi Lee

2010-04-29T23:31:29Z

Jal012:

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==
*Functional Diagram

Wii - remote composer - Javi Lee

2010-04-29T23:31:17Z

Jal012:

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==
* Functional Diagram

Wii - remote composer - Javi Lee

2010-04-29T23:29:57Z

Jal012:

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

==Visualization==

Wii - remote composer - Javi Lee

2010-04-29T23:29:04Z

Jal012:

== Description ==
*Motivation

I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I wanted to have a "musical" aspect in this project. My basic idea would be set up a screen that will be cut up into squares, (not visibly) and these squares will be holding certain notes. With the Wii remote, one could go over these squares and press a button on the remote to 'activate' the sound. The program will automatically save this input and have the possibility to play back the music after wards.

*Interactive paradigm

I wanted to take the physical space and turn it into "concert" hall. The user will be able to compose 'music' without having to go into a secluded room to use technologically advanced computers and programs to compose a small piece of music. This will be a real-time composition of music as if he/she were to be a composer for a band at a concert.

*Technical Description

I want to use Processing to be able to connect the the sensor and the accelerometer in the Wii remote. The processing program will split the screen into grids where each square of the grid will hold a pitch/sound. Then the user will be able to use the sensor of the Wii remote to track where the remote will be pointing at the screen. The accelerometer will help to move around the screen as well. Then by pressing a button, the user could play the sound and 'save' the sound so after the user presses so many buttons, he/she will be able to replay the sequence of sounds saved.

Wii - remote composer - Javi Lee

2010-04-29T23:17:38Z

Jal012: New page: == Description == *Motivation I was just curious to see if one could compose music with the Wii remote. I've been very influenced lately by many friend who create their own music and so I...

Classes/2010/VIS145B

2010-04-29T23:10:19Z

Jal012: /* Midterm Projects */

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*personal wiki page
*source code on wiki
*image/video documentation as appropriate.
*explanatory writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 - Midterm Critiques ===
*Due: Midterm Projects
*In Class:
**Critique of midterm projects.

=== Week 7 ===
Student presentations
=== Week 8 ===
Student presentations
=== Week 9 ===
Student presentations
=== Week 10 - Final Critiques ===
In-class Critiques.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | Untitled - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Motion Animation - Greg Parsons]]
* [[Image Processing - Ben Brickley & Emilio Marcelino]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Classes/2010/VIS145B

2010-04-02T01:04:20Z

Jal012: /* Student Pages */

Students/JavierLee

2010-04-02T01:03:45Z

Jal012: New page: I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, somet...

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.
I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

Classes/2010/VIS145B

2010-04-02T00:58:08Z

Jal012: /* Student Pages */

Students/Javier Lee

2010-03-20T04:28:23Z

Jal012: /* Visual */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document several different people to see the trends, including how they communicate with each other. (shake, high five, fist bump, etc...)

import processing.serial.*;
Serial port;
int value;
PFont font;
int buttonValue = 0;
int prevButtonValue = 0;

void setup(){
size(500,700);
//String portName = Serial.list()[0];
println(Serial.list());
port = new Serial(this, Serial.list()[0], 9600);
font = loadFont("BerlinSansFBDemi-Bold-250.vlw");
textAlign(CENTER);
textFont(font);
}

void draw(){
background(153);
fill(0, 102, 153);
rect(30,height,240,-value);
text(value,width/2,height-value-20 );
drawGraph();
prevButtonValue = buttonValue;
}

void drawGraph(){
if (port.available() > 0) {
value = port.read();
print(value);
}
if (value != 0){
buttonValue++;
value = buttonValue;

}
}

===Visual===
Circuit
[[Image:Photo 173.jpg|none|300px]]
Button without Glove
[[Image:Photo 174.jpg|none|300px]]
Visual
[[Image:Photo 172.jpg|none|300px]]

Students/Javier Lee

2010-03-20T04:27:26Z

Jal012: /* Visual */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document several different people to see the trends, including how they communicate with each other. (shake, high five, fist bump, etc...)

import processing.serial.*;
Serial port;
int value;
PFont font;
int buttonValue = 0;
int prevButtonValue = 0;

void setup(){
size(500,700);
//String portName = Serial.list()[0];
println(Serial.list());
port = new Serial(this, Serial.list()[0], 9600);
font = loadFont("BerlinSansFBDemi-Bold-250.vlw");
textAlign(CENTER);
textFont(font);
}

void draw(){
background(153);
fill(0, 102, 153);
rect(30,height,240,-value);
text(value,width/2,height-value-20 );
drawGraph();
prevButtonValue = buttonValue;
}

void drawGraph(){
if (port.available() > 0) {
value = port.read();
print(value);
}
if (value != 0){
buttonValue++;
value = buttonValue;

}
}

===Visual===
[[Image:Photo 173.jpg|none|300px]] Circuit

[[Image:Photo 174.jpg|none|300px]] Button without Glove

[[Image:Photo 172.jpg|none|300px]]

Students/Javier Lee

2010-03-20T04:26:36Z

Jal012: /* Visual */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document several different people to see the trends, including how they communicate with each other. (shake, high five, fist bump, etc...)

import processing.serial.*;
Serial port;
int value;
PFont font;
int buttonValue = 0;
int prevButtonValue = 0;

void setup(){
size(500,700);
//String portName = Serial.list()[0];
println(Serial.list());
port = new Serial(this, Serial.list()[0], 9600);
font = loadFont("BerlinSansFBDemi-Bold-250.vlw");
textAlign(CENTER);
textFont(font);
}

void draw(){
background(153);
fill(0, 102, 153);
rect(30,height,240,-value);
text(value,width/2,height-value-20 );
drawGraph();
prevButtonValue = buttonValue;
}

void drawGraph(){
if (port.available() > 0) {
value = port.read();
print(value);
}
if (value != 0){
buttonValue++;
value = buttonValue;

}
}

===Visual===
[[Image:Photo 173.jpg|none|Circuit|300px]]

[[Image:Photo 174.jpg|none|ButtonGlove|300px]]

[[Image:Photo 172.jpg|none|300px]]

File:Photo 172.jpg

2010-03-20T04:25:11Z

Jal012:

File:Photo 174.jpg

2010-03-20T04:24:43Z

Jal012:

File:Photo 173.jpg

2010-03-20T04:24:17Z

Jal012:

Students/Javier Lee

2010-03-20T04:23:54Z

Jal012: /* Visual */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document several different people to see the trends, including how they communicate with each other. (shake, high five, fist bump, etc...)

import processing.serial.*;
Serial port;
int value;
PFont font;
int buttonValue = 0;
int prevButtonValue = 0;

void setup(){
size(500,700);
//String portName = Serial.list()[0];
println(Serial.list());
port = new Serial(this, Serial.list()[0], 9600);
font = loadFont("BerlinSansFBDemi-Bold-250.vlw");
textAlign(CENTER);
textFont(font);
}

void draw(){
background(153);
fill(0, 102, 153);
rect(30,height,240,-value);
text(value,width/2,height-value-20 );
drawGraph();
prevButtonValue = buttonValue;
}

void drawGraph(){
if (port.available() > 0) {
value = port.read();
print(value);
}
if (value != 0){
buttonValue++;
value = buttonValue;

}
}

===Visual===
[[Image:Photo 173.jpg|none|300px]]

[[Image:Photo 174.jpg|none|300px]]

[[Image:Photo 172.jpg|none|300px]]

Students/Javier Lee

2010-03-20T04:04:00Z

Jal012: /* Code */

Students/Javier Lee

2010-03-19T18:26:26Z

Jal012: /* Final Project */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document several different people to see the trends, including how they communicate with each other. (shake, high five, fist bump, etc...)

===Code===
import processing.serial.*;
Serial port;
int value;
PFont font;
int buttonValue = 0;
int prevButtonValue = 0;

void setup(){
size(300,500);
//String portName = Serial.list()[0];
println(Serial.list());
port = new Serial(this, Serial.list()[0], 9600);
font = loadFont("BerlinSansFBDemi-Bold-250.vlw");
textAlign(CENTER);
textFont(font);
}

void draw(){
background(153);
fill(0, 102, 153);
rect(30,height,240,-value);
text(value,width/2,height-value-20 );
drawGraph();
prevButtonValue = buttonValue;
}

void drawGraph(){
if (port.available() > 0) {
value = port.read();
}
if (value == 1){
value = buttonValue;
buttonValue++;
}
}

===Visual===

Students/Javier Lee

2010-03-18T17:41:44Z

Jal012: /* Final Project */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program into processing the codes that will display how many times I have been in contact with people throughout the day. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user. I want to document myself, who is normally a social being, with the completed project and compare that to friends, who are introverted and not really social; to prove a point.

Students/Javier Lee

2010-03-12T01:44:05Z

Jal012: /* Final Proposal */

==Javier Lee==

I'm interested in the creative process of art and making artwork. I like the hands-on aspect of art where everything you make is being made by your own hands. It's your own creation, something to be proud of. I understand that there are times when electronics and technology can enhance the experience of the artwork and there are a lot of times when they are needed, but I'm more old-fashioned. I prefer to paint or sculpt.

I'm a Vis Arts media major with an emphasis on computers because in this technologically advance world of ours, I believe that a new generation of artists are on the rise and I am interested in trying to be apart of that.

===HW #1===

[[Image:0111001639.jpg|none|thumb|200px|left|Best Invention for lonely days.]]
[[Image:0111001637.jpg|none|thumb|200px|left|Lady killer.]]
[[Image:0111001633.jpg|none|thumb|200px|left|Lights up the keyhole.]]
[[Image:Coranado.jpg|none|thumb|200px|left|Nightlife at Coronado.]]
[[Image:0111001635.jpg|none|thumb|200px|left|Not entirely sure.]]

==Midterm Proposal==

I have decided to make a stuffed animal (bear) dance by using a "frankenstein" switch. I took the original bear, that had a push button to turn it on and off, and decided to connect it to the frankenstein switch in order to try and use a different method to make the bear dance. The bear will be taunting those who view this project with a phrase "I Dare You to Make Me Dance!" This will be attached to the bear. The switch will also have a sign that will read "Hint: Pull me Down." My original plan is the nail the switch to the wall behind the bear.

===Circuit Diagram===
[[Image:curcuitpic.jpg|none|300px]]

===Visualization===
[[Image:mybear.jpg|none|300px]]

==Final Project==

Our society has begun to come to an age where we are less interactive with each other physically. For example, instead of trying to see each other, we text or call making the interaction less intimate. My project idea is an interactive piece where the user has to actually face the project and interact with it making it, in a sense, a personal and intimate relationship. I want to create a project where I sew a push button into a glove and use the arduino to program a mini LED display to display numbers. Everyone time someone shakes hands with the user, the button is pushed which will start to count how many have come into contact with the user.

===Circuit Diagram===
?

===Visualization===
?

Students/Javier Lee

2010-03-04T09:21:23Z

Jal012: /* Midterm Proposal */

File:Mybear.jpg

2010-02-04T22:26:26Z

Jal012:

Students/Javier Lee

2010-02-04T22:25:47Z

Jal012: /* Midterm Proposal */