K2lu: /* Visual Concept */

==Title==
You Music Video (uMV)
==Description==
* Motivation

I've had interest in rotoscoping and animation in videos and dance for a while - and I'm interesting in mixing them, live.

* Interactive paradigm

As the person dances/moves, animation or other features will react to their movement, enhancing it on video, and basically creating a music video on the spot.

* Technical Description

The person would be caught and tracked on camera, and we could use frame differencing to track the magnitude of his or her movements and the pre-coded/drawn animations would react accordingly.
Background images can be added and changed over time to improve the effect.

==Visual Concept==

* Reference:
http://www.motiontheory.com/work/nike_presto-04

View video 'Urban Canvas'.

http://www.motiontheory.com/work/nike_flow

View video 'Flow'.

==Documentation==

* Source Code:
-coding consists of initialization of camera, bitmap manipulating to create motion-detecting/color/background editing effects, and some animating code.
-camera code and motion detecting code is adapted from [[http://drawlogic.com/2007/10/17/motion-detection-in-flash-as2-and-as3-and-c/]], with some changes for color and background editing effects.

CAMERA:
-sets up webcam and shows security panel

import flash.media.Camera;
import flash.system.Security;
import flash.system.SecurityPanel;
import flash.events.*;

var cam:Camera = Camera.getCamera();
if(cam != null){
cam.setMode(video1.width, video1.height, 12, true);
video1.attachCamera(cam);
cam.addEventListener(ActivityEvent.ACTIVITY, activityHandler);
}else{
Security.showSettings(SecurityPanel.CAMERA)
}
var inited:Boolean=false;
function activityHandler(event:ActivityEvent):void {
if(cam.muted){
Security.showSettings(SecurityPanel.CAMERA)
}else if(!inited){
initialize();
inited=true;
}

//trace("activityHandler: " + event);
}

BITMAP:
import flash.display.Bitmap;
import flash.display.BitmapData;
import flash.geom.Matrix;
import flash.utils.Timer;
import flash.events.TimerEvent;

var now:BitmapData;
var out:BitmapData;
var before:BitmapData;
var bitmap:Bitmap;
var timer:Timer;
var m:Matrix;
var max:int = 7;
function initialize(){
//create an array that will be the fading image cue
list=new Array()
//create an identity matrix
m=new Matrix()
//scale the transformation matrix to match the scale of the Video object on stage
m.scale((video1.scaleX),(video1.scaleY))
//create a bitmap object in memory that is the same size as the Video object on stage
now=new BitmapData(video1.width, video1.height, true, 0x00000000);
//create a bitmap object in memory to hold a layered bitmap from the fading image cue
out=new BitmapData(video1.width, video1.height, true, 0x00000000);
//out.draw(video1,m);
before = out.clone();
bitmap=new Bitmap();
//create a bitmap to display the bitmapdata
this.addChild(bitmap);
//position it to the right of the live Webcam feed
//bitmap.x=video1.x+video1.width;
bitmap.x=video1.x;
bitmap.y=video1.y;
//call the snap function every 1/10th of a second
timer = new Timer(100);
timer.addEventListener(TimerEvent.TIMER, snap);
timer.start();
}
//capture a freezeframe from the webcam and copy it, called regularly do detect movement
function snap(event:TimerEvent){

bitmap.bitmapData=out;
//draw the video into the bitmapdata object object with the scaled transformation matrix
now.draw(video1,m)
//copy the current freezeframe
done=now.clone()
//now draw the previous freezeframe ("BEFORE"!) on top of the current frameframe and apply the 'difference' blendmode
done.draw(before,m,null,"difference")

//filter out all pixels in the differenced bitmap that are greater than just over black (0xFF111111) and make them green (0xFF00FF00)
//over-write the previous contents of the bitmap
done.threshold(done,done.rect,done.rect.topLeft,">",0xFF707070,0xFF00FF00,0xFFFFFFFF,true) //important line, used to set threshold of colors and change background to black while movement/people to green

//add the finished bitmap to a fading image cue
list.push(done.clone())
//if the cue is now greater than the maximum length we specified
if(list.length > max)
{
//then remove the bitmap at the very front of the cue
//and free the memory it was using
list.shift().dispose()
}
//how many items in the fading cue
var l=list.length
//how much should the green channel deteriate on each degradation
var each=255/l
//declare local var to speed up the loop
var g
//var changed:uint
//clear the out bitmap object so we can start a fresh
out.fillRect(out.rect,0xFF000000)
//copy the current bitmap and save it for the next time this function is called
before=now.clone()
//loop through each bitmap in the fading image cue
for(var i=0;i<l;++i)
{
//determine the current degradation
g=each*i

out.threshold(list[i], out.rect, out.rect.topLeft, "<=", 0xFF707070, 0x00000000, 0xFF000000, true);
//this line was added to make unimportant pixels transparent - used for background changing

//copy all the pixels that are green in the current item in the fading image cue and make them into the degradated green color
//add those pixels on top of the bitmap that will displayed to the user
out.threshold(list[i],out.rect,out.rect.topLeft,"==",0xFF00FF00,(255<<24 | 0<<16 | g<<8 | 0),0x00FFFFFF,false)

}

UMV

2010-05-21T21:11:01Z

K2lu: /* Visual Concept */

UMV

2010-05-21T21:10:49Z

K2lu: /* Visual Concept */

UMV

2010-05-21T01:13:21Z

K2lu: New page: ==Title== You Music Video (uMV) ==Description== * Motivation I've had interest in rotoscoping and animation in videos and dance for a while - and I'm interesting in mixing them, live. * ...

Classes/2010/VIS145B

2010-05-21T01:07:47Z

K2lu: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Untitled (for now) - Joeny Thipsidakhom]]
* [[uMV | uMV - Tony Lu]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

Classes/2010/VIS145B

2010-05-21T01:07:25Z

K2lu: /* Final Projects */

==Related Links:==

[http://www.bodybuildingrevealed.com/'''body building''']

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*section on your project
*source code
*image/video documentation. 5 images or 5 videos.
*descriptive writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*In class:
**Workshop midterm project ideas. (45 minutes)
**Work on midterm projects.
*NOTE: Best of ICAM from Candy Harris. There will be an install in the annex here at Mandeville and presentations at the Experimental Theater in the CPMC (music building). They should come see what they are going to have to live up to for their final projects. Plus the keynote speakers (ICAM alumns) always have great info about career paths after graduation.

=== Week 6 ===
In class work on midterms.

=== Week 7 - Midterm Critiques ===
In class critique of midterms.

=== Week 8 ===

Due: Written response (1 page) to one of your classmate's projects.

In Class: Draft final project proposal and post to wiki by the end of class. In class discussion as needed.

=== Week 9 ===
work on finals

=== Week 10 - Final Critiques ===
In-class critiques of finals.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://niccageaseveryone.blogspot.com/
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project - Tony Lu | Virtual Maze - Tony Lu]]
* [[Midterm Project | SayCHEESE - Joel and Jenny Chang]]
* [[Carnival Ride| Carnival Ride - Christina Sanchez and Jennifer Sunga]]
* [[Hunted - Anna Lin, Jenny Wang, and Ellen Huang]]
* [[Wii - remote composer - Javi Lee]]
* [[Social Creature | Boo (formerly Social Creature) - Jet Antonio]]
* [[Sound Sketch - Emilio Marcelino, Greg Parsons, and Ben Brickley]]

== Final Projects ==
* [[Aquarium| Aquarium - Jezreel Callejas]]
* [[Not So Lost| Not So Lost - Ben Brickely, Emilio Marcelino and Greg Parsons]]
* [[Dance in the Dark - Anna Lin, Jenny Wang and Ellen Huang]]
* [[Inkling One | Inkling One - Jet Antonio]]
* [[Untitled (for now) - Joeny Thipsidakhom]]
* [[YOU MV | YOU MV - Tony Lu]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]

IDance

2010-05-21T01:06:23Z

K2lu: New page: ==Title== ==Description==

==Title==

==Description==

Classes/2010/VIS145B

2010-05-21T01:05:47Z

Midterm Project - Tony Lu

2010-05-19T20:10:18Z

K2lu: /* Documentation */

==Title==
VIRTUAL MAZE
==Description==
* Motivation
I'd like my projects to have amusement values and possibly practical applications, much like a game. Along side that, it should also involve an emphasis on physical activity, while definitely showing feedback on the virtual world. I'm pretty fascinated with the blurring of physical and virtual realms. Hopefully it'll be pretty technically advanced too.
* Interactive Paradigm
I'm thinking of tracking a person in physical space, and then have that person walk through a maze in virtual space. He would be able to move in real life unobstructed, of course, but if his virtual representation hits a wall it would be "stuck." I'm also considering putting in aspects of Pac man or Mario, or incorporating some kind of importance on movements such as dancing or jumping... depending on if my technical ability would allow it.
* Technical Description
If possible I'd like Processing to track the person through webcam, possibly using brightness thresholding with a plain background and singling out the blob of black that is the person. If that doesn't work I could attach LED's to the person and use brightness tracking instead. The maze should be able to be drawn in Processing, and finally I'd have to find the way to code the limiting of the virtual entity's movements.

==Visualization==
* Functional Diagrams and Visual Concept
[[Image:Vis145b midterm.jpg|800px|thumb|left]]

==Documentation==
* Source Code
The coding contains two files, the main coding and the Cell object

Main file:

-adapts OpenCV's face tracking code and creates the maze (composed of Cell objects)
{
import hypermedia.video.*;

import ddf.minim.*;

OpenCV opencv;

// contrast/brightness values

int contrast_value = 0;
int brightness_value = 0;
int cellsize = 100;
int cellnum = 42;
boolean start = true;
int currentcell = 0;
int in_cell = 0;
boolean move = false;
Cell[] cells = new Cell[cellnum];
PImage pacman;
PImage pacmanAlpha;
AudioPlayer player;
Minim minim;
int playercounter = 0;

void setup() {

size( 700, 600 );
minim = new Minim(this);
player = minim.loadFile("StartGame.mp3");
player.loop();

pacman = loadImage("pacman.png");
pacmanAlpha = loadImage("pacmanalpha3.png");

opencv = new OpenCV( this );
opencv.capture( width, height ); // open video stream
opencv.cascade( OpenCV.CASCADE_FRONTALFACE_ALT ); // load detection description, here-> front face detection : "haarcascade_frontalface_alt.xml"

int k = -cellsize;

//int[] temp = { -1, -2, -3, -4, -5 };
for(int i = 0; i < cellnum; i++) {
if(i%(width/cellsize) == 0) { k+= cellsize; }
cells[i] = new Cell(i, (i%(width/cellsize))*cellsize, k, cellsize);

}

setupAllNeighbors();

// print usage
println( "Drag mouse on X-axis inside this sketch window to change contrast" );
println( "Drag mouse on Y-axis inside this sketch window to change brightness" );

}

public void stop() {
opencv.stop();
super.stop();
}

void draw() {

// grab a new frame
// and convert to gray
opencv.read();
opencv.flip( OpenCV.FLIP_HORIZONTAL );
//opencv.convert( GRAY );
opencv.contrast( contrast_value );
opencv.brightness( brightness_value );

// proceed detection
Rectangle[] faces = opencv.detect( 1.2, 2, OpenCV.HAAR_DO_CANNY_PRUNING, 40, 40 );

// display the image
image( opencv.image(), 0, 0 );
noStroke();
fill(255);
// rect(0, 0, width, height);
boolean r;

drawMaze();

if(start == false) { cells[currentcell].cellOn(true); }

for(int l = 0; l<cellnum; l++) {
r = false;
if(cells[l].stepped == true) { r = true; }
cells[l].circleOn(r);
}

// draw face area(s)

for( int i=0; i<faces.length; i++ ) {

noFill();
stroke(255,0,0);
strokeWeight(5);
//rect( faces[i].x, faces[i].y, faces[i].width, faces[i].height );
noStroke();
fill(0, 0, 200, 80);
in_cell = findClosestCell(faces[i].x + (faces[i].width)/2, faces[i].y);
//ellipse(faces[i].x + (faces[i].width)/2, faces[i].y + (faces[i].height)/2, 100, 100);
//ellipse(faces[i].x + (faces[i].width)/2, faces[i].y, 100, 100);
//ellipse(cells[in_cell].x, cells[in_cell].y, 100, 100);

if(start == true) { cells[in_cell].cellOn(); currentcell = in_cell; start = false; }

for(int j = 0; j < 4; j++) {

if(cells[currentcell].neighbors[j] == in_cell) { move = true; }

}
if(move == true) {

cells[in_cell].cellOn();

currentcell = in_cell;
}

move = false;
}

}

/**
* Changes contrast/brigthness values
*/
void mouseDragged() {
contrast_value = (int) map( mouseX, 0, width, -128, 128 );
brightness_value = (int) map( mouseY, 0, width, -128, 128 );
}

int findClosestCell(int face_x, int face_y) {
int cellx; int celly;
int xhundred = (face_x / 100) * 100;
int xten = face_x % 100;
int yhundred = (face_y / 100) * 100;
int yten = face_y % 100;

if(xten > 85) { if(xhundred < 600) { cellx = xhundred + 100; } else { cellx = xhundred; } }
else if(xten < 15) { if(xhundred > 100) { cellx = xhundred - 100; } else { cellx = xhundred; } }
else { cellx = xhundred; }
if(yten > 85) { if(yhundred < 500) { celly = yhundred + 100; } else { celly = yhundred; } }
else if(yten < 15) { if(yhundred > 100) { celly = yhundred - 100; } else { celly = yhundred; } }
else { celly = yhundred; }

return (cellx/100) + (celly/100)*(width/cellsize);
}

void setupNeighbors(int cell, int[] arrayOfNeighbors) {
//cell neighbor set up
//cells[0].neighbors[0] = 7;
cells[cell].neighbors = arrayOfNeighbors;

}

void setupAllNeighbors() {

int[] cell0 = { 7, 1, 0, -1 };
int[] cell1 = { 0, 1, 8, -1 };
int[] cell2 = { 2, 3, -1, -2 };
int[] cell3 = { 2, 3, 10, -1 };
int[] cell4 = { 4, 11, 5, -1 };
int[] cell5 = { 5, 4, 6, -2 };
int[] cell6 = { 5, 6, 13, -2 };
int[] cell7 = { 7, 0, 14, -1 };
int[] cell8 = { 8, 1, 15, -2 };
int[] cell9 = { 9, 16, 10, -2 };
int[] cell10 = { 3, 10, 17, 9 };
int[] cell11 = { 4, 11, 12, -2 };
int[] cell12 = { 12, 11, 19, -2 };
int[] cell13 = { 13, 20, 6, -2 };
int[] cell14 = { 14, 7, 21, -2 };
int[] cell15 = { 15, 16, 8, -2 };
int[] cell16 = { 16, 15, 9, -2 };
int[] cell17 = { 17, 10, 24, -2 };
int[] cell18 = { 18, 19, 25, -2 };
int[] cell19 = { 19, 12, 18, -1 };
int[] cell20 = { 20, 13, -2, -1 };
int[] cell21 = { 21, 22, 14, -2 };
int[] cell22 = { 22, 23, 21, -2 };
int[] cell23 = { 23, 22, 24, 30 };
int[] cell24 = { 24, 31, 17, 23 };
int[] cell25 = { 25, 32, 18, 26 };
int[] cell26 = { 26, 27, 25, -2 };
int[] cell27 = { 27, 26, 34, -2 };
int[] cell28 = { 28, 29, 35, -1 };
int[] cell29 = { 29, 30, 28, -2 };
int[] cell30 = { 30, 23, 29, -1 };
int[] cell31 = { 31, 32, 24, -2 };
int[] cell32 = { 31, 32, 33, 25 };
int[] cell33 = { 33, 32, 40, -1 };
int[] cell34 = { 34, 41, 27, -2 };
int[] cell35 = { 35, 36, 28, -2 };
int[] cell36 = { 36, 35, 37, -2 };
int[] cell37 = { 37, 36, -1, -2 };
int[] cell38 = { 38, 39, -2, -1 };
int[] cell39 = { 39, 40, 38, -2 };
int[] cell40 = { 40, 39, 33, -2 };
int[] cell41 = { 41, 34, -2, -1 };

setupNeighbors(0, cell0);
setupNeighbors(1, cell1);
setupNeighbors(2, cell2);
setupNeighbors(3, cell3);
setupNeighbors(4, cell4);
setupNeighbors(5, cell5);
setupNeighbors(6, cell6);
setupNeighbors(7, cell7);
setupNeighbors(8, cell8);
setupNeighbors(9, cell9);
setupNeighbors(10, cell10);
setupNeighbors(11, cell11);
setupNeighbors(12, cell12);
setupNeighbors(13, cell13);
setupNeighbors(14, cell14);
setupNeighbors(15, cell15);
setupNeighbors(16, cell16);
setupNeighbors(17, cell17);
setupNeighbors(18, cell18);
setupNeighbors(19, cell19);
setupNeighbors(20, cell20);
setupNeighbors(21, cell21);
setupNeighbors(22, cell22);
setupNeighbors(23, cell23);
setupNeighbors(24, cell24);
setupNeighbors(25, cell25);
setupNeighbors(26, cell26);
setupNeighbors(27, cell27);
setupNeighbors(28, cell28);
setupNeighbors(29, cell29);
setupNeighbors(30, cell30);
setupNeighbors(31, cell31);
setupNeighbors(32, cell32);
setupNeighbors(33, cell33);
setupNeighbors(34, cell34);
setupNeighbors(35, cell35);
setupNeighbors(36, cell36);
setupNeighbors(37, cell37);
setupNeighbors(38, cell38);
setupNeighbors(39, cell39);
setupNeighbors(40, cell40);
setupNeighbors(41, cell41);
}

void drawMaze() {
stroke(0, 0, 255);
strokeWeight(4);
line(0, 0, 0, height);
line(0, 0, width, 0);
line(width, 0, width, height);
line(0, height, width, height);
line(100, 100, 100, 300);
line(100, 300, 300, 300);
line(300, 300, 300, 200);
line(200, 0, 200, 200);
line(200, 100, 300, 100);
line(0, 400, 200, 400);
line(400, 0, 400, 400);
line(100, 500, 500, 500);
line(300, 400, 300, height);
line(500, 400, 600, 400);
line(400, 200, 500, 200);
line(500, 300, width, 300);
line(500, 100, 600, 100);
line(600, 100, 600,300);
line(600, 400, 600, height);
}
}

Midterm Project

2010-04-29T07:30:52Z

K2lu: New page: ==Virtual Maze== ==Description== * Motivation I'd like my projects to have amusement values and possibly practical applications, much like a game. Along side that, it should also involve a...

==Virtual Maze==
==Description==
* Motivation
I'd like my projects to have amusement values and possibly practical applications, much like a game. Along side that, it should also involve an emphasis on physical activity, while definitely showing feedback on the virtual world. I'm pretty fascinated with the blurring of physical and virtual realms. Hopefully it'll be pretty technically advanced too.
* Interactive Paradigm
I'm thinking of tracking a person in physical space, and then have that person walk through a maze in virtual space. He would be able to move in real life unobstructed, of course, but if his virtual representation hits a wall it would be "stuck." I'm also considering putting in aspects of Pac man or Mario, or incorporating some kind of importance on movements such as dancing... depending on if my technical ability would allow it.
* Technical Description
If possible I'd like Processing to track the person through webcam, possibly using brightness thresholding with a plain background and singling out the blob of black that is the person. If that doesn't work I could attach LED's to the person and use brightness tracking instead. The maze should be able to be drawn in Processing, and finally I'd have to find the way to limit the virtual entity's movements.
==Visualization==
* Functional Diagrams
* Visual Concept

Classes/2010/VIS145B

2010-04-29T07:11:21Z

K2lu: /* Midterm Projects */

== Time and Process Based Digital Media II ==
Time: Thursdays 3:30-6:20pm, VAF 228

This class is an advanced study and portfolio project course centered on the use of hardware and software to create interactive and time-based art. These projects can take many forms—interactive installations, dynamic visualizations/sonifications, printed renderings—chosen by the students. This will not be a course of technical instruction—rather we will consider technical and conceptual issues in tandem, supplementing discussions and activities with specific technical instruction where necessary. There is a strong emphasis on the development and articulation of personal directions of research by the students in the course.

I would like to split the reading/homework responsibility for two parts of the class. In the first half of the term I will present a series of works and readings covering my particular interests--the intersections of social performance, embodied experience, and cognition. In the latter half of the class (after the midterm) you all will do the presentations on topics of your choosing. Working individually or in small groups, you will provide us with some conceptual provocation (reading material) covering topics you intend to engage with your final, and you will lead a discussion on technical and conceptual issues. Reading and critical writing, in response to text and works you present and those I present, are integral to this course.

The schedule is a living document and will be revised over the period of the course.

== Instructor ==
Robert Twomey

rtwomey@ucsd.edu
*http://roberttwomey.com
*http://experimentalgamelab.net
*http://crca.ucsd.edu

Office Hours: Wednesday 3-4pm, Atkinson Hall Rm 1601 (CRCA research neighborhood). Please e-mail me if you plan to attend.

== Grading ==
*Midterm Project - 30%
*Final Project - 40%
*Presentations - 10%
*Readings - 10%
*Participation - 10%

=== Presentations ===
(1) Short presentation on your work in the second week of class. This should be a statement of your interests, direction, goals with media art. Present examples from your own work which you feel strongly about, and which best represent your interests and trajectory. Present examples of other artist's work that serve as models for the kind of work you would like to make. (5-10 minutes each)

(2) Medium presentation on final projects in the second semester of the course (weeks 7-9). This is the portion of the class where you dictate the reading and the discussion. If you are presenting on a given week, you need to provide us with a reading 1 week in advance. We will sign up for those time slots in week 6, just after the midterm. (10-15 minutes)

=== Reading Responses ===
These are written summaries and critical responses to materials assigned for out of class viewing. Things to consider: What points does the author make? Do you buy their assumptions or agree with their conclusions? Reading responses will be printed and turned in to the instructor at the beginning of class. Generally these should be 1 page long.

=== Projects ===
Midterm and final projects will be graded on concept, effort, and realization. Formal proposals are a necessary component of the process so take them seriously. Make the effort to get started early and seek the help you need--we want to see finished, well-considered pieces for the midterm and final. Additionally, you will need to submit documentation of the project after completion which includes images, video, and source code where applicable. These materials (proposals and documentation) will all be posted to the wiki.
=== Documentation Policy ===
*personal wiki page
*source code on wiki
*image/video documentation as appropriate.
*explanatory writing (on intent, motivation, context)

=== Attendance ===
Attendance is mandatory. Each unexcused absence will drop your final grade one letter. There are only 10 weeks of class, please come to them all.

== Schedule ==
=== Week 1 - Intro ===
*Introductions
*Scope of course, interests, technical possibilities.
*My work.
*Watch: We Live In Public. 2009. (excerpts)
*In class: personal page on wiki. [http://www.trsp.net/teaching/gamemod/ game-mod exercise]. [http://www.trsp.net/teaching/gamemod/gamemod_breakout_source_en.zip download link]
*Read: [http://www.nyu.edu/projects/xdesign/mainmenu/archive_tangible.html Against Virtualized Information], [http://www.nyu.edu/projects/xdesign/mainmenu/archive_analtictech.html Novel Analytic Techniques], and [http://www.nyu.edu/projects/xdesign/mainmenu/archive_infocounts.html What Information Counts?] by [http://www.environmentalhealthclinic.net/people/natalie-jeremijenko/ Natalie Jeremijenko].
*Read: [http://www.yalealumnimagazine.com/issues/2004_03/jeremijenko.html An Engineer for the Avante Garde]
*Read: [http://www.worldchanging.com/archives/001450.html Natalie Jeremijenko The WorldChanging Interview]
*Read: [http://tech90s.walkerart.org/nj/transcript/nj_01.html Database Politics and Social Simulations], good background on her earlier artwork.

=== Week 2 - Student Research Interests ===
*Due: 1 page on Jeremijenko.
*Presentations on your work.
*Read: [http://www.flong.com/texts/essays/essay_cvad/ Computer Vision for Artists and Designers: Pedagogic Tools and Techniques for Novice Programmers] Golan Levin. ''pay particular attention to part II. ELEMENTARY COMPUTER VISION TECHNIQUES. we are going to try these in class next week.''

=== Week 3 - Computer Vision / Human Perception ===
*Due: Nothing. Read the Golan Levin piece, but no written response.
*Discuss:
**Myron Kreuger. Video Place. 1989 [http://www.youtube.com/watch?v=dqZyZrN3Pl0]
**Text Rain. Camille Utterback & Romy Achituv. 1999. [http://www.youtube.com/watch?v=toWFvXHghDk] [http://www.camilleutterback.com/]
**Very Nervous System. 1982-1991. [http://vimeo.com/8120954]
**Suicide Box. Bureau of Inverse Technology. 1996. (13:00)
**Marie Sester. ACCESS. 2003. [http://accessproject.net]
**Messa di Voce. Golan Levin and Zach Lieberman with Jaap Blonk and Joan La Barbara. 2003. [http://www.flong.com/projects/messa/] [http://www.tmema.org/messa/messa.html]
**Seen. David Rokeby. 2002. [http://vimeo.com/6012986]
**Sorting Daemon. David Rokeby. 2003. [http://homepage.mac.com/davidrokeby/sorting.html]
**Cheese. Christian Moller. 2003. [http://www.christian-moeller.com/display.php?project_id=36] made in collaboration with UCSD [http://mplab.ucsd.edu/wordpress/ Machine Perception Lab]
**Eyewriter. 2009 [http://www.eyewriter.org/]
**Saccade. 2010 [http://roberttwomey.com/saccade] (in progress)
*Discuss:
**thresholding
**frame difference
**OpenCV - [http://ubaa.net/shared/processing/opencv/ download] [http://www.cs.unc.edu/Research/stc/FAQs/OpenCV/OpenCVReferenceManual.pdf reference manual]. If you are getting this for your computer, be sure to get OpenCV, the OpenCV Processing Library, and the OpenCV Processing Examples (three separate downloads).
**face recognition
*In Class:
**Working alone or in small groups, do experiments with video processing and computer vision.

=== Week 4 - Computer Vision Work ===
* In Class:
** Work on computer vision projects
** Talk about midterm projects.

=== Week 5 - Midterm Workshop ===
*Due: Midterm project proposal.
**Working individually or in small groups (2-3 people), produce an interactive piece that bridges the gap between screen space and physical space. There are many ways to do this--using image-based computer vision techniques, game controllers, audio input, or other physical hardware (Arduino?). Think about the parameters of interaction--are you documenting viewer's behavior (unknown to them), are you taking a familiar form (such as a video game) and tweaking it in some way, are you intervening in social space? Think about what form the output will take. In your one page proposal, describe the input(s), output(s), and dynamic of interaction, as well as some statement of your motivation. Why is this a valuable or interesting project? In addition to the written description, produce supporting visual materials. These should be two functional diagram images and two visual/aesthetic images. The functional diagrams should show the necessary software and hardware components and explain how the interaction will occur. The aesthetic diagrams will give us a sense of what it will look like, how the output will appear. Make a page for your project (including a title) in the Midterm Projects section at the bottom of this page, upload the necessary materials and embed them in that page. This proposal is due in class next week where we will critique and workshop the ideas.
*Review computer vision experiments from last class.
*Work on midterm projects.

=== Week 6 - Midterm Critiques ===
In-class critiques of midterm projects.

=== Week 7 ===
Student presentations
=== Week 8 ===
Student presentations
=== Week 9 ===
Student presentations
=== Week 10 - Final Critiques ===
In-class Critiques.

=== Finals Week ===
Final documentation due.

== Topics ==
To Be Scheduled

'''Performance for the camera, for the web'''
*Discuss Chatroulette. Facebook, Twitter, Youtube. Attention in the social net.
*ManyCam [http://www.manycam.com/]
*PS3 eye
*jennicam [http://www.wired.com/thisdayintech/2010/04/0414jennicam-launches wired]
*Lonelygirl15 [http://www.youtube.com/watch?v=-goXKtd6cPo youtube] [http://www.wired.com/wired/archive/14.12/lonelygirl.html article]
*Discuss telematic perfromance.
* Justin.tv [http://www.justin.tv/#r=s7RVqBU~]
*Read: The Presentation of Self in Everyday Life (excerpt). Erving Goffman. 1959.
*Read: Performance: A Critical Introduction (excerpt). Richard Carlson. 2004.
*Do: Intervention in social circuits. Chatroulette/Facebook/Youtube exercise.

'''Social Networks/Web 2.0'''
*Read: Protocol, Control, and Networks by Alexander Galloway and Eugene Thacker. Grey Room 17, Fall 2004 p 6-29.
*Read: DIGITAL MAOISM: The Hazards of the New Online Collectivism. Jaron Lanier. 2006.
*Watch: MediatedCultures @ Kansas State http://mediatedcultures.net/mediatedculture.htm
*Datamining/Complex Networks, node-edge graphing.

'''Digital Memory/Personal Media: Where do we exist and how do we remember?'''
*Read: Mediated Memories in the Digital Age (excerpt). Jose van Dijck. 2007.
*Read: Are you sure you want to do this? Matthias Fuchs 1994.
*Read: Delete: The Virtue of Forgetting in the Digital Age (excerpt). Viktor Mayer-Schonberger. 2009.
*Flickr.com, Facebook
*Discuss: My Pocket. Burak Arikan. 2008.

'''Cognition + Creativity'''
*Generative Art vs. Computational Creativity
*Casy Reas
*Processing.org
*Tom Shannon. [http://www.wired.com/magazine/2010/03/pl_arts_pendulum/all/1]
*Read: Triumph of the Cyborg Composer.
*Read: How to draw three people in a garden. 1988.
*Read: Shades of Computational Evocation and Meaning: The GRIOT System and Improvisational Poetry Generation. 2006.

'''Artificial Intelligence'''
*Read: Expressive Processing (excerpt), Noah Wardrip Fruin, 2009.
*Read: Elephants Don't Play Chess, Rodney Brooks, 1990.

'''Appropriation and Remix'''
*Read: The Fiction of Memory. New York Times, March 12, 2010. Luc Sante
*Read: Jonatham Lethem. The Ecstasy of Influence. Harpers Magazine. 2007.
*Remix Culture. Lev.
*God's Little Toys: Confessions of a cut & paste artist. William Gibson. 2005. *http://www.wired.com/wired/archive/13.07/gibson.html
*Reality Hunger: A Manifesto. David Shields. 2010.

'''Materiality in the information age.'''
*Tangible interfaces, haptic feedback.
*Read: Evocative Objects: Things We Think With (excerpt). Sherry Turkle, 2007.
*Read: New Media and the Forensic Imagination (excerpt). Matthew Kirschenbaum. 2008.
*View: BIT Plane.
*View: Garbage Cubes
*Discuss techniques of markerless tracking, augmented reality, QR codes, etc. *Online/Offline Space.

'''Embodiment'''
*Computing with bodies, engineered bodies
*tactile media, haptic interface
*embodied perception
*Read: Stelarc.

'''Self-Image'''
*Read: Self/Image: Technology, Representation, and the Contemporary Subject (excerpt). Amelia Jones, 2006.
*Do: Forensic Photoshop Exercise.
*http://www.flickr.com/photos/dryponder/sets/72157623726710218/
*http://nymag.com/daily/intel/2010/02/obama_being_forced_to_look_at.html#photo=1
*http://bubleraptor.tumblr.com/
*photoshop free Marie Claire issue: http://jezebel.com/5511507/so-long-as-your-face-looks-alright-everything-else-can-be-photoshopped

== Places to Find Art ==
* http://we-make-money-not-art.com/
* http://www.isea-web.org/, http://www.isea2010ruhr.org/
* http://www.transmediale.de/en
* http://01sj.org/
* http://www.file.org.br/
* http://www.aec.at/festival_about_en.php
* http://www.sciencegallery.com/lightwave09
* Institutions that Sponsor/Show Media Art
** Eyebeam New York City
** New Museum/Rhizome.org http://rhizome.org
** HarvestWorks
** Machine Project, Los Angeles.

== Midterm Projects ==
Make pages here.
* [[DummyProject | Dummy Project]]
* [[MidtermProject| MotionDJ - Leilani Martin]]
* [[What's For Lunch, Kids? by Kelley Kim| ''What's For Lunch, Kids?'' - Kelley Kim]]
* [[Virtual Walk? - Joeny Thipsidakhom]]
* [[Untitled Midterm| Untitled - Jezreel Callejas]]
* [[Midterm Project | Virtual Maze - Tony Lu]]

== Student Pages ==
Click "edit" on the right to add your own page below.
* [[Students/RobertTwomey | RobertTwomey]]
* [[Students/Javier Lee | Javier Lee]]
* [[Students/Jenny Wang | Jenny Wang]]
* [[Students/Joeny Thipsidakhom | Joeny Thipsidakhom]]
* [[Students/Kuan-Ting Lu | Tony Lu]]
* [[Students/Jezreel Callejas| Jezreel Callejas]]
* [[Students/ChristinaSanchez| Christina Sanchez]]
* [[Students/BenBrickley | BenBrickley]]
* [[Students/Ellen Huang | Ellen Huang]]
* [[Students/Kelley Kim | Kelley Kim]]
* [[Students/EmilioMarcelino | EmilioMarcelino]]
* [[Students/Anna Lin | Anna Lin]]
* [[Student/Jenny Chang | Jenny Chang]]
* [[Student/Jet Antonio | Jet Antonio]]
* [[Students/GregoryParsons | Gregory Parsons]]
* [[Students/Jennifer Sunga | Jennifer Sunga]]
* [[Students/LeilaniMartin | Leilani Martin]]