Difference between revisions of "Home"
(→Face recognition) |
(→Face recognition) |
||
Line 238: | Line 238: | ||
* Download csu FacePerf software: | * Download csu FacePerf software: | ||
* default face normalization parameters <code> | * default face normalization parameters <code> | ||
− | /* default normalization parameters */ | + | /* default normalization parameters */ |
− | #define ELLIPSE_X 65.0 | + | #define ELLIPSE_X 65.0 |
− | #define ELLIPSE_Y 50.0 | + | #define ELLIPSE_Y 50.0 |
− | #define ELLIPSE_A 64.0 | + | #define ELLIPSE_A 64.0 |
− | #define ELLIPSE_B 118.0 | + | #define ELLIPSE_B 118.0 |
− | #define EDGE_PRE 0 | + | #define EDGE_PRE 0 |
− | #define EDGE_POST 0 | + | #define EDGE_POST 0 |
− | #define EYE_LX 30.0 | + | #define EYE_LX 30.0 |
− | #define EYE_LY 45.0 | + | #define EYE_LY 45.0 |
− | #define EYE_RX 100.0 | + | #define EYE_RX 100.0 |
− | #define EYE_RY 45.0 | + | #define EYE_RY 45.0 |
− | #define SIZE_WIDTH 130 | + | #define SIZE_WIDTH 130 |
− | #define SIZE_HEIGHT 150 | + | #define SIZE_HEIGHT 150 |
− | #define NOISE 0.0 | + | #define NOISE 0.0 |
− | #define SCALE 1.0 | + | #define SCALE 1.0 |
− | #define SHIFT_X 0.0 | + | #define SHIFT_X 0.0 |
− | #define SHIFT_Y 0.0 | + | #define SHIFT_Y 0.0 |
− | #define HIST_NONE 0 | + | #define HIST_NONE 0 |
− | #define HIST_PRE 1 | + | #define HIST_PRE 1 |
− | #define HIST_POST 2 | + | #define HIST_POST 2 |
</code> | </code> | ||
Revision as of 11:30, 2 August 2009
Contents
Classes
Spring 2009 - Electronic Technologies for Art
Electronic Technologies for Art
Winter 2010 - Electronic Technologies for Art
Electronic Technologis for Art I
VIS 147A # ELECTRONIC TECHNOLOGIES FOR ART I
4 units;
This course will develop artworks and installations that utilize digital electronics. Techniques in digital electronic construction and computer interfacing will be learned that will allow for interactive control of sound, lighting and electromechanics will be learned. Students will construct devices which can responsively adapt artworks to conditions involving viewer participation, space activation and machine intelligence.
Spring 2010 - Time and Process Based Digital Media
Course page Time and Process Based Digital Media
Frameworks
Workshop
Language Processing and Self-Representation
- Representation:
- Wordles
- online textual self-representation: the giant text semantic repository in the sky
- gmail
- semantic annotation and tagging of other media
- flickr descriptions
- youtube
- the ongoing-conversation
- comments sections
- traditional text databases
- news media
- nytimes
- wsj corpus
- tools / techniques / technologies
- Computer Mediated Communications (CMC)
- Social Information Processing (SIP)
- Ellison, N., Heino, R., & Gibbs, J. (2006). Managing impressions online: Self-presentation processes in the online dating environment. Journal of Computer-Mediated Communication, 11(2), article 2. http://jcmc.indiana.edu/vol11/issue2/ellison.html
- http://fredstutzman.com/academic.html
- Stutzman, F. (2008) The Spatial Production of Friendship. Re-Public special issue: Towards a critique of the social web http://fredstutzman.com/pubs/stutzman_republic.pdf
- Herring, S. C. (2003a). Gender and power in online communication. In J. Holmes & M. Meyerhoff (Eds.), The handbook of language and gender (pp. 202-228). Oxford: Blackwell. https://scholarworks.iu.edu/dspace/bitstream/handle/2022/1024/WP01-05B.html
- Yee, N., & Bailenson, J. (in press). The Proteus Effect: The Effect of Transformed. Self-Representation on Behavior. Human Communication Research. http://www.stanford.edu/~bailenso/papers/proteus%20effect.pdf
- Lampe, C. A., Ellison, N., and Steinfield, C. 2007. A familiar face(book): profile elements as signals in an online social network. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (San Jose, California, USA, April 28 - May 03, 2007). CHI '07. ACM, New York, NY, 435-444. DOI= http://doi.acm.org/10.1145/1240624.1240695 http://portal.acm.org/ft_gateway.cfm?id=1240695&type=pdf&coll=GUIDE&dl=GUIDE&CFID=36075291&CFTOKEN=36956775
- H Liu, P Maes, G Davenport. Unraveling the taste fabric of social networks. Selected Readings on the Human Side of Information …, 2008 http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.83.7198&rep=rep1&type=pdf
- Social Network
- Friend of A Friend (FOAF)
Reference
- The World Made Digital - http://nickm.com/classes/the_word_made_digital/2008_spring/
- Digital Writing With Python - http://dwwp.decontextualize.com/
- Introduction to Computational Media - http://www.bogost.com/teaching/introduction_to_computational.shtml
- Design of Networked Media - http://www.bogost.com/teaching/design_of_networked_media.shtml
- VoiceXML
Proposals
Language Research
Closed Captioning
- http://www.dcmp.org/captioningkey/
- http://en.wikipedia.org/wiki/Closed_captioning
- Caption it yourself http://www.dcmp.org/ciy/
Teleprompter
Language for performance Teleprompter
Wordnet similarity
wordnet::similarity word vectors
- coffee#n#1: nutmeg, preparation, coffee_tree, caffeine, pulverized, coffee, arabia, tea, shelf_life, packed, hot_water, drinking, topped, java, lemon_peel, ordered, cognac, irish_whiskey, beverage, perforated, cup, sweetened, infusion, espresso, cream, boiling, dehydrated, finely, whipped_cream, stimulating, bitter, cinnamon, alkaloid
- cup#n#1: loaded, drunk, disposable, mustache, coffee, boxlike, tea, saucer, footed, drinking, eucharistic, collectively, tableware, bowl, cup, standardized, greece, rim, toast, missing, ancient_greek, drinking_vessel
- rifle#n#1: automatic_rifle, loads, loading, rifle, action_mechanism, bore, barrel, butt_end, breech, cartridge, fired, sliding, firearm, shotgun, lever, armored, shoulder_holster, portable, lifted, semiautomatic, forward_motion, rifled
- work#n#1: dry_rot, busywork, willing, machine_tool, technology, practical, barn, shiny, undertaking, productive, wages, inquiring, waiting, unit_of_time, preliminary, cleansing, substitute, incomplete, obliged, operations, a_great_deal, rubbing, washed, separately, ophelia, outstanding, interesting, waxing, stocks, attending, papers, labor, thoroughly, heavy_lifting, wasnt, municipal, succeed, missionary, hoped, further, mechanical, medical_care, barber, assigned, meager, budget, course_of_study, attempted, disadvantaged, boss, routine, damaging, close_to, done_for, grade, directed, systematically, recreational, duties, checked, shining, shoes, piece_of_work, polishing, sunday, soap, gawkers, leave_of_absence, improve, no_longer, cleaning, housewife, handling
- neck: sternum, collarbone, hanging, immunity, human_being, cartilaginous, externally, cervix, aids, elderly, body_part, glandular, rings, flex, mastoid, clavicle, admired, occipital_bone, arteries, larynx, membranous, inhaled, aorta, fold, obliquely, artery, ductless, spine, on_fire, chin, graceful
- rifle#n#1 <-> neck#n#1 = 0.0728235790450328
Generative Video through NLP
- making edits based on semantic content
- sequence
- cut points?
- decisions based on character names?
- aesthetic strategies for text
- side-scrolling text
- intertitles
- subtitles
- titles
- aesthetic strategies for photos
- Ken Burns effect
- simulated motion
- motion blur Main_Page#Motion Estimation
- camera shake
- applying motion parameters extracted from real-life situation
- aesthetic strategies for video
- specifically... diverse collections of heterogenous clips and documentation
- video collection strategies
similarity measures
Calculating the similarity of two phrases, with the goal of finding more related matches. Example: "ocean at night" to "still life, objects around the studio" versus "cat tails at the ocean"
- http://www.google.com/search?q=calculate+similarity+of+two+phrases&hl=en&start=20&sa=N
- http://stackoverflow.com/questions/70560/how-do-i-compare-phrases-for-similarity
- http://en.wikipedia.org/wiki/Document_classification
- Phrase-based Document Similarity Based on an Index Graph Model http://www2007.org/papers/paper632.pdf
- http://pami.uwaterloo.ca/pub/hammouda/hammouda_icdm02.pdf
Optical Character Recognition
word evolution study at University of Reading
- Professor Mark Pagel http://www.evolution.reading.ac.uk/
- ThamesBlue
Closed Captioning
Electronic Literature as Performance
LCD hacks
- datasheet from the LCD screen of my old laptop http://www.datasheet4u.com/download.php?id=532443
Fabrication
Fabrication
- http://www.physics.ucsd.edu/~tmurphy/phys121/lectures/lectures.html
- http://fab.cba.mit.edu/classes/MIT/863.07/
- http://www.media.mit.edu/physics/pedagogy/fab/
- http://fab.cba.mit.edu/classes/MIT/863.08/
- http://fab.cba.mit.edu/classes/MIT/961.09/
- CMU 39-245 Rapid Design through Virtual and Physical Prototyping
- silicone mold procedure
fabrication and rapid prototyping
Video Tools
High Resolution Video
- 24P workflow with open source tools [3]
- HDMI capture card (BlackMagic Intensity) [4]
- PCI-Mini and BlackMagic card solution on MBPro [5]
Sub-titles and Closed- Captioning
Convert Fraps Video to Youtube
- ffmpeg command reference http://linux.die.net/man/1/ffmpeg
-
ffmpeg -i infile.avi -vcodec mpeg4 -b 8000k outfile.mp4
- drop audio
ffmpeg -i infile.avi -vcodec mpeg4 -an -b 8000k outfile.mp4
- resize to youtube preferred HD
ffmpeg -i infile.avi -vcodec mpeg4 -s 1280x720 -b 8000k outfile.mp4
Dump video to frames
-
ffmpeg -i infile.avi -s 720x480 -f image2 infile-%03d.tga
Misc
DV cam as a webcam
Monitor Mount
- http://en.wikipedia.org/wiki/Flat_Display_Mounting_Interface
- M4 screws (approx 10mm long), in square 100mm across.
Modifying VideoInput lib for OpenFrameworks
- Added "Bdaiface.h" to DShow.h in C:\\Dev-CPP\\Include
- install ffdshow filter for MPEG2 Decoding http://sourceforge.net/projects/ffdshow-tryout/
DirectShow Comments
// Setup the other filters necessary to handle MPEG2TS Stream // Capture Device -> MPEG-2 Demultiplexer -> ffdshow Video Decoder -> Frame Grabber // MPEG-2 Demultiplexer Filter // Major Type: Video // Sub Type: MPEG2_VIDEO // Format: MPEG2Video // New Pin // Name: Video // Media Type: MPEG2 Program Video // PID Mapping: // PID: x0810 // Pin: Video // Elementary Stream (A/V only) // ffdshow Video Decoder Filter // Codecs // Format: MPEG2 // Decoder: libmpeg2 // Supported FOURCCs/remarks: MPEG2 codec // In: // Major Type: Video // Sub Type: MPEG2_VIDEO // Format: MPEG2Video // Out: // Major Type: Video // Sub Type: YV12 // Format: YV12 1536x-1080, 12bits, // Aspect Ratio: 16x9, // Interlace format: Frames // rcSrc=[0,0,1440,1080] // rcDst=[0,0,1440,1080]
CV
Motion Estimation
- Blind image deconvolution motion blur estimation http://www.ima.umn.edu/2005-2006/MM8.9-18.06/activities/Wohlberg-Brendt/team5_pres.pdf
- Motion Blur Parameter Identification from a Linearly Blurred Image http://ieeexplore.ieee.org/iel5/4145986/4099325/04146207.pdf?tp=&isnumber=&arnumber=4146207
- Blind Estimation of Motion Blur Parameters For Image Deconvolution http://www.lx.it.pt/~jpaos/Joao/Joao_Oliveira_files/ibpria2007_motionblur.pdf
Identity Processing
Face detection
- with opencv: http://opencv.willowgarage.com/wiki/FaceDetection
- Picasa Face Detection and Tagging
-
Face recognition
- http://info.polarrose.com/features/
- PittPatt http://www.pittpatt.com/
- good paper http://www.cs.colostate.edu/~vision/faceperf/Bolme_IISWC2007.pdf
- Elastic Bunch Graph Matching (EBGM)
- PCA
- Download csu FacePerf software:
- default face normalization parameters
/* default normalization parameters */ #define ELLIPSE_X 65.0 #define ELLIPSE_Y 50.0 #define ELLIPSE_A 64.0 #define ELLIPSE_B 118.0
#define EDGE_PRE 0 #define EDGE_POST 0
#define EYE_LX 30.0 #define EYE_LY 45.0 #define EYE_RX 100.0 #define EYE_RY 45.0
#define SIZE_WIDTH 130 #define SIZE_HEIGHT 150
#define NOISE 0.0 #define SCALE 1.0 #define SHIFT_X 0.0 #define SHIFT_Y 0.0
#define HIST_NONE 0 #define HIST_PRE 1 #define HIST_POST 2
Biological Limits
Structure from Motion / Motion Correction
- http://www.youtube.com/watch?v=3TlCGh5Pc90&eurl=http%3A%2F%2Fcreatedigitalmotion.com%2F2009%2F06%2F30%2Fmagical-3d-warping-techniques-steadies-your-videos%2F&feature=player_embedded
- voodoo http://www.digilab.uni-hannover.de/docs/manual.html
Book Formatting
- render txt files to whole-page images
Windows hacking
XP from USB stick
Corn Fed Nation
E-Ink Facemask
- broadsheet proto kit ($4000) http://www.eink.com/kits/amepd.html
- http://griplipproductions.homestead.com/facecast.html
Performance
- http://www.spelman.edu/academics/programs/anthropology/pdf/anth333dra333dwhite.pdf
- Theater and Ritual
- http://www.amazon.com/Ritual-Theatre-Human-Seriousness-Books/dp/0933826176/ref=pd_cp_b_2
- http://www.amazon.com/Between-Theater-Anthropology-Richard-Schechner/dp/0812212258/ref=sid_av_dp
- http://www.amazon.com/Contesting-Performance-Emerging-Research-Interventions/dp/0230008453/ref=sr_1_3?ie=UTF8&s=books&qid=1245344889&sr=1-3
- http://www.amazon.com/Performance-Inc-Performativity-Mediated-Resistance/dp/0415774187/ref=sr_1_4?ie=UTF8&s=books&qid=1245344889&sr=1-4
Semantic Web
Misc
decision making algorithms
- OODA Loop (for Observe, Orient, Decide and Act)
- John Boyd. http://www.d-n-i.net/boyd/pdf/c&c.pdf
- Plan-Do-Check-Act (PDCA, Shewhart) http://en.wikipedia.org/wiki/Shewhart_cycle
- sigma six, “Define, Measure, Analyze, Improve, Control” (DMAIC)
MedTech
Transcranial Magnetic Stimulation (TMS)
Electronic Muscle Stimulation (EMS)
Map-Reduce
AJAX versus traditional web design
Enabling OBEX with motorola Razr V3c
Provocative thoughts
- Danger of a New Online Collectivism: Digital Maoism
- Lost Serendipity http://www.nytimes.com/2009/08/02/business/02ping.html?_r=1&hpw