Update - Sounds and Sound Interaction

We've combined the results of last time's competition, taking ideas from the other teams into one idea.

1. Approaching a Module. If someone is near a module, or in between two, a range finder will detect them and activate a chime sound to indicate that the module can be interacted with and involves sound. Similarly, if the range finder is activated but none of the sensors have been activated in a certain amount of time the chime sound will again play, beckoning people to come interact with it.

2. Under the arch. We take Team 5's concept of combining range finders with IR pairs in order to measure the height at which the IR beam was broken. One instrument will have three pitches or note combinations staggered along the height of the angle under the arch. If the beam is broken higher up, the higher note combination will be played and vice versa.

3. Sensor Interaction. As we described last time, multiple sensor activation is rewarded, encouraging community participation. The sensors will represent one of 4-5 instruments. When one is activated alone, it will play a short rhythm or beat. If 2 are activated, a short song will play involving the instruments of those two sensors. As more sensors are activated at the same time, a richer, more complicated song will play. It becomes a challenge for interactors to find the hidden songs in the module (3-4 perhaps). In order to allow a person interacting alone to find the songs, there will be a small time window (perhaps 1-3 seconds) for other sensors to be activated once one sensor is activated and then trigger a song.

*UPDATE*
After looking at the physical construction of the modules, it seems to make more sense to simply put an IR pair across the underside. When the IR beam is broken, a sound should be triggered.

Progress Report Week 9

The idea:

Use photo resistors to play sounds such that, when a photo resistor is covered, a sound plays once, and when multiple resistors are covered a different sound loops.

The design:

Our original idea last week was to use two arduino boards linked together, one connected to all of the photo resistors and the other connected to the wave shield. We thought that we would need two arduinos because it was our understanding that the wave sheild would occupy all but 3 or 4 of the pins on the arduino. To our delight, the wave shield actually left us with access to 10 analog pins, and because of this we only needed one arduino board to accomplish our task.

The Prototype:

Wave Shield

We first had to build the wave shield. This was mostly done by Anna. The construction went smoothly without any soldering mistakes. After the wave shield was constructed, we attached it to the arduino and soldered it into place. With the wave shield firmly attached to the arduino we had to find an SD card that we could use with the card. The SD card ended up being one of the more problematic aspects of the prototype, and we were confused as to why one was not included with the technology kit. Luckily one of our team members had a mircoSD card and adapter (to regular SD size) that we could load wav files onto. The SD card had to be formatted to FAT16, which required a bit of a work around on a mac (View complete process here). With a properly formatted Card, we were able to run the example arduino code and hear our audio files through the wave shield!

Photo Resistors

Our next task was to construct a circuit with a photo resistor that we could use to call the play() function on the wave shield. It took us some time to remember how to correctly organize all of the resistors and photocells and wires, but eventually we created a working circuit. From there we began to add conditional statements such that if the photocell circuit was being covered, it would play a sound. We were able to successfully connect the photocell to the play() function in the wave shield, and we then began to adapt the example wave shield code to play specific files from the SD card when a specific photocell was covered.

Problems

SD Card - We didn't have one in our Tech kit.

Our SD adapter frequently gives us the error that the card failed to initialize, we believe this is just a hardware error, because if we simply redeploy it will work.

Wires

Because the Wave shield has slots for wires to be soldered in place, it was fairly annoying to try and test with unsoldered wires. They kept popping out of their slots, and sometimes the connection was not reliable.

Headphones

We discovered that the original headphones we were using were broken, and had to switch to using earbuds.

The Working Prototype

Phase 2: Getting the sound to work...

This week we hashed out the digital interaction and got a sample working on our newly soldered wave shield-arduino sandwich. The soldering could be a bit tricky, but was overall a lot of fun. As far as programming, the wave shied site was incredibly helpful.


The photo above if from an initial try, but as of now we can activate two photoresistors independently. If - looking at the diagram below - you activate only photoresistor A, it will place its wav file. If you activate only photoresistor B, it will place its wav file. If both are activated together, the system will play and loop a wav file that is the combination of A and B's sounds. For example, if A is a trumpet melody and B is a drum beat, A-B will a trumpet-drum beat loop.
We are estimating approximately 8 photoresistors per module, so there will have to be a wav file for every distinct combination of 8.


Some possible issues we came across while testing:

• Cloudy Days. We noticed that the numbers output by the photoresistor changed a great deal when we closed the blinds, or the sun went away. This affected our parameters for when the sound should go off.
• Range of Photoresistors. We aren't sure of the maximum distance that will set off the resistors. Would a shadow from a few feet away do it? This might not be a problem, but something to investigate.

Progress Report Week 8

For this week, our team discussed how to design the digital interaction for the overall
piece, and how we could implement it. Below are our notes on the types of interactions and how
the interaction would work. Also below are several images of ways to help convey the digital
interactions to users. We also found a website with all the information we would need to
accomplish setting up parts of the digital aspect.

Range finders detect distance.

Use two arduinos on one module

Interaction scenarios:

Make an improvisation song

sitting on it and read (one noise attivation)

Marco Polo

Actions:

Running Past

Sitting

Crawling Under

Jump on/off

Records (a red circle with black hand on it)

Hanging

Use as a home base

Hit-it

Slide

Stand on

Walk towards it

Different sound for different range for range finders

Loops rhythm if 2 hands activated. ( Sound 1, Sound 2. Together = Sound 6)

Hold two hand prints and they repeat.

Hide handprints (Exploration)

Abstract Instrument (Travis’ idea)

Twister

“Play” Hand Print

Smear Hand with 3 photosensors

Temporary recording of the “song” or interaction. If you hit the “Play Hand” and hold it. Then you can activate more sensors and add to the existing beat, as long as the play hand is activated. If there are no prior activations, it should still play something (ga tech sound?). Maybe play back last 5 beats (to rep 4 fingers/ 1 thumb). Body Remixing. Encourages Community

About 6 hand prints per structure

Each hand print a different color

What kinds of sounds?

- Congo beats

- Nature sounds

- Digital sounds

- How far can you hear the sounds?

To accomplish building the digital aspect:

http://absences.sofianaudry.com/en/node/10

http://hacknmod.com/hack/how-to-connect-multiple-arduino-microcontrollers-using-i2c/

Progress Report Week 7

We've decided to put aside the idea of using LEDs in conjunction with sound for this project. After testing the plausibility of LEDs in a real world scenario, we found them to not be very noticeable, even in the shade. We feel that with the limited amount of time that we have for this project, our final product would be far more polished if we were to focus exclusively on the sound interaction with the piece. We can dedicate our time to creating a sound interaction that is inherently connected to the physical space as well as the physical interaction.

Parts List per Module : 127.76

Arduino Duemilonove

http://arduino.cc/en/Main/ArduinoBoardDuemilanove

Cost: $29.00

# Needed: 1/arch = $29.00

Specs:

Operating Voltage 5V

Input Voltage (recommended) 7-12V

Input Voltage (limits)6-20V Digital I/O Pins14 (6 provide PWM output) Analog Input Pins6

DC Current per I/O Pin40 mA

DC Current for 3.3V Pin50 mA

Flash Memory 16 KB (ATmega168) or 32 KB (ATmega328),2 KB used by bootloader

SRAM1 KB (ATmega168) or 2 KB (ATmega328) EEPROM512 bytes (ATmega168) or 1 KB (ATmega328)

The board can operate on an external supply of 6 to 20 volts. If supplied with less than 7V, however, the 5V pin may supply less than five volts and the board may be unstable. If using more than 12V, the voltage regulator may overheat and damage the board. The recommended range is 7 to 12 volts.

IR Sensor/Emitter Sets

http://www.sparkfun.com/commerce/product_info.php?products_id=241

Cost: $1.76 (10-99 order)

# Needed: 4/arch = $7.04

Specs:

Description: Side-looking Infrared Emitters and IR Detectors. These simple devices operate at 940nm and work well for generic IR systems including remote control and touch-less object sensing. Using a simple ADC on any microcontroller will allow variable readings to be collected from the detector. The emitter is driven up to 50mA with a current limiting resistor as with any LED device. The detect is a NPN transistor that is biased by incoming IR light.

Photoresistor

Cost: $1.35 (10+)

# Needed: 1/arch = $1.35

Specs:

http://www.jameco.com/webapp/wcs/stores/servlet/ProductDisplay?langId=-1&storeId=10001&catalogId=10001&pa=202438&productId=202438&keyCode=WSF&cid=GMC

PHOTOCELL,150 mW, 200 VPK, 3.6 Kohm

MAX LITE,0.3 Mohm MIN DARK

Speaker

http://www.sparkfun.com/commerce/product_info.php?products_id=9151

Cost: $1.95

# Needed: 2/arch = $3.90

Specs:

Small Size

Power rating: 0.5W

Impedance: 8 ohm

Amp

http://www.parts-express.com/pe/showdetl.cfm?partnumber=320-214&source=googleps

Cost: $18

# Needed: 1/arch = $18

Specs:

500 mA ; 7.5 W ; 15V DC

Solar Cell

http://www.sparkfun.com/commerce/product_info.php?products_id=7840

Cost: $34.95

# Needed: 1/arch = $34.95

Specs:

2.5 Watts

Description: Packaged solar cell with barrel plug termination. This is a custom cell produced for SFE - not a small toy surplus item! This unit is rated for 8V open voltage and 310mA short circuit. We actually took a random unit outside and measured 9.15V open voltage and 280mA short circuit. Under ideal sun conditions (high-noon, clear sky) 310mA is very possible but will vary from cell to cell. We can even get 110mA from inside our office windows! Termination is a 5.5mm x 2.1mm barrel plug, center positive on a 2m cable. Monocrystalline high efficiency cells at 15-15.2%. Mates directly with many of our development boards. Unit has a clear epoxy resin coating with hard-board backing. Robust sealing for out door applications!
Dimensions: 7 x 4.5"

NiCd A Flat Top Battery A Nickel Cadmium Industrial Rechargeable Battery

http://www.batteriesplus.com/product/33221-NUN1400--AF-NiCd-A-Flat-Top-Battery/100093-1/102937-Industrial-Rechargeable-Cells/102949-Nickel-Cadmium/A.aspx

Cost: $4.19

# Needed: 8/arch = $33.52

Specs: A Nickel Cadmium Industrial Rechargeable Battery NiCd A Flat Top Battery NUN1400-AF. Top quality cells make top quality batteries. Get the right cell and have one of our Battery Experts assemble a pack to power your application. Talk to a Battery Expert at one of our stores regarding battery assembly and custom design capabilities using NiCd or NiMH cells.

• Item number: NUN1400-AF

• Weight: 0.1000 lbs

• Voltage: 1.2V

• Capacity: 1400MAH

• Primary Applications: Battery pack assembly, industrial use and more