Project3: Creatures

Project3: Creatures

Collaborated Project with Alan Amaya

1. Project Brief

“Do you have a technology-dependent creative project in your head that you want to build? Do you look at a particular kind of work by other interactive designers/artists and think "I wish I knew how to make that!" In this project, we're dropping you in at the deep end. We want you to propose a creative technology project, and we're going to try to help you build it. Or, more accurately, we're going to help you identify and kludge together a small critical piece of it.”

2. Concept

Our world contains two inter-related creatures: the Marker (creature A), and the Eraser (creature B). The Marker has legs made of charcoal, and the Eraser has sponges as its limbs. The Marker is driven by the light intensity in the environment that the Eraser keeps an eye on, and the Eraser is propelled by the audio level in the environment sensed by the Marker. Together, they can perceive the space they are in and react to it based on the information received from their partner.

Creature A Image

Creature A: The Marker

Creature B Image

Creature B: The Eraser

3. Iterations

Plan A:

Creature A has emotions through different colors and intensity of light, which is a real-time response to the ambient sound emitted by creature B. In the meantime, creature B reads creature A’s emotions, and controls the ambient sound and the window accordingly.

We made the following table to map out the type of reactions each creature will have:

Plan A Image

However, when our NeoPixel ring arrived, we noticed that it runs on 5V, different than the 3.3V ESP32 runs on. It was too late to wait for a level shifter to arrive, so we abandoned NeoPixel at all.

NeoPixel Image

NeoPixel Rings

We also realized that in order to play ambient sound, we need an external music player (e.g. a phone) other than ESP32, which is against the idea of a self-sufficient creature. We decided to reduce the complexity in this plan, which led us to plan B.

Plan B:

Plan B Image

Creature A has a mini sound sensor and runs on wheels. Creature B has a photocell and a stepper motor that spins something. The spinning of the stepper motor on creature B depends on the intensity of sound creature A captures. Meanwhile, the movement of creature A is determined by the intensity of light creature B senses.

4. Making Process

We then moved on to the making process.
Welding Image
Creature A Process Image

with Stepper Motor


with Servo Motor


Creature B Process Image

We had to switch from stepper to servo motor for Creature B because we only had one FeatherWing add-on which we need to drive Creature A’s two DC motors.

Communication Image

5. Final Design

5.1 Catalog of Tools

Catalog of Tools

5.2 How It Works

How It Works

5.3 Arduino Code

Creature A Code
Creature B Code

5.4 Project Video