Ladybug
STEM toy that publishes to a web journal, encouraging reflection on one’s experiences

Challenge
Invent an educational device that has a tangible user interface
Adopted the theme of “Exploration”
We started with brainstorming as a group followed by rounds of independent sketching. “Exploration” emerged as a popular theme (flashlight, walkie talkies, utility belt, butterfly net)
Aligned on goals
- Encourage exploration and early learning for children by giving them feedback on images they encounter in the world.
- Spark new conversations between parent and child.
Explored magnifying glass metaphor

Storyboarding a use case
Helped build team alignment and shared understanding

Researching materials and planning the prototype

Interaction Design
Sensors allow the device to detect when it is being actively held, and if it is currently in motion. When the user pauses over an item to inspect it in detail, a camera mounted to the lens captures the subject of the user’s interest. Operation of the device is intuitively the same as using a regular magnifying glass.

Online journal collects memories of the exploration
Imagine a child with the ladybug device in a park, or a museum. As they look closer at objects, a snapshot is captured by the device. Later, loved ones can sit together, review the journal entries, and use the images to encourage the child to speak about their experience.

User testing
Observing people use the device gave us a lot of interface improvement ideas
- Adjust camera position based on common angles
- LED feedback often unnoticed
- “is anything happening?”
- The “system status” UI heuristic important with gesture-based interactions




