Ladybug

STEM toy that publishes to a web journal, encouraging reflection on one’s experiences

Challenge

Invent an educational device that has a tangible user interface

Adopted the theme of “Exploration”

We started with brainstorming as a group followed by rounds of independent sketching. “Exploration” emerged as a popular theme (flashlight, walkie talkies, utility belt, butterfly net)

Aligned on goals

  • Encourage exploration and early learning for children by giving them feedback on images they encounter in the world.
  • Spark new conversations between parent and child.

Explored magnifying glass metaphor

Storyboarding a use case

Helped build team alignment and shared understanding

Storyboard vision of the device in the real world

Researching materials and planning the prototype

Experimented with gesture controls using force and motion sensors.

Interaction Design

Sensors allow the device to detect when it is being actively held, and if it is currently in motion. When the user pauses over an item to inspect it in detail, a camera mounted to the lens captures the subject of the user’s interest. Operation of the device is intuitively the same as using a regular magnifying glass.

Online journal collects memories of the exploration

Imagine a child with the ladybug device in a park, or a museum. As they look closer at objects, a snapshot is captured by the device. Later, loved ones can sit together, review the journal entries, and use the images to encourage the child to speak about their experience.

Live streaming captures from device to web

User testing

Observing people use the device gave us a lot of interface improvement ideas

  • Adjust camera position based on common angles
  • LED feedback often unnoticed
  • “is anything happening?”
  • The “system status” UI heuristic important with gesture-based interactions