The Thinking Chair is when Steve, Joe or Shelley solve a problem. He/She puzzles over Blue's three clues and attempts to come up with the answer.
Blue's Clues Wiki