You’re thinking too much. It’s a joke, and not a super-logical one. Teenagers always think their crushes don’t know they exist. Ghosts are supposedly invisible.