Don Norman split this from affordance in the revised "Design of Everyday Things." A door handle affords pulling; the "PULL" sign next to it is the signifier. A flat push-plate has no handle-affordance at all, so the sign becomes mandatory.
Onscreen, a dropdown's ▾ arrow, a drag handle's grip icon, a link's underline — all signifiers. Function without a signal just makes users push when they should pull, or the reverse.
Door A has no sign, so the user pulls and gets stuck. Door B shows an arrow and opens the right way.
When to use
When affordance alone isn't enough, add a label, arrow, or icon. "Looks nice but I don't know what to do" feedback is a missing-signifier signal.