With \setuphead[section][number=yes/no]
how do you test whether what's being typeset
is in a section or not ?

Using

\determineheadnumber[section]
\currentheadnumber

is only relevant when number=yes.

-- 
Alan