Can AI Tell Us When To Use AI And When Not To?