The question therefore is not whether in this case the deputy clerk made any observation or offered any criticism which he might not properly have made or offered; the question is whether he was so related to the case in its civil aspect as to be unfit to act as clerk to the justices in the criminal matter. The answer to that question depends not upon what actually was done but upon what might appear to be done.