James makes no claim for himself concerning authority, here. He is simply a servant of God and Christ, implying that he is also the servant of those to whom he writes.
God and Lord Jesus Christ
He is writing to twelve tribes which are scattered. Note: at this point there is no concept in his mind about ten lost tribes.