For a certain positive integer $n$, the number $n^{6873}$ leaves a remainder of $3$ when divided by $23.$ What remainder does $n$ leave when divided by $23$?