解:$(1)$∵点$A$在$y$轴上,∴其横坐标为$0,$即$3a - 5 = 0,$解得$a = \frac 53$
此时点$A$的纵坐标为$a + 1 = \frac 53 + 1 = \frac 83,$∴点$A$的坐标为$(0,$$\frac 83)$
$ (2)$∵点$A$到$x$轴的距离是$2,$∴点$A$纵坐标的绝对值为$2,$即$|a + 1| = 2$
当$a + 1 = 2$时,$a = 1,$此时点$A$的横坐标为$3×1 - 5 = -2,$坐标为$(-2,$$2)$
当$a + 1 = -2$时,$a = -3,$此时点$A$的横坐标为$3×(-3) - 5 = -14,$坐标为$(-14,$$-2)$
综上,点$A$的坐标为$(-2,$$2)$或$(-14,$$-2)$