[AI] Use swatch color in gradient

How do I use a swatch color as a point on a gradient? When I click on a gradient point and then a swatch color, it just cancels my gradient and fills in the shape with a solid color. So right now I’m just clicking the gradient point and then selecting a color from the color pallete, which is hard for me to use.