Prepare the Rice Krispie Treats per the recipe on the box and let cool.
Wrap each lollipop stick with washi tape and set aside.
Slice treats into squares/rectangles. You should get at least 16 treats out of one pan.
Slide the sticks into the treats. Wait until they're cool or they won't hold their shape.
In a medium bowl, whisk together the powdered sugar and milk. You may need to add a touch more milk depending on the consistency you're after. You won't want it too thick, but also not too runny. Once you get the right consistency, drop in a couple drops of food coloring then whisk together.
Dip the treats into the glaze, let the excess drip off, then lay them on a piece of wax paper.
Sprinkle with sprinkles and let them set.