Cut the top off of the plastic cups. Depending on your kids this might be an adult job.
Cut the straws down to be your desired staff size.
Tape the straw to the inside of the cup. I found that duct tape worked best for this. It held strong even after being played with in the water.