So it turns out that rosemary is easy to propagate. All you have to do is snip a few branches and throw them in a glass of water. After about two weeks, they cuttings will have grown lots of thin white roots.
Here there are transplanted into small pots.
When they get larger, I'll move them into ever larger pots. I love simple.