|MadSci Network: Zoology|
As far as I know, baby lemmings do not have a specific name. The young of all rodents can be referred to as "pups." Sometimes you will hear newborn rodents called "pinkies," because that's what they look like. They are born without hair, and so their pink skin is visible. They acquire fur and grow fast, though. They have to--they will be weaned when their mom has another litter, which for lemmings is in about three weeks!
Try the links in the MadSci Library for more information on Zoology.