Sometime back when I was in Kapiri Mponshi I found that there were a few cheap hotels and lodges such as Mimis Executive Guest Lodge, Unity Motel and Eros Lodge.
As to contact details, I think others can chip in.
NB: This page on Kapiri Mponshi on this same site, I think will give you more information on Kapirimponshi.