Key factors to consider when purchasing a music streamer include audio quality, supported streaming services, connectivity options, compatibility with your existing equipment, ease of use, additional features like voice control or multi-room audio, and overall value for your budget.