The source of the account of the famine in the year is Anglo-Saxon Chronicle (E: The Laud MS) a. 1005 ([edited]: , and F of the same year) that also states that the famine hit the Anglo-Saxons as well.

 

The following is the passage in question (sorry for my miserably rough translation, and I cannot type even proper OE for now):

'In this year there was so terrible famine across the Anglo-Saxons (Angel cynn) that no one remembered such so severe [famine], and also in this year the fleet left this land for Denmark, [edited]: and came back for a little after'.

The original text comes from: Plummer, Charles (ed.), Two of the Saxon Chronicles Parallel, London, 1892, p.139.

 

It also seems to me in rather more straightforward reading of the source text that the primary victims of the famine was the Englishmen, not the Vikings.

Do you wish to have the more extensive information on the famine then in England?
I afraid that there not so much more primary sources can be found in this event itself, but I hope I can find some secondary literature on this period.

[Edited]: tweaks the format of the translation, and correct some translations.