Although I can't claim to be an expert on this topic, there are a few publications which discuss this question in detail.
The first, Gaynes' The Discovery of Penicillin—New Insights After More Than 75 Years of Clinical Use, published in a CDC journal, explores penicillin's early history. After its discovery in 1928, Fleming had difficulty isolating the compound from the extract for clinical use (essentially it wasn't practically useful). However, by 1932, Bayer chemists in Germany had developed a sulfonamidochrysoidine called Prontosil, the first widely available antibiotic, for which Gerhard Domagk received a Nobel Prize in 1939. Penicillin wasn't successfully isolated for clinical use until 1939, by a team at Oxford. The author notes that as late as 1941, the US did not have enough penicillin to treat even one person. At that point, as Britain was actively engaged in war with Germany, the team at Oxford took their research to the United States, where penicillin could be developed in a safer environment. It wasn't until 1943 that penicillin was finally widespread enough to treat the Allied Forces.
In the USSR, a different strain of penicillin had actually been isolated for clinical use by Zinaida Yermolyeva in 1942. By 1943, it was being used in Soviet hospitals, and later on even at the front lines. This is discussed in the second article, Ford's Crisis Point: The Rise and Fall of Penicillin in a journal of the McCrone Research Institute.
As for your question on Germany, there is nothing to say they were not very aware of Fleming's discovery when it was first published, as it was information in the global public domain. However, Wainwright suggests in "Hitler's Penicillin," in a journal published by Johns Hopkins, that the Germans relied heavily on the sulfonamidochrysoidines created by Domagk to the point of blindness to the uses of penicillin. This is important because, although these treatments were effective, bacteria quickly developed a resistance to them and they often proved toxic. Faced with this reality, Germany did in fact try to make use of penicillin - Fleming had, in his effort to isolate the compound, sent a culture to Germany in the 1930s. However, German scientists failed to replicate the successes of the US, England and USSR.
Problems in Germany were compounded by the fact that, by then, the tide was beginning to turn and Germany began to lose the war. Political infighting and corruption prevented any focused attempts at isolating penicillin for widespread use. The Wainwright article goes on to explore Hitler's treatment by Theodor Morrell with what is presumed to be penicillin (an unrefined form) after the assassination attempt by Claus von Stauffenberg. Thus, it seems to be that Germany was well aware of its uses, but unable to mass produce a version comparable in quality to that of the Allies for their own troops.
So, to summarize the answer to your question: it seems the USSR had developed their own strain of penicillin and thus did not need supplies from other countries, and that Germany did try to isolate it, but failed for a variety of reasons.
USSR didn't produce penicillin in any meaningful quantities until after the end of war. It did have, however, a propaganda campaign to show that it did. USSR was supplied with American penicillin since 1944 and relied on knowledge transfer from Florey to start even small scale manufacturing. The mass production didn't start until Chain sold them the info in 1948.
Germans tried to produce it, but could not obtain the culture early in war, and later on dedicated resources to sulfa drug production. They probably had a very small scale manufacture in 1944 and could obtain small quantities of US product for VIPs.