To a certain extent the problem here is linguistic. It is always problematic when we apply an English term like "giant," rooted in Northern Europe, to a Hebrew text. The brief, vague references to the Nephilim in Genesis, Numbers, and possible in Ezekiel, provide scant information about what was intended - or even if the same concept was intended by these references.

That said, it appears that the Nephilim may have been large human-like creatures (or perhaps large humans) from what may have been perceived as a "Golden Age" when everything was larger, grander, and more heroic.

That's not exactly what is meant by the idea of "giant" as it is expressed in English - or related - oral traditions. There, the giant was a race of supernatural beings who helped shape the landscape and were defeated by heroic men who eventually came along and overcame the titanic first inhabitants of the land.

There are features that overlap with the two traditions, but that does not imply any sort of link. To my mind, there are not sufficient shared motifs to suggest any sort of connection. This is partly because the Hebrew references are so rare and scant, but a historical relationship before the conversion of the North is simply improbable.

To answer your question, then, "Nephilim" is frequently translated as "Giant" (and they are giants of a sort), but that translation is problematic and one should not allow for anything more than a shared term to be implied.