Religious Studies BA here. Which part of the Bible? Much of the Torah/Old Testament early on we have no evidence for. Even up to and including the Exodus. There seems to be no substantial evidence that the Hebrews were ever slaves in Egypt--not, at least, in the numbers described in Exodus. However, it is worth noting that many other ancient near east cultures have very similar flood myths to the one in Genesis. Look at the Babylonian Epic of Gilgamesh.
However, as the Old Testament progresses, it seems, for the most part, to become more and more historically founded. Take Maccabees, which tells of how Alexander the Great conquered the Hebrews and many other lands, then at his death left his empire in the hands of his generals. It further tells of a Jewish uprising called the Maccabean Revolt which happened in about 167 BCE, when a group of Jews revolted against Hellenistic rule and drove the Greeks out of the Temple. Another example would be the destruction of the First Temple in 586 BCE by the Babylonian Empire and subsequent exile of Jews from Israel, and later the return of the Jews and rebuilding of the Temple under dispensation of the Persian emperor Cyrus the great in 538 BCE, who had recently conquered Babylon.
There is much scholarship on the historicity of Jesus, and no serious modern scholar still argues that he didn't exist. If you're interested in that subject, I suggest reading up on the historicity of Jesus.
The answer to your question is "sometimes." But remember that this is not a history book in the way that modern people think of history. This is the cultural history of an ancient people group, including their myths, legends, religious beliefs, etc., and cannot be divorced from this context to understand it in any historical critical way. Keep in mind also almost none of the Bible was composed to be written down immediately. Much of it began as oral storytelling and continued in this way for hundreds of years before being written down. Most ancient cultures were orally based, Hebrew not the least. Even the New Testament took at least 30 years to begin being written down after the events it describes.
Long story short, it is more useful to think of the Bible as a collection of cultural stories than a history book. Some of them are rooted in historical fact, and even the grand mythical ones like the worldwide flood probably had some actual basis in fact, though exaggerated through years of oral tradition and to fit the religious pedagogy they were going for.
Hi, fyi your you'll find a few earlier posts on this topic in the FAQ - there are a few sections here related to historicity of the Bible