I'm not much into religion but the stories are interesting. I've read some of the questions in the AskHistorians FAQ and they cover specific events but are there any good reads that I could pick up that would cover the bible from a historical point of view? A good starting point perhaps? Sorry if this isn't the right type of question for this subreddit, I can't find anything explicitly forbidding this type of question but sorry if it is wrong.
It's pretty controversial but my personal favorite is Neil Silberman and Israel Finkelstein "The Bible Unearthed" (Old Testament). Another good one, also OT, is "Who Wrote the Bible?" The last one is a classic but may be a little outdated at this point (from the late 80s).
Everett Ferguson's "Backgrounds of Early Christianity" is a very good background book on the New Testament and immediately after world.
Are you more interested in Old Testament or New Testament backgrounds?
The religion section of the AskHistorians book list might be worth looking at.
I personally recommend A brief introduction to the New Testament by Bart D. Ehrman if you are looking for something that examines the creation of the New Testament and the historical circumstances surrounding it.