When I think of the first civilizations or at least the early ones with written language I think of the rivers they lived on, Tigris, Euphrates, Nile, Indus, Yangtze(not sure if that's right). Anyways, did any early literate civilizations pop up somewhere away from a river.
I am fairly certain the answer to this is no. I am not aware of any literate civilizations from the 2nd or 3rd millennium BC (or earlier) that began away from the water.
The reason the locations are important is really because of the importance of food surplus. Early people were hunter-gatherers, and while some scholars think the hunter-gatherer lifestyle has its benefits, it does not produce a food surplus to support craft specialists.
The "Neolithic Revolution" is basically the beginnings of sedentism, or people starting to settle in more permanent locations, and domesticating plants and animals. Then, they begin to clump together for protection from people who want to steal their food. These turn into towns and cities. The food surplus allows these towns and cities to support people who don't gather or hunt their own food, but rather invest that time into innovating new technologies, or creating beautiful things, or organizing the growing settlement. This is a process called "craft specialization", and it is largely made possible by food surplus resulting from the development of agriculture.
Now why do we see the first major civilizations generally by rivers? It's because the river plains provide abundant water for that essential agriculture to provide that food surplus.
In fact, writing can even be tied to the development of that food surplus. People used ceramic tokens in the shape of goods (grain, beer, bread, sheep, etc) that they put in central storage units or traded for other goods. These tokens were used to keep track of transactions and keep track of who owned how much. These tokens were often enclosed in clay envelopes, but it became obvious that you had to break the envelope to see how much was inside, so they started to press the tokens into the clay on the outside, to mark what was inside. Then someone decided who needs tokens? The token impressions are good enough. And that's when writing was born. And so all of our earliest examples of writing are actually receipts and economic documents recording early transactions. Without the surplus foodstuffs and other goods which were made possible by the agricultural importance of rivers, we might not have writing.
Water has always been an extremely valuable resource. And while civilizations or other people groups did crop up in areas with less water, they usually copied and/or slightly altered the writing systems of the large, main civilizations who invented writing systems. The civilizations from areas with less water took longer to develop craft specialization and organizational complexity, becuase they had to wait for technology to be developed to allow surplus foodstuffs to be created in their territories, which were not as suitable for agricultural working.
The Inca Empire could classify as a civilization that sprouted without a river valley, if you're a bit loose on the definition. The earliest permanent settlements are on the western coast just beyond the Andes on the ocean, in the many river valleys there. Those settlements aren't the end result however, as the wide variety of climates in such a relatively small amount of space, any larger settlement of people wouldn't've lasted in those smaller river valleys.
Interestingly enough, it wasn't until the highlands in the Andean Mountain range were settled by several groups of people (where they domesticated several types of llamas and a wide variety of potatoes) that they moved into the areas between the mountains (where llamas weren't as often found due to the different environment down there) that the civilization grew. They relied very little on one particular river, with the main form of transportation being the amazing roadways that are found everywhere in Peru.
So long story short; yes, some small river valleys were important in the beginning, but not reliant upon their individual rivers like the other civilizations you listed.
And just to clarify, they didn't have a written language, which I see is something you mentioned. However, they did have a complex bureaucratic system kept in check with numbers. That was done by knotted string, called quipu , all tied together in certain ways to mean certain things. I'm not sure if you'll consider the Inca 'literate' enough to answer your question.