That quote couldn't be more wrong. Psalm 5:6 even explicitly states that "the lord abhors the man of bloodshed and deceit". The passage you referenced is essentially about how God is displeased by wickedness, and the author asks that God banish those that rebel againt him.

Edit: after some investigation, the quote you listed is a complete fabrication from "the Quotable Atheist" by Jack Huberman. It appears nowhere in the Bible.

Not even remotely:

https://www.biblegateway.com/passage/?search=Psalm+5%3A4-10&version=KJV

4 For thou art not a God that hath pleasure in wickedness: neither shall evil dwell with thee.

5 The foolish shall not stand in thy sight: thou hatest all workers of iniquity.

6 Thou shalt destroy them that speak leasing: the Lord will abhor the bloody and deceitful man.

7 But as for me, I will come into thy house in the multitude of thy mercy: and in thy fear will I worship toward thy holy temple.

8 Lead me, O Lord, in thy righteousness because of mine enemies; make thy way straight before my face.

9 For there is no faithfulness in their mouth; their inward part is very wickedness; their throat is an open sepulchre; they flatter with their tongue.

10 Destroy thou them, O God; let them fall by their own counsels; cast them out in the multitude of their transgressions; for they have rebelled against thee.

As for finding it (if it does exist), it would help knowing which translation was used to text search for it.

You can go to https://www.biblegateway.com/ and do searches throughout different translations on your own as well, if you'd like to find it.

On this website a longer version of the quote is attributed to someone called Veyanne.

Seems like Veyanne is a usenet poster who had a geocities website on which she published The Psalms of Veyanne.