My main point of comparison is the UK, which has many ranks - (Chief) Inspector, (Chief) Superintendent, Chief Constable - which aren't used in the USA, instead being replaced with ranks of military origin like Lieutenant, Captain, Major etc. Sergeant is used in both countries.
The UK is the different/unusual one. When Robert Peel founded the Metropolitan Police, he wanted it to be considered different from the French Gendarmerie which was thought by British people to be a symbol of oppression and state overreach. Therefore, they wear blue uniforms (British soldiers at the time typically wore red) and have a rank structure which shares very few ranks with the military.
"US police forces" has a very wide meaning, some are organized with military ranks and some are not. In at least some cases, those ranks were used because the persons responsible for the organization and training of the police in question were military personnel themselves.