While the positive effects of ether that you listed are certainly legitimate, there are three main reasons why the drug has remained generally unpopular for recreational use:
Odor. Ether has a very pungent scent to it; users often compare the smell to being like that of jet fuel. Recreational use of ether causes this scent to stick on the user’s clothes and skin for up to several days. Additionally, since ether is typically inhaled after being doused on a rag (similar to that of chloroform), the user is also left with the unpleasant taste of it for around the same time.
Flammability. Ether is extremely flammable, meaning that casual use in an uncontrolled environment carries great risk for the user.
Addiction. Ether is also highly addictive; recreational users typically go on a “binge” when using it. Going through just one rag is enough for the user to have a strong desire to keep doing one after the other, since the psychoactive effects typically last for only a few minutes.
Recreational use of ether did briefly become popular during the 19th Century, especially within Ireland. As the temperance movement became a dominating force within the country, some Irish citizens turned to ether as a substitute for alcohol. This is why author and journalist Hunter S. Thompson describes ether in his 1971 novel Fear and Loathing in Las Vegas as making the user feel “like the village drunkard in some early Irish novel”.
Source:
Miller, Richard Lawrence (2002), "Ether", The Encyclopedia of Addictive Drugs, Westport, Connecticut: Greenwood Press, pp. 153–154, ISBN 0-313-31807-7, retrieved 9 November 2018
As an addendum to what /u/zyyp explained, I'd like to say that the recreational usage of ether was indeed popular in late 19th and early 20th century, mainly in conjunction with temperance laws limiting access to alcohol either legally (bans) or economically (excises). Ireland, France, Russia and Poland (both pre-1918 and after gaining independence) are a good examples of areas where ether became very popular, especially among poorer parts of population due to its cost and lack of social stigma related to that getting inebriated. Limitation of alcohol production during the Great War to safeguard food supplies for military use was also a factor. Additionally, unlike opium, cocaine or morphine, ether was not classified as a narcotic neither by Geneva Conventions of 1912 nor by local laws, and thus it was freely available and relatively cheap eve in comparison with alcohol. Its abuse, however, quickly led to bans in 1920s. For example, Polish authorities forbid the sale of ether for consumption in 1925 (meaning it could have been sold only to people with legitimate business needs such as apothecarians, doctors, chemists etc.) and in 1928 ether was legally classified as and addictive drug. As one can expect, this led to surge in ether smuggling, mainly from Germany and Czechoslovakia.
Initially, the form of choice were 'Hoffman drops', sometimes called 'sulphuric ether' (possibly due to pungent smell), a solution of diethyl ether in ethyl alcohol, sold as a general analgesic. It was also quickly noticed that ether increases (prolongs) euphoric effects of alcohol, so this compound was often mixed with alcohol or consumed alongside it to make effects last longer. Today we know that this was a result of the inhibition of alcohol dehydrogenase responsible for metabolisation of ethyl alcohol. According to contemporary sources, in some areas ether consumption was extremely common. For example, in heavily industrialised Upper Silesia ether was consumed by large percentage of students (both adult and underage). It was also popular among miners, what led to establishing a law forbidding people under influence of ether to work in the mines, at least partially due to the fire hazard. According to the survey conducted in 1937 by Michał Wiendlocha, director of the psychiatric hospital in Rybnik, prevalence of ether consumption in the area was roughly 30%, but in some villages could reach 90%, meaning that popularity of ether surpassed even that of alcohol (with the two usually being the only recreational drugs used by Silesian villagers). The reasons already discussed (unpleasant odor and high flammability, as well as an association with lower classes and addicts) made ether unpopular among higher socio-economic strata of society.