I'm not asking about vacations. But would a peasant have any time in the week to stop by a friends house or stop by the tavern after a long week?
By all means, yes. The concept of 'weekend' is intrinsic to Christianity and Judaism, with the Sunday and Saturday being respectively considered 'holy days', during which adherents should abstain from work. As we're speaking about 13th-15th century Europe, we can safely assume that all constituent regions of the latter are well-christianized with the possible exception of northern Lithuanian lands (still pagan) and Spain (largely Muslim) in the earlier part of the discussed period. Thus, our average Medieval peasants had a good grasp of a 'weekend' as according to the local customs, on every 7th day he was supposed to rest, abstain from any hard work and attend necessary religious ceremonies, although as contemporary sources suggest, the latter requirement was usually paid only lip service to. The notion that Sunday should be a day of rest and prayer is evident in early ecclesiastical regulations, as Canon 28. of the Council of Orleans in 511 explicitly stated that people should abstain from work on Sunday, unless absolutely necessary. Similarly, Council of Auxerre in 578 in Canon 16. stated that it is not allowed to 'yoke up the oxen on the Lord's day or perform other work'. Council of Macon in 585 also forbade not only work on Sunday but also attending legal matters or collecting taxes and fines (which were considered work).
This said, we must also remember that besides Sundays (Lord's Days) there were also numerous holidays, usually related to various patron saints and ecclesiastical observances. The number and character of these varied between times and places, but for example in 1422, bishop of PoznaĆ (Western Poland), published a list of the Church holidays equal to Sunday (meaning that people should abstain from work and attend church service) that numbered 45, what with about 52 Sundays, was giving almost 100 days per year when people could rest. List of holidays and observances in the Teutonic Order in 14th and 15th centuries also gives a similar numbers.
Now, we must remember, that in case of peasants, i.e. agricultural workers, there is usually no such thing as 'work-free days' as some chores has to be taken daily or whenever necessary, because nature has very little regards to human culture and cows need to be milked if necessary, or food has to be prepared, Sunday or not. But in general, Sunday was a day of rest and peasants were very unlikely to be asked by their lord to perform some works they were obliged to do according to the feudal rent agreement. On the other hand, it has to be stressed, that free tenants were not employees of their lords, but rather private entrepreneurs who were renting their land in exchange for specified amount of money, goods or work (often all three). This meant that peasants did not have any kind of work schedule and could work as much or as little as they pleased, provided they did enough to secure sustenance for themselves and pay all due obligations to the landowner, what, with rather primitive technology and small size of villages was usually quite a lot. To sum it up, if an average peasant finished all his chores for a day, he was free to do anything they wanted. The same applied to urban master craftsmen who were working whenever they had commissions and did not report to anyone, although they could not afford to be lazy, as city life meant expenses and people unable to meet them could have lost their citizen status. So they usually worked whenever possible.
If a peasant was unable to go to a tavern on Sunday, it was usually due to lack of such establishment in a village, as this is much later concept, quite rare in Middle Ages, as discussed in these threads. Then again, some villagers were producing beer, ale or similar products and were selling them at a small profit margin, with their homesteads serving as a centre of meetings for the locals. Also, all important events (important holidays [often being a blatant remnants of old pagan beliefs], weddings, funerals, christenings, end of harvest etc.) were usually a communal events, where all or a majority peasants in a village were pitching in and celebrated with dance, music and general revelry. Given the aforementioned primitive technology, preparation required time, so it is safe to assume that it was a day-long celebration, and thus usually conducted during the holidays, so they won't interfere with required work.