You don't mention how much you drink, or for how long you have been drinking. Most people know that excessive alcohol intake can cause brain damage including memory damage ; but some people are unusually sensitive to ill-effects from drinking aochol ( eg the Alcohol Intolerance Syndrome) and get such ill-effects at much lower doses. Can't you get by on 2 glasses of wine a session ?
And someone pointed out that the number of glasses of wine referred to in advice on how much drinking is excessive or gives too high a level for drunk-driving issues, is now inacuratem as many bars are serving larger glasses of wine, some amounting to around 1/3 of a bottle, rather than the much smaller glasses that were usual when the guidelines were laid down.