Well, addiction, while not specifically mentioned by Christ, just as in the case of sexual immorality, can and often does, in severe cases, destroy the marriage. How? Usually because the addiction causes a man or woman to do violence to their spouse, either physically or spiritually, but oftentimes both. In such a case (you would realize it eventually if you were a victim of it) the perpetrator of the violence to the marriage has clearly chosen not to be married to their victim, but rather they have chosen to be in a committed, mostly assuredly permanent relationship (marriage) with the object(s) of their addiction. They have already initiated and chosen to be unmarried to their spouse. It may be chosen by a woman, however, and for example, to remain in such a marriage even though her husband may end up killing her in some way, either directly or indirectly (and we have a saint to whom this actually happened). But, if the woman has children to care for, then her martyria ought probably not be accepted by her for the sake of her children. So divorce, in this case, might be found more acceptable to a bishop, because it's reasonable for us to accept that no mother would be willing to risk allowing a violent and irresponsible man to destroy her children, after destroying her so that she will no longer be around to protect them.
A bishop will probably tell us that Holy Matrimony is Sacramental, because it has a "salvific" grace. They will probably also tell us, however, that sometimes addiction to sin destroys the marriage so that it can no longer be salvific, or henceforth made to be salvific, and for that reason the salvific union has ceased to be, and can never afterwards be salvific: the Sacrament is no longer nor ever will be present because not only have the two who were joined become too broken through sins to be fixed, but the marital union itself is even more hopelessly broken than the two sinners combined. So, if no longer salvific, then there's no longer an imperative to keep the failed union in tact. Bishops of the antiquated Byzantium Church, I've been informed, were conducting divorces of Orthodox people basically throughout its history, and we don't know all the details leading to all such divorces, we would have to ask them what led them to their decision to permit these divorces, but there were probably other reasons besides adultery. Repenting, with forgiving and loving is one thing. Continuing to share a house or a life with a person whose sins have destroyed the sacramental union beyond repair (and this is the basis upon which bishops grant divorces) is quite another. If someone wants to remain married to such a person while living separately in celibacy then whose to stop them? Nobody. My mother-in-law kicked her husband out decades ago because of his hopeless addiction to alcohol. They never divorced and she will never remarry, even though her husband died decades ago. But they were older and the kids were all grown at that point. Some people, for all I know, may have gone on to join monastic communities without ever divorcing. I don't know. I think it would be good for any of us who find ourselves unmarried, and not otherwise committed or relied upon for supporting other people or kids in essential ways, to enter into the monastic life as soon as we are able, so long as we are found to be fit for that way of life. But Pardon my digression.
I once read an account of the life of a spiritual father who was Ethiopian, or Egyptian, who is also a saint, who had left his wife to live the solitary life. The wife was not complicit with his leaving her, and tried in every way, through argument and persuasion related to household duties, and then through other compelling social pressures to prevent him from walking away from their marriage to become a monastic, but he would not be deterred. If this life of the saint is true, then perhaps some may conclude that salvation, what should be our greatest concern, is always at stake, and if a marriage is as such that it will most assuredly lead to damnation rather than salvation, then a separation or a divorce could very well be the better choice. I think that's why a bishop will sometimes recognize a basis for a divorce. Are there abuses? I'm sure there are, just as you know that there are based on what you've witnessed. It's a slippery slope that's been created for sure, but slippery slopes have always been par for this course, especially as of late. They will ultimately lead us down so low in the pit that it will permit Antichrist to rise above us, which as we know is a prophecy of Scripture so it must be fulfilled.
With regards to the insistence on relying solely upon Scripture and evidence found in the writings of the Church fathers, I think it might be important to be aware that, to begin with, there isn't a whole lot of Scriptural or patristic support for the Orthodox view of Holy Matrimony vs the heterodox views. In the Orthodox view, death does not end Holy Matrimony, which endures eternally in the Kingdom of God. Christ's own words about marriage are usually interpreted to mean that there will be no such thing as the union of Holy Matrimony in the Kingdom of God. There doesn't seem to be, to my knowledge, a strong patristic consensus supporting the Orthodox view either. St. John Chrysostom is the strongest proponent of the belief in the eternal union of a husband and wife. He wrote his famous letter to a widow, insisting that she not remarry, but remain faithful to the union of Holy Matrimony that she had with her deceased husband, so that they could remain forever as husband and wife in the Kingdom of God. Remarrying, according to St. John, would be the only thing that would prevent the eternal continuation of her first marriage. Other than this, I don't think there is much patristic support for Orthodox belief. If you know of any, please share. But regardless, it's our Holy Tradition to idealize Holy Matrimony to the extent that we give it a place in God's Kingdom. This great reverence of Matrimony is shown by our canons that do not allow the clergy to remarry if they are widowed, because to do so would be to bring the Matrimony to an end, and the only worse thing that could happen to a married couple in Christ, we might suppose, is for them to lose their salvation. Salvation (Christ) is first. After that, marriage.
Just to mention, I haven't listened to any of the AFR podcast, so I don't have any opinion about it. For all I know it's garbage. But Christ did not say that there wouldn't be divorces. He merely reminds us that "in the beginning it was not so". It was not meant to be, and therefore divorce, like murder, is not according to the will of God. In paradise, there was no death. Adam and Eve are regarded by Christ as husband and wife. If they had not fallen and died, would they be husband and wife eternally? Or was that union only ever meant to be temporary? Will the Kingdom of God dissolve the union of husbands and wives at the time of the last judgement? Is it dissolved by death of one or another of the married couple as taught in heterodoxy? God does not will for divorces to happen. But God doesn't will for anything evil to happen, yet it happens just the same. Even people who should be Orthodox Christians in practice commit murder and all sorts of other crimes. So while we may insist that divorce not be allowed, just as Christ insisted that it not be practiced, it's being practiced nonetheless, and there isn't a whole lot that anyone will be able to do anything to stop. The best we could do is to remind people that divorce is not God's will. They'll probably get divorced anyway, and if the Church tolerates it not, then they will also divorce themselves from Church membership altogether. So the Church tolerates divorcees. It's not a perfect world here in the Orthodox Church. Every once and a while, grace abounds and some who have been joined in the Mystery of Holy Matrimony, by the grace of God, remain married forever. It might be a good idea to rejoice in this good and beautiful thing and to celebrate it vigorously and joyously when it happens, so that those considering divorce may be given ample reasons and opportunities to consider otherwise.