Ok, I have decided to fix the problem on my own, so I ordered a Tusq saddle, got it yesterday and installed it. I needed to sand it down quite a bit, both height and thickness. I have the high e at 2mm and the low E at 3mm, all measured at the 12th fret. Then I gave the neck a little tweek and bingo no more buzzing.
I immediately noticed that when sanding the saddle it smelled like bone to me. With it being a plastic I did not expect that. I started sanding and it reminded me of when I use to carve elk antlers.