Right now, I’ve semi solved the problem by adding a script in cron.d to restore the necessary ip on reboot. I posted my configs on Linode support forum:
I still don’t understand why it didn’t work on first reboot after running sudo mailinabox but restores IP correctly on second reboot.