Have you got a side door?
If not, that would be where I would put my effort.
You can then semi fix ( so large stuff can still pass though, but infrequently used) the double doors and clad the inside with insulation.
That would massively increase both security and heat retention.