Hi,
I'm from the VFX field. We generally use https://github.com/openexr/openexr/tree/master/IlmBase/Imath because well, it is awesome. BUt it isn't designed for max performance, rather just usefulness and correctness. I'd suggest porting some of the advanced functionality and classes across to this library.
Best regards,
Ben Houston