How to encode orthogonal matrix using Huffman?

I have orthogonal matrix and I want to encode it using Huffman but apparently it takes ages and may not succeed, I don't want to quantize the matrix, is there any other way to encode that matrix ?

[Walter Roberson]

How big is the matrix, and what data type is it? Are the values complex? Are they restricted to 0 and 1 (a permutation matrix) ?