As per the comments in dotnet/coreclr#19999, we should update the managed DoubleToNum implementation to directly use fixed-sized buffers and also update the DiyFp class to no longer use properties, and to just directly expose the fields (since it is an internal type).