Describe the bug, including details regarding any error messages, version, and platform.
Using serialize_pandas() in pyarrow to serialize a pandas dataframe to arrow bytes allows for columns with a null name.
However, attempting to deserialize these bytes in the Apache Arrow C# library results in an ArgumentNullException being thrown from the Field constructor with the message Value cannot be null. (Parameter 'name').
If null field names are allowed in the Apache Arrow spec, then this is a bug in the C# library. If they are not allowed, then would this be a bug in pyarrow?
Component(s)
C#, Python
Describe the bug, including details regarding any error messages, version, and platform.
Using
serialize_pandas()in pyarrow to serialize a pandas dataframe to arrow bytes allows for columns with a null name.However, attempting to deserialize these bytes in the Apache Arrow C# library results in an
ArgumentNullExceptionbeing thrown from theFieldconstructor with the messageValue cannot be null. (Parameter 'name').If null field names are allowed in the Apache Arrow spec, then this is a bug in the C# library. If they are not allowed, then would this be a bug in pyarrow?
Component(s)
C#, Python