Skip to content

Conversation

Eshanatnight
Copy link
Contributor

@Eshanatnight Eshanatnight commented Apr 24, 2024

Fixes #774

List of updated crates

  1. arrow-schema = "47.0.0" -> "51.0.0"
  2. arrow-array = "47.0.0" -> "51.0.0"
  3. arrow-json = "47.0.0" -> "51.0.0"
  4. arrow-ipc = "47.0.0" -> "51.0.0"
  5. arrow-select = "47.0.0" -> "51.0.0"
  6. parquet = "47.0.0" -> "51.0.0"
  7. arrow-flight = "47.0.0" -> "51.0.0"
  8. datafusion = "32.0.0" -> "37.1.0"
  9. object_store = "0.7.0" -> "0.9.1"
  10. tonic = "0.10.0" -> "0.11.0"
  11. tonic-web = "0.10.0" -> "0.11.0"
  12. thread-priority = "0.13.1" -> "1.0.0"
  13. zip = "0.6" -> "1.1.1"
  14. sysinfo = "0.29.6" -> "0.30.11"
  15. actix-web = "4.3"-> "4.5.1"
  16. actix-cors = "0.6" -> "0.7.0"
  17. base64 = "0.21" -> "0.22.0"
  18. cookie = "0.17.0" -> "0.18.1"
  19. crossterm = "0.26" -> "0.27.0"
  20. env_logger = "0.10" -> "0.11.3"
  21. hostname = "0.3" -> "0.4.0"
  22. http = "0.2" -> "0.2.7"
  23. itertools = "0.10" -> "0.12.1"
  24. reqwest = "0.11.18" -> "0.11.27"
  25. rustls = "0.20" -> "0.22.4"
  26. rustls-pemfile = "1.0" -> "2.1.2"
  27. uptime_lib = "0.2.2" -> "0.3.0"
  28. openid = "0.12.0" -> "0.14.0"
  29. cargo_toml = "0.15" -> "0.20.1"
  30. rstest = "0.16" -> "0.19.0"

Behavior Changes

arrow now infers null rows by mark existence of a field if it wasn't
known before. This was not done in previous version.

So schema for
{"a": 1,"b": "hello","c": null} is inferred to have all 3 columns ["a": Number, "b": string, "c": null] previously it would have inferred it to
be ["a": Number, "b": String]`

Hence I modified the tests basic_object_with_null_into_rb and
arr_with_null_derive_schema_into_rb (temporary, going forward we should
delete them)

arrow-schema = "47.0.0" -> "51.0.0" arrow-array = "47.0.0" -> "51.0.0" arrow-json = "47.0.0" -> "51.0.0" arrow-ipc = "47.0.0" -> "51.0.0" arrow-select = "47.0.0" -> "51.0.0" parquet = "47.0.0" -> "51.0.0" arrow-flight = "47.0.0" -> "51.0.0" datafusion = "32.0.0" -> "37.1.0" object_store = "0.7.0" -> "0.9.1" tonic = "0.10.0" -> "0.11.0" tonic-web = "0.10.0" -> "0.11.0"
arrow-schema = "47.0.0" -> "51.0.0" arrow-array = "47.0.0" -> "51.0.0" arrow-json = "47.0.0" -> "51.0.0" arrow-ipc = "47.0.0" -> "51.0.0" arrow-select = "47.0.0" -> "51.0.0" parquet = "47.0.0" -> "51.0.0" arrow-flight = "47.0.0" -> "51.0.0" datafusion = "32.0.0" -> "37.1.0" object_store = "0.7.0" -> "0.9.1" tonic = "0.10.0" -> "0.11.0" tonic-web = "0.10.0" -> "0.11.0" thread-priority = "0.13.1" -> "1.0.0" zip = "0.6" -> "1.1.1" sysinfo = "0.29.6" -> "0.30.11"
actix-web = "4.3"-> "4.5.1" actix-cors = "0.6" -> "0.7.0" base64 = "0.21" -> "0.22.0" cookie = "0.17.0" -> "0.18.1" crossterm = "0.26" -> "0.27.0" env_logger = "0.10" -> "0.11.3" hostname = "0.3" -> "0.4.0" http = "0.2" -> "0.2.7" itertools = "0.10" -> "0.12.1" reqwest = "0.11.18" -> "0.11.27" rustls = "0.20" -> "0.22.4" rustls-pemfile = "1.0" -> "2.1.2" uptime_lib = "0.2.2" -> "0.3.0" openid = "0.12.0" -> "0.14.0" cargo_toml = "0.15" -> "0.20.1" rstest = "0.16" -> "0.19.0"
arrow now infers null rows by mark existence of a field if it wasn't known before. This was not done in previous version. So schema for `{"a": 1,"b": "hello","c": null}` is inferd to have all 3 columns ["a": Number, "b": string, "c": null] previously it would have infered it to be `["a": Number, "b": String] Hence I modified the tests basic_object_with_null_into_rb and arr_with_null_derive_schema_into_rb (temparary, going forward we should delete them)
@nitisht nitisht merged commit 0190d85 into parseablehq:main Apr 24, 2024
@Eshanatnight Eshanatnight deleted the upgrade-dependencies branch April 24, 2024 15:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants