Skip to content

Commit 10542a7

Browse files
docs: update upgrade ntoes for 32.0 (#17719) (#17721)
* docs: update upgrade notes for 32.0 * update spelling file * Update docs/release-info/upgrade-notes.md --------- Co-authored-by: 317brian <53799971+317brian@users.noreply.github.com>
1 parent 1d7c0cb commit 10542a7

File tree

2 files changed

+103
-0
lines changed

2 files changed

+103
-0
lines changed

docs/release-info/upgrade-notes.md

+102
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,108 @@ For more information, see [Migration guide: front-coded dictionaries](./migr-fro
3838

3939
If you're already using this feature, you don't need to take any action.
4040

41+
## 32.0.0
42+
43+
### Incompatible changes
44+
45+
### ANSI-SQL compatibility and query results
46+
47+
Support for the configs that let you maintain older behavior that wasn't ANSI-SQL compliant have been removed:
48+
49+
- `druid.generic.useDefaultValueForNull=true`
50+
- `druid.expressions.useStrictBooleans=false`
51+
- `druid.generic.useThreeValueLogicForNativeFilters=false`
52+
53+
They no longer affect your query results. Only SQL-compliant non-legacy behavior is supported now.
54+
55+
If the configs are set to the legacy behavior, Druid services will fail to start.
56+
57+
If you want to continue to get the same results without these settings, you must update your queries or your results will be incorrect after you upgrade.
58+
59+
For more information about how to update your queries, see the [migration guide](https://druid.apache.org/docs/latest/release-info/migr-ansi-sql-null).
60+
61+
[#17568](https://github.com/apache/druid/pull/17568) [#17609](https://github.com/apache/druid/pull/17609)
62+
63+
### Java support
64+
65+
Java support in Druid has been updated:
66+
67+
- Java 8 support has been removed
68+
- Java 11 support is deprecated
69+
70+
We recommend that you upgrade to Java 17.
71+
72+
[#17466](https://github.com/apache/druid/pull/17466)
73+
74+
### Javascript support
75+
76+
- Javascript tiered broker selector strategy and Javascript filters currently do not work on Java 17.
77+
78+
### Deprecations
79+
80+
### Hadoop-based ingestion
81+
82+
Hadoop-based ingestion is now deprecated. We recommend that you migrate to SQL-based ingestion.
83+
84+
## 31.0.0
85+
86+
### Upgrade notes
87+
88+
#### Array ingest mode now defaults to array
89+
90+
The SQL-based ingestion query context flag `arrayIngestMode` now defaults to `array` instead of `mvd`. This means that SQL `VARCHAR ARRAY` types is no longer implicitly translated and stored in `VARCHAR` columns, but is instead stored as `VARCHAR ARRAY`. This change permits other array types such as `BIGINT ARRAY` and `DOUBLE ARRAY` to be inserted with MSQ task engine into their respective array column types instead of failing as they do in `mvd` mode.
91+
92+
To continue to store multi-value strings, modify any insert/replace queries to wrap the array types with the `ARRAY_TO_MV` operator.
93+
94+
Validation is in place to prevent mixing `VARCHAR` and `VARCHAR ARRAY` columns in the same table, so any ingestions affected by this change will fail and provide a descriptive error message instead of exhibiting unexpected behavior.
95+
96+
The `arrayIngestMode` option of `none` has been removed. It was introduced prior to the table validation logic as a means for cluster operators to force query writers to explicitly set `array` or `mvd` on their query contexts, but provides little utility in Druid 31.
97+
98+
See the following topics for more information:
99+
* [Ingest multi-value dimensions](https://druid.apache.org/docs/latest/querying/multi-value-dimensions.md#sql-based-ingestion) for how to ingest multi-value strings.
100+
* [Ingest arrays](https://druid.apache.org/docs/latest/querying/arrays.md#sql-based-ingestion) for ingesting arrays.
101+
102+
[#16789](https://github.com/apache/druid/pull/16789)
103+
104+
#### Removed task action audit logging
105+
106+
The deprecated task action audit logging has been removed. This change includes the following updates:
107+
108+
- The endpoint `/indexer/v1/task/{taskId}/segments` is no longer supported.
109+
- Druid doesn't write to or read from the metadata table `druid_taskLog`.
110+
- Druid ignores the property `druid.indexer.auditlog.enabled`.
111+
- Druid doesn't emit the metric `task/action/log/time`.
112+
113+
These changes are backward compatible with all existing metadata storage extensions.
114+
115+
[#16309](https://github.com/apache/druid/pull/16309)
116+
117+
#### Removed Firehose and FirehoseFactory
118+
119+
Removed Firehose and FirehoseFactory and remaining implementations.
120+
Apache deprecated support for Druid firehoses in version 0.17. Support for firehose ingestion was removed in version 26.0.
121+
122+
[#16758](https://github.com/apache/druid/pull/16758)
123+
124+
### Incompatible changes
125+
126+
#### Removed the scan query legacy mode
127+
128+
The native scan query legacy mode has been removed. It was introduced in Druid 0.11 to maintain compatibility during an upgrade from older versions of Druid where the scan query was part of a `contrib` extension.
129+
130+
[#16659](https://github.com/apache/druid/pull/16659)
131+
132+
Hard-coded `"legacy":false` following removal of the legacy mode to prevent error during rolling upgrades or downgrades.
133+
134+
[#16793](https://github.com/apache/druid/pull/16793)
135+
136+
#### ZK-based segment loading
137+
138+
ZK-based segment loading is now disabled. ZK `servedSegmentsPath` was deprecated in Druid 0.7.1. This legacy path has been replaced by `liveSegmentsPath`.
139+
140+
Segment-serving processes such as Peons, Historicals and Indexers no longer create ZK `loadQueuePath` entries. The `druid.zk.paths.loadQueuePath` and `druid.zk.paths.servedSegmentsPath` properties are no longer used.
141+
142+
Move to HTTP-based segment loading first and then perform the version upgrade.
41143
## 30.0.0
42144

43145
### Upgrade notes

website/.spelling

+1
Original file line numberDiff line numberDiff line change
@@ -348,6 +348,7 @@ filterColumn
348348
filterValue
349349
firefox
350350
firehose
351+
FirehoseFactory
351352
firehoses
352353
FireHydrant
353354
fromPigAvroStorage

0 commit comments

Comments
 (0)