|
| 1 | +<!--- |
| 2 | +Licensed to the Apache Software Foundation (ASF) under one |
| 3 | +or more contributor license agreements. See the NOTICE file |
| 4 | +distributed with this work for additional information |
| 5 | +regarding copyright ownership. The ASF licenses this file |
| 6 | +to you under the Apache License, Version 2.0 (the |
| 7 | +"License"); you may not use this file except in compliance |
| 8 | +with the License. You may obtain a copy of the License at |
| 9 | +
|
| 10 | + http://www.apache.org/licenses/LICENSE-2.0 |
| 11 | +
|
| 12 | +Unless required by applicable law or agreed to in writing, software |
| 13 | +distributed under the License is distributed on an "AS IS" BASIS, |
| 14 | +WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 15 | +See the License for the specific language governing permissions and |
| 16 | +limitations under the License. |
| 17 | +--> |
| 18 | + |
1 | 19 | # HBase Changelog
|
2 | 20 |
|
3 |
| -<!--- |
4 |
| -# Licensed to the Apache Software Foundation (ASF) under one |
5 |
| -# or more contributor license agreements. See the NOTICE file |
6 |
| -# distributed with this work for additional information |
7 |
| -# regarding copyright ownership. The ASF licenses this file |
8 |
| -# to you under the Apache License, Version 2.0 (the |
9 |
| -# "License"); you may not use this file except in compliance |
10 |
| -# with the License. You may obtain a copy of the License at |
11 |
| -# |
12 |
| -# http://www.apache.org/licenses/LICENSE-2.0 |
13 |
| -# |
14 |
| -# Unless required by applicable law or agreed to in writing, software |
15 |
| -# distributed under the License is distributed on an "AS IS" BASIS, |
16 |
| -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
17 |
| -# See the License for the specific language governing permissions and |
18 |
| -# limitations under the License. |
19 |
| -
|
20 |
| -# Be careful doing manual edits in this file. Do not change format |
21 |
| -# of release header or remove the below marker. This file is generated. |
22 |
| -# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!--> |
23 |
| -## Release connector-1.0.0 - Unreleased (as of 2019-04-23) |
| 21 | +## Release connector-1.0.0 - Unreleased (as of 2019-04-26) |
24 | 22 |
|
25 | 23 |
|
26 | 24 |
|
27 | 25 | ### NEW FEATURES:
|
28 | 26 |
|
29 | 27 | | JIRA | Summary | Priority | Component |
|
30 | 28 | |:---- |:---- | :--- |:---- |
|
31 |
| -| [HBASE-15320](https://issues.apache.org/jira/browse/HBASE-15320) | HBase connector for Kafka Connect | Major | Replication | |
| 29 | +| [HBASE-13992](https://issues.apache.org/jira/browse/HBASE-13992) | Integrate SparkOnHBase into HBase | Major | hbase-connectors, spark | |
| 30 | +| [HBASE-14150](https://issues.apache.org/jira/browse/HBASE-14150) | Add BulkLoad functionality to HBase-Spark Module | Major | hbase-connectors, spark | |
| 31 | +| [HBASE-14181](https://issues.apache.org/jira/browse/HBASE-14181) | Add Spark DataFrame DataSource to HBase-Spark Module | Minor | hbase-connectors, spark | |
| 32 | +| [HBASE-14340](https://issues.apache.org/jira/browse/HBASE-14340) | Add second bulk load option to Spark Bulk Load to send puts as the value | Minor | hbase-connectors, spark | |
| 33 | +| [HBASE-14849](https://issues.apache.org/jira/browse/HBASE-14849) | Add option to set block cache to false on SparkSQL executions | Major | hbase-connectors, spark | |
| 34 | +| [HBASE-15572](https://issues.apache.org/jira/browse/HBASE-15572) | Adding optional timestamp semantics to HBase-Spark | Major | hbase-connectors, spark | |
| 35 | +| [HBASE-17933](https://issues.apache.org/jira/browse/HBASE-17933) | [hbase-spark] Support Java api for bulkload | Major | hbase-connectors, spark | |
| 36 | +| [HBASE-15320](https://issues.apache.org/jira/browse/HBASE-15320) | HBase connector for Kafka Connect | Major | hbase-connectors, Replication | |
32 | 37 |
|
33 | 38 |
|
34 | 39 | ### IMPROVEMENTS:
|
35 | 40 |
|
36 | 41 | | JIRA | Summary | Priority | Component |
|
37 | 42 | |:---- |:---- | :--- |:---- |
|
| 43 | +| [HBASE-14515](https://issues.apache.org/jira/browse/HBASE-14515) | Allow spark module unit tests to be skipped with a profile | Minor | build, hbase-connectors, spark | |
| 44 | +| [HBASE-14158](https://issues.apache.org/jira/browse/HBASE-14158) | Add documentation for Initial Release for HBase-Spark Module integration | Major | documentation, hbase-connectors, spark | |
| 45 | +| [HBASE-14159](https://issues.apache.org/jira/browse/HBASE-14159) | Resolve warning introduced by HBase-Spark module | Minor | build, hbase-connectors, spark | |
| 46 | +| [HBASE-15434](https://issues.apache.org/jira/browse/HBASE-15434) | [findbugs] Exclude scala generated source and protobuf generated code in hbase-spark module | Major | hbase-connectors, spark | |
| 47 | +| [HBASE-16638](https://issues.apache.org/jira/browse/HBASE-16638) | Reduce the number of Connection's created in classes of hbase-spark module | Critical | hbase-connectors, spark | |
| 48 | +| [HBASE-16823](https://issues.apache.org/jira/browse/HBASE-16823) | Add examples in HBase Spark module | Major | hbase-connectors, spark | |
| 49 | +| [HBASE-17549](https://issues.apache.org/jira/browse/HBASE-17549) | HBase-Spark Module : Incorrect log at println and unwanted comment code | Major | hbase-connectors, spark | |
| 50 | +| [HBASE-18176](https://issues.apache.org/jira/browse/HBASE-18176) | add enforcer rule to make sure hbase-spark / scala aren't dependencies of unexpected modules | Major | build, hbase-connectors, spark | |
38 | 51 | | [HBASE-21491](https://issues.apache.org/jira/browse/HBASE-21491) | [hbase-connectors] Edit on spark connector README | Trivial | hbase-connectors |
|
39 | 52 | | [HBASE-21841](https://issues.apache.org/jira/browse/HBASE-21841) | Allow inserting null values throw DataSource API | Major | spark |
|
40 | 53 | | [HBASE-21880](https://issues.apache.org/jira/browse/HBASE-21880) | [hbase-connectors] clean up site target | Minor | hbase-connectors |
|
41 | 54 | | [HBASE-21842](https://issues.apache.org/jira/browse/HBASE-21842) | Properly use flatten-maven-plugin in hbase-connectors | Major | hbase-connectors |
|
42 | 55 | | [HBASE-21931](https://issues.apache.org/jira/browse/HBASE-21931) | [hbase-connectors] Bump surefire version | Major | hbase-connectors |
|
| 56 | +| [HBASE-14789](https://issues.apache.org/jira/browse/HBASE-14789) | Enhance the current spark-hbase connector | Major | hbase-connectors, spark | |
43 | 57 |
|
44 | 58 |
|
45 | 59 | ### BUG FIXES:
|
46 | 60 |
|
47 | 61 | | JIRA | Summary | Priority | Component |
|
48 | 62 | |:---- |:---- | :--- |:---- |
|
| 63 | +| [HBASE-14377](https://issues.apache.org/jira/browse/HBASE-14377) | JavaHBaseContextSuite not being run | Critical | hbase-connectors, spark | |
| 64 | +| [HBASE-14406](https://issues.apache.org/jira/browse/HBASE-14406) | The dataframe datasource filter is wrong, and will result in data loss or unexpected behavior | Blocker | hbase-connectors, spark | |
| 65 | +| [HBASE-15184](https://issues.apache.org/jira/browse/HBASE-15184) | SparkSQL Scan operation doesn't work on kerberos cluster | Critical | hbase-connectors, spark | |
| 66 | +| [HBASE-16804](https://issues.apache.org/jira/browse/HBASE-16804) | JavaHBaseContext.streamBulkGet is void but should be JavaDStream | Major | hbase-connectors, spark | |
| 67 | +| [HBASE-17547](https://issues.apache.org/jira/browse/HBASE-17547) | HBase-Spark Module : TableCatelog doesn't support multiple columns from Single Column family | Major | hbase-connectors, spark | |
| 68 | +| [HBASE-17574](https://issues.apache.org/jira/browse/HBASE-17574) | Clean up how to run tests under hbase-spark module | Major | hbase-connectors, spark | |
| 69 | +| [HBASE-15597](https://issues.apache.org/jira/browse/HBASE-15597) | Clean up configuration keys used in hbase-spark module | Critical | hbase-connectors, spark | |
| 70 | +| [HBASE-17909](https://issues.apache.org/jira/browse/HBASE-17909) | Redundant exclusion of jruby-complete in pom of hbase-spark | Minor | hbase-connectors, spark | |
| 71 | +| [HBASE-17546](https://issues.apache.org/jira/browse/HBASE-17546) | Incorrect syntax at HBase-Spark Module Examples | Minor | hbase-connectors, spark | |
| 72 | +| [HBASE-19387](https://issues.apache.org/jira/browse/HBASE-19387) | HBase-spark snappy.SnappyError on Arm64 | Minor | hbase-connectors, spark, test | |
| 73 | +| [HBASE-16179](https://issues.apache.org/jira/browse/HBASE-16179) | Fix compilation errors when building hbase-spark against Spark 2.0 | Critical | hbase-connectors, spark | |
| 74 | +| [HBASE-20124](https://issues.apache.org/jira/browse/HBASE-20124) | Make hbase-spark module work with hadoop3 | Major | dependencies, hadoop3, hbase-connectors, spark | |
| 75 | +| [HBASE-20177](https://issues.apache.org/jira/browse/HBASE-20177) | Fix warning: Class org.apache.hadoop.minikdc.MiniKdc not found in hbase-spark | Minor | hbase-connectors | |
| 76 | +| [HBASE-20375](https://issues.apache.org/jira/browse/HBASE-20375) | Remove use of getCurrentUserCredentials in hbase-spark module | Major | hbase-connectors, spark | |
| 77 | +| [HBASE-20880](https://issues.apache.org/jira/browse/HBASE-20880) | Fix for warning It would fail on the following input in hbase-spark | Minor | hbase-connectors | |
| 78 | +| [HBASE-21038](https://issues.apache.org/jira/browse/HBASE-21038) | SAXParseException when hbase.spark.use.hbasecontext=false | Major | hbase-connectors | |
| 79 | +| [HBASE-20175](https://issues.apache.org/jira/browse/HBASE-20175) | hbase-spark needs scala dependency convergance | Major | dependencies, hbase-connectors, spark | |
49 | 80 | | [HBASE-21429](https://issues.apache.org/jira/browse/HBASE-21429) | [hbase-connectors] pom refactoring adding kafka dir intermediary | Minor | hbase-connectors, kafka |
|
50 | 81 | | [HBASE-21431](https://issues.apache.org/jira/browse/HBASE-21431) | [hbase-connectors] Fix build and test issues | Blocker | hbase-connectors |
|
51 | 82 | | [HBASE-21434](https://issues.apache.org/jira/browse/HBASE-21434) | [hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version | Major | hbase-connectors, kafka |
|
52 | 83 | | [HBASE-21446](https://issues.apache.org/jira/browse/HBASE-21446) | [hbase-connectors] Update spark and scala versions; add some doc on how to generate artifacts with different versions | Major | hbase-connectors, spark |
|
53 | 84 | | [HBASE-21448](https://issues.apache.org/jira/browse/HBASE-21448) | [hbase-connectors] Make compile/tests pass on scala 2.10 AND 2.11 | Major | hbase-connectors, spark |
|
54 | 85 | | [HBASE-21878](https://issues.apache.org/jira/browse/HBASE-21878) | [hbase-connectors] Fix hbase-checkstyle version reference | Critical | hbase-connectors |
|
55 | 86 | | [HBASE-21923](https://issues.apache.org/jira/browse/HBASE-21923) | [hbase-connectors] Make apache-rat pass | Critical | hbase-connectors |
|
| 87 | +| [HBASE-21450](https://issues.apache.org/jira/browse/HBASE-21450) | [documentation] Point spark doc at hbase-connectors spark | Major | documentation, hbase-connectors, spark | |
| 88 | + |
| 89 | + |
| 90 | +### TESTS: |
| 91 | + |
| 92 | +| JIRA | Summary | Priority | Component | |
| 93 | +|:---- |:---- | :--- |:---- | |
| 94 | +| [HBASE-18175](https://issues.apache.org/jira/browse/HBASE-18175) | Add hbase-spark integration test into hbase-spark-it | Critical | hbase-connectors, spark | |
| 95 | +| [HBASE-20176](https://issues.apache.org/jira/browse/HBASE-20176) | Fix warnings about Logging import in hbase-spark test code | Minor | hbase-connectors | |
56 | 96 |
|
57 | 97 |
|
58 | 98 | ### SUB-TASKS:
|
59 | 99 |
|
60 | 100 | | JIRA | Summary | Priority | Component |
|
61 | 101 | |:---- |:---- | :--- |:---- |
|
| 102 | +| [HBASE-15336](https://issues.apache.org/jira/browse/HBASE-15336) | Support Dataframe writer to the spark connector | Major | hbase-connectors, spark | |
| 103 | +| [HBASE-15333](https://issues.apache.org/jira/browse/HBASE-15333) | [hbase-spark] Enhance dataframe filters to handle naively encoded short, integer, long, float and double | Major | hbase-connectors, spark | |
| 104 | +| [HBASE-15473](https://issues.apache.org/jira/browse/HBASE-15473) | Documentation for the usage of hbase dataframe user api (JSON, Avro, etc) | Blocker | documentation, hbase-connectors, spark | |
| 105 | +| [HBASE-19482](https://issues.apache.org/jira/browse/HBASE-19482) | Fix Checkstyle errors in hbase-spark-it | Minor | hbase-connectors | |
| 106 | +| [HBASE-19597](https://issues.apache.org/jira/browse/HBASE-19597) | Fix Checkstyle errors in hbase-spark | Minor | hbase-connectors, spark | |
62 | 107 | | [HBASE-21002](https://issues.apache.org/jira/browse/HBASE-21002) | Create assembly and scripts to start Kafka Proxy | Minor | hbase-connectors |
|
63 | 108 | | [HBASE-21435](https://issues.apache.org/jira/browse/HBASE-21435) | [hbase-connectors] Cleanup of kafka dependencies; clarify hadoop version; addendum | Minor | hbase-connectors, kafka |
|
64 | 109 |
|
|
67 | 112 |
|
68 | 113 | | JIRA | Summary | Priority | Component |
|
69 | 114 | |:---- |:---- | :--- |:---- |
|
| 115 | +| [HBASE-14184](https://issues.apache.org/jira/browse/HBASE-14184) | Fix indention and typo in JavaHBaseContext | Minor | hbase-connectors, spark | |
| 116 | +| [HBASE-21022](https://issues.apache.org/jira/browse/HBASE-21022) | Review kafka-connection repo's POMs | Major | hbase-connectors, kafka | |
| 117 | +| [HBASE-20257](https://issues.apache.org/jira/browse/HBASE-20257) | hbase-spark should not depend on com.google.code.findbugs.jsr305 | Minor | build, hbase-connectors, spark | |
| 118 | +| [HBASE-21273](https://issues.apache.org/jira/browse/HBASE-21273) | Move classes out of org.apache.spark namespace | Major | hbase-connectors, spark | |
70 | 119 | | [HBASE-21432](https://issues.apache.org/jira/browse/HBASE-21432) | [hbase-connectors] Add Apache Yetus integration for hbase-connectors repository | Major | build, hbase-connectors |
|
71 | 120 | | [HBASE-22221](https://issues.apache.org/jira/browse/HBASE-22221) | Extend kafka-proxy documentation with required hbase settings | Major | hbase-connectors |
|
72 | 121 | | [HBASE-22210](https://issues.apache.org/jira/browse/HBASE-22210) | Fix hbase-connectors-assembly to include every jar | Major | hbase-connectors |
|
|
0 commit comments