Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

information of column xxx is not fund #42017

Closed
aytrack opened this issue Mar 8, 2023 · 4 comments
Closed

information of column xxx is not fund #42017

aytrack opened this issue Mar 8, 2023 · 4 comments
Assignees
@tiancaiamao
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. duplicate Issues or pull requests already exists. fuzz/schrddl may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.

Comments

@aytrack
Copy link
Contributor

aytrack commented Mar 8, 2023

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

  1. create table
drop table if exists t1;
create table t1(a int, b int, c int) partition by hash(a) partitions 10;
insert into t1(a, b, c) values (1,2,3), (4,5,6), (7,8,9);
insert into t1(a,b,c) select a, b, c from t1;    --some times
  1. do some update OR delete
delete from t1 limit 1;  -- some times
  1. add column and index with other session while execute dml
 alter table t1 add column d int null default 10;

2. What did you expect to see? (Required)

execute successfully

3. What did you see instead (Required)

[2023/03/08 16:54:33.933 +08:00] [WARN] [session.go:2185] ["compile SQL failed"] [conn=3740839823879963031] [error="information of column test.t1.d is not found"] [SQL="delete from t1 limit 1"]
[2023/03/08 16:54:33.933 +08:00] [INFO] [conn.go:1181] ["command dispatched failed"] [conn=3740839823879963031] [connInfo="id:3740839823879963031, addr:127.0.0.1:55149 status:10, collation:utf8_general_ci, user:root"] [command=Query] [status="inTxn:0, autocommit:1"] [sql= "delete from t1 limit 1"] [txn_mode=PESSIMISTIC] [timestamp=0] [err="information of column test.t1.d is not found
github.com/pingcap/errors.AddStack
	/Users/pingcap/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174
github.com/pingcap/errors.Trace
	/Users/pingcap/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/juju_adaptor.go:15
github.com/pingcap/tidb/planner/core.(*partitionProcessor).reconstructTableColNames
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:334
github.com/pingcap/tidb/planner/core.(*partitionProcessor).processHashPartition
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:340
github.com/pingcap/tidb/planner/core.(*partitionProcessor).prune
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:649
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:72
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:64
github.com/pingcap/tidb/planner/core.logicalOptimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:874
github.com/pingcap/tidb/planner/core.DoOptimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:285
github.com/pingcap/tidb/planner/core.(*PlanBuilder).buildDelete
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/logical_plan_builder.go:5889
github.com/pingcap/tidb/planner/core.(*PlanBuilder).Build
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/planbuilder.go:775
github.com/pingcap/tidb/planner.buildLogicalPlan
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:461
github.com/pingcap/tidb/planner.optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:382
github.com/pingcap/tidb/planner.Optimize
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:245
github.com/pingcap/tidb/executor.(*Compiler).Compile
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/executor/compiler.go:116
github.com/pingcap/tidb/session.(*session).ExecuteStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/session/session.go:2173
github.com/pingcap/tidb/server.(*TiDBContext).ExecuteStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/driver_tidb.go:247
github.com/pingcap/tidb/server.(*clientConn).handleStmt
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:2122
github.com/pingcap/tidb/server.(*clientConn).handleQuery
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1972
github.com/pingcap/tidb/server.(*clientConn).dispatch
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1403
github.com/pingcap/tidb/server.(*clientConn).Run
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1152
github.com/pingcap/tidb/server.(*Server).onConn
	/Users/pingcap/workspace/build-common/go/src/github.com/pingcap/tidb/server/server.go:646
runtime.goexit
	/usr/local/go1.19.5/src/runtime/asm_arm64.s:1172"]

4. What is your TiDB version? (Required)

[16:57:52]TiDB root:test> select tidb_version();
+-----------------------------------------------------------+
| tidb_version()                                            |
+-----------------------------------------------------------+
| Release Version: v6.5.1                                   |
| Edition: Community                                        |
| Git Commit Hash: 9a3f362639ddeb837246fd9f5d821f49d495b516 |
| Git Branch: heads/refs/tags/v6.5.1                        |
| UTC Build Time: 2023-03-03 12:51:29                       |
| GoVersion: go1.19.5                                       |
| Race Enabled: false                                       |
| TiKV Min Version: 6.2.0-alpha                             |
| Check Table Before Drop: false                            |
| Store: tikv                                               |
+-----------------------------------------------------------+
1 row in set
@aytrack aytrack added type/bug The issue is confirmed as a bug. fuzz/schrddl severity/major labels Mar 8, 2023
@ti-chi-bot ti-chi-bot added may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 labels Mar 8, 2023
@aytrack aytrack added sig/sql-infra SIG: SQL Infra affects-6.5 This bug affects the 6.5.x(LTS) versions. labels Mar 8, 2023
@tiancaiamao
Copy link
Contributor

Root cause is the same with #41622

@tiancaiamao tiancaiamao added the duplicate Issues or pull requests already exists. label Mar 16, 2023
@aytrack
Copy link
Contributor Author

aytrack commented Apr 13, 2023

Since v6.5.2-pre has the fix pr #42027, but it still can reproduce in the fuzz test.
The error stack is same with the issue descirbe but I can't reproduce it with the issue step. It maybe another issue.
so reopen this issue @tiancaiamao

[2023/04/13 07:43:01.216 +08:00] [WARN] [session.go:2184] ["compile SQL failed"] [conn=6589672252424323851] [error="information of column test.d4b38bf1.252e3907 is not found"] [SQL="delete from `d4b38bf1` where `d4b38bf1`.`b49d3b99` in ( 4790.6679297484925 ,9504.339305142064 ,2051.1826176062823 ,5707.99414964935 ) "]
[2023/04/13 07:43:01.216 +08:00] [INFO] [conn.go:1181] ["command dispatched failed"] [conn=6589672252424323851] [connInfo="id:6589672252424323851, addr:10.233.80.42:45092 status:10, collation:utf8mb4_general_ci, user:root"] [command=Query] [status="inTxn:0, autocommit:1"] [sql="delete from `d4b38bf1` where `d4b38bf1`.`b49d3b99` in ( 4790.6679297484925 ,9504.339305142064 ,2051.1826176062823 ,5707.99414964935 ) "] [txn_mode=PESSIMISTIC] [timestamp=0] [err="information of column test.d4b38bf1.252e3907 is not found
github.com/pingcap/errors.AddStack
	/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/errors.go:174
github.com/pingcap/errors.Trace
	/go/pkg/mod/github.com/pingcap/errors@v0.11.5-0.20220729040631-518f63d66278/juju_adaptor.go:15
github.com/pingcap/tidb/planner/core.(*partitionProcessor).reconstructTableColNames
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:334
github.com/pingcap/tidb/planner/core.(*partitionProcessor).processHashPartition
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:340
github.com/pingcap/tidb/planner/core.(*partitionProcessor).prune
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:654
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:72
github.com/pingcap/tidb/planner/core.(*partitionProcessor).rewriteDataSource
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:100
github.com/pingcap/tidb/planner/core.(*partitionProcessor).optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/rule_partition_processor.go:64
github.com/pingcap/tidb/planner/core.logicalOptimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:874
github.com/pingcap/tidb/planner/core.DoOptimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/optimizer.go:285
github.com/pingcap/tidb/planner/core.(*PlanBuilder).buildDelete
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/logical_plan_builder.go:5889
github.com/pingcap/tidb/planner/core.(*PlanBuilder).Build
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/core/planbuilder.go:775
github.com/pingcap/tidb/planner.buildLogicalPlan
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:461
github.com/pingcap/tidb/planner.optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:382
github.com/pingcap/tidb/planner.Optimize
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/planner/optimize.go:245
github.com/pingcap/tidb/executor.(*Compiler).Compile
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/executor/compiler.go:116
github.com/pingcap/tidb/session.(*session).ExecuteStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/session/session.go:2172
github.com/pingcap/tidb/server.(*TiDBContext).ExecuteStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/driver_tidb.go:252
github.com/pingcap/tidb/server.(*clientConn).handleStmt
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:2122
github.com/pingcap/tidb/server.(*clientConn).handleQuery
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1972
github.com/pingcap/tidb/server.(*clientConn).dispatch
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1403
github.com/pingcap/tidb/server.(*clientConn).Run
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/conn.go:1152
github.com/pingcap/tidb/server.(*Server).onConn
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/server/server.go:648
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1594"]

@aytrack aytrack reopened this Apr 13, 2023
@VelocityLight VelocityLight added the affects-7.1 This bug affects the 7.1.x(LTS) versions. label Apr 20, 2023
@tiancaiamao
Copy link
Contributor

Does the master branch still get this error? @aytrack

@ti-chi-bot ti-chi-bot added the affects-7.5 This bug affects the 7.5.x(LTS) versions. label Oct 23, 2023
@tiancaiamao
Copy link
Contributor

I wonder whether do queries during the intemediate DDL state can cause this problem, and still no reproduce.

func TestHashPartitionAddColumn(t *testing.T) {
	store, dom := testkit.CreateMockStoreAndDomain(t)

	tk := testkit.NewTestKit(t, store)
	tk.MustExec("use test")
	tk.MustExec("create table t1(a int, b int, c int) partition by hash(a) partitions 10;")
	tk.MustExec("insert into t1(a, b, c) values (1,2,3), (4,5,6), (7,8,9);")
	for i:=0; i<5; i++ {
		tk.MustExec("insert into t1(a,b,c) select a, b, c from t1;")
	}


	hook := &callback.TestDDLCallback{Do: dom}
	hook.OnJobRunBeforeExported = func(job *model.Job) {
		tk2 := testkit.NewTestKit(t, store)
		tk2.MustExec("use test")
		tk2.MustExec("delete from t1 limit 1 ")
	}
	dom.DDL().SetHook(hook)
	tk.MustExec("alter table t1 add column d int null default 10;")
}

It's a long time after the issue been reported, so I think it's safe to close it if there isn't a stable way to reproduce it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tiancaiamao tiancaiamao

Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. duplicate Issues or pull requests already exists. fuzz/schrddl may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 severity/major sig/sql-infra SIG: SQL Infra type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@tiancaiamao @VelocityLight @aytrack @ti-chi-bot