pingcap/tidb-lightning issues and pull requests

#571 - README: display a notice that the repository has been moved

Pull Request - State: closed - Opened by kennytm almost 4 years ago
Labels: status/LGT2

#570 - config: make lint happy

Pull Request - State: closed - Opened by jackysp almost 4 years ago - 2 comments

#569 - Add progress bar and the final result(pass or failed) in command output

Issue - State: open - Opened by Tammyxia almost 4 years ago
Labels: feature-request

#568 - metrics/grafana: add uid

Pull Request - State: closed - Opened by 9547 almost 4 years ago - 7 comments
Labels: first-time-contributor

#567 - test: fix ssl key ca name

Pull Request - State: closed - Opened by glorv almost 4 years ago - 1 comment
Labels: status/LGT2

#565 - *: fix lightning arch image address

Pull Request - State: closed - Opened by glorv almost 4 years ago - 3 comments
Labels: status/LGT2, CanMerge

#564 - use system_time_zone to encode kv if tidb set it

Pull Request - State: open - Opened by 3pointer almost 4 years ago - 2 comments

#563 - local backend oom

Issue - State: open - Opened by gozssky almost 4 years ago - 1 comment
Labels: type/bug, severity/major

#562 - tidb-lightning alters the values of timestamp columns

Issue - State: open - Opened by ngocson2vn about 4 years ago - 1 comment
Labels: type/bug, severity/major

#561 - README: add more info

Pull Request - State: closed - Opened by CaitinChen about 4 years ago - 4 comments
Labels: status/LGT2

#560 - backend/local: optimize local writer concurrency and memory usage

Pull Request - State: closed - Opened by glorv about 4 years ago - 3 comments
Labels: status/PTAL

#559 - metrics: use tidb_cluster label get variable values

Pull Request - State: closed - Opened by zjj2wry about 4 years ago - 3 comments
Labels: status/LGT2

#557 - metrics: grafana dashboards support multiple cluster

Pull Request - State: closed - Opened by zjj2wry about 4 years ago - 3 comments

#556 - grafana dashboards support multiple cluster

Pull Request - State: closed - Opened by zjj2wry about 4 years ago - 9 comments
Labels: status/LGT2, CanMerge, 4.0-cherry-pick

#555 - test: fix s3 integration test

Pull Request - State: closed - Opened by glorv about 4 years ago - 3 comments
Labels: status/LGT2, CanMerge

#554 - backend/local: fallback retryIngest to retryWrite

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: CanMerge, status/LGT3

#553 - In the TPC-C test, the following error occurred when using local backend lighting

Issue - State: open - Opened by newHE3DBer about 4 years ago - 1 comment
Labels: type/bug, question

#552 - restore: fail fast when met error in engine/chunk restore

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment

#551 - backend/tidb: temporarily disable the strict-mode value check in tidb backend

Pull Request - State: closed - Opened by glorv about 4 years ago - 3 comments
Labels: status/LGT2

#550 - panic in tidb backend in strict sql-mode

Issue - State: open - Opened by glorv about 4 years ago
Labels: type/bug, severity/major

#549 - config: change redact log parameter name (#547)

Pull Request - State: closed - Opened by glorv about 4 years ago
Labels: status/LGT2

#548 - config: change redact log parameter name (#547)

Pull Request - State: closed - Opened by glorv about 4 years ago

#547 - config: change redact log parameter name

Pull Request - State: closed - Opened by lichunzhu about 4 years ago - 3 comments
Labels: status/LGT2, Should Update Docs, status/PTAL

#546 - Enhance lightning monitor

Issue - State: open - Opened by cyliu0 about 4 years ago
Labels: feature-request

#545 - restore: don't change TiDB config to support lightning via SQL

Pull Request - State: closed - Opened by lance6716 about 4 years ago - 3 comments
Labels: status/LGT2

#544 - block user accessing importing tables by RENAME TABLE

Issue - State: open - Opened by lance6716 about 4 years ago - 5 comments
Labels: feature-request

#543 - Compatible for disk quota

Pull Request - State: closed - Opened by Little-Wallace about 4 years ago - 11 comments
Labels: status/LGT2

#542 - User Access check before start importing

Issue - State: open - Opened by cyliu0 about 4 years ago - 5 comments
Labels: feature-request

#541 - outdate docs about privilege requirements for the target database

Issue - State: open - Opened by july2993 about 4 years ago

#540 - post-process: allow run checksum at last and restrict the number of checksum jobs

Pull Request - State: closed - Opened by glorv about 4 years ago - 6 comments
Labels: status/LGT2, CanMerge

#539 - backend: support shard row id for local/importer backend

Pull Request - State: closed - Opened by glorv about 4 years ago - 11 comments
Labels: status/LGT1

#538 - *: redact log and error messages, add log-redact parameter

Pull Request - State: closed - Opened by lichunzhu about 4 years ago - 5 comments
Labels: status/LGT2, Should Update Docs, status/PTAL

#537 - restore: add error retry for checksum by tikv

Pull Request - State: closed - Opened by glorv about 4 years ago - 2 comments
Labels: status/LGT2

#536 - Benchmark the speed of importing lots of small tables

Issue - State: open - Opened by kennytm about 4 years ago
Labels: feature-request, priority/P3, difficulty/2-medium

#535 - mydumper: do not remove more than 1 sep if trim last sep is true

Pull Request - State: closed - Opened by glorv about 4 years ago - 12 comments
Labels: status/LGT2, CanMerge

#534 - local backend panic when build with CGO_ENABLED=0

Issue - State: open - Opened by gozssky about 4 years ago

#533 - mydumper: update br to apply auto retry s3 read error

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: status/LGT2, CanMerge

#532 - lightning tidb backend failed to restore csv files when trim-last-separator is true

Issue - State: closed - Opened by glorv about 4 years ago
Labels: type/bug, severity/major

#531 - backend/local: add encode for retry scan region keys

Pull Request - State: closed - Opened by glorv about 4 years ago - 3 comments
Labels: status/LGT1, type/bug-fix

#530 - restore: fix error lost in create schema

Pull Request - State: closed - Opened by 3pointer about 4 years ago - 3 comments
Labels: status/LGT2, type/bug-fix, CanMerge

#529 - test: fix unstable integration test auto_random_default

Pull Request - State: closed - Opened by glorv about 4 years ago - 3 comments
Labels: status/LGT2, CanMerge

#528 - restore: check row value count to avoid unexpected encode result

Pull Request - State: closed - Opened by glorv about 4 years ago - 17 comments
Labels: status/LGT2, type/bug-fix

#527 - *: add some error description

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: status/LGT2, CanMerge

#526 - backend: import planner/core package to initialize expression.RewriteAstExpr

Pull Request - State: closed - Opened by xuhui-lu about 4 years ago - 8 comments
Labels: status/LGT2, first-time-contributor

#525 - add the estimated total progress/total files and per table progress in /progress/task and /progress/table api

Issue - State: open - Opened by july2993 about 4 years ago
Labels: feature-request

#524 - backend/local: skip split regions if engine total size is smaller than region size

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: status/LGT2, CanMerge

#523 - backend/local: fix next key

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment
Labels: status/LGT2

#522 - Support loading data in Google Cloud Storage

Issue - State: open - Opened by tennix about 4 years ago
Labels: feature-request

#521 - mydump: fix issue 519

Pull Request - State: closed - Opened by kennytm about 4 years ago - 3 comments
Labels: status/LGT2, release-blocker, CanMerge

#520 - Sort index rather than insert it into skiplist

Pull Request - State: closed - Opened by Little-Wallace about 4 years ago - 4 comments
Labels: status/LGT2, first-time-contributor

#519 - lightning restore fail to restore csv with special delimiter

Issue - State: closed - Opened by lichunzhu about 4 years ago - 2 comments
Labels: type/bug, priority/P0, severity/major

#518 - Lightning report `[tikv:9002]TiKV server timeout` when analyze enabled

Issue - State: closed - Opened by shuijing198799 about 4 years ago - 3 comments

#517 - restore: apply adjust max-pending-peer-count when stop pd schedulers

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: status/LGT2, release-blocker, CanMerge

#516 - backend/local: remove useless and buggy truncate key

Pull Request - State: closed - Opened by glorv about 4 years ago - 2 comments
Labels: status/LGT2, CanMerge

#515 - local backend split regions count far less than expected in nightly cluster

Issue - State: closed - Opened by glorv about 4 years ago - 1 comment
Labels: type/bug, severity/moderate

#514 - test: enable clustered index in test

Pull Request - State: closed - Opened by leoppro about 4 years ago - 4 comments

#513 - log: error log is not clear.

Issue - State: closed - Opened by 3pointer about 4 years ago - 2 comments
Labels: type/bug, priority/P2, severity/minor

#512 - Make it easier to run integration tests

Issue - State: open - Opened by kennytm about 4 years ago
Labels: feature-request

#510 - test: fix invalid failpoint and integration test

Pull Request - State: closed - Opened by glorv about 4 years ago - 7 comments
Labels: status/LGT2, CanMerge

#509 - post-process: support run table analyze after all tables are finished

Pull Request - State: closed - Opened by glorv about 4 years ago - 4 comments
Labels: status/LGT2

#508 - backend,restore: duplicate more important system variables from downstream

Pull Request - State: closed - Opened by kennytm about 4 years ago - 5 comments
Labels: status/LGT2

#507 - Add an option to turn alter table auto_increment off.

Issue - State: open - Opened by 3pointer about 4 years ago - 1 comment
Labels: feature-request

#506 - restore: add importing progress and optimize the accuracy of restore progress

Pull Request - State: closed - Opened by glorv about 4 years ago - 11 comments
Labels: status/LGT2, CanMerge

#505 - backend: support stored generated columns in local/importer backends

Pull Request - State: closed - Opened by kennytm about 4 years ago - 1 comment
Labels: status/LGT2

#504 - Recognize `block_encryption_mode` from downstream

Issue - State: closed - Opened by kennytm about 4 years ago - 4 comments
Labels: type/bug, priority/P3, difficulty/2-medium

#503 - Failed to import tpcc data due to column count not match value count in item table

Issue - State: closed - Opened by gengliqi about 4 years ago - 2 comments

#502 - restore: Try to create tables in parallel

Pull Request - State: closed - Opened by hidehalo about 4 years ago - 36 comments
Labels: status/LGT2, status/PTAL, rewarded

#501 - backend/local: set pebble db max file limit

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment
Labels: status/LGT2

#500 - TiKV storage and cpu usages are not balance during importing

Issue - State: closed - Opened by cyliu0 about 4 years ago - 3 comments
Labels: type/bug, severity/critical

#499 - test: fix can not kill tiflash process by name

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment
Labels: status/LGT1

#498 - .github: let challenge-bot recognize the default SIG

Pull Request - State: closed - Opened by kennytm about 4 years ago - 5 comments
Labels: status/LGT2

#497 - backend/local: check and return iter.Error when pebble is not valid

Pull Request - State: closed - Opened by glorv about 4 years ago - 8 comments
Labels: status/LGT2

#496 - Analyze tables when generating KV pairs

Issue - State: open - Opened by overvenus about 4 years ago
Labels: feature-request

#495 - Exit with actual error log

Issue - State: open - Opened by overvenus about 4 years ago - 2 comments
Labels: type/bug, severity/minor

#494 - Add open fd check for local backend

Issue - State: closed - Opened by overvenus about 4 years ago - 4 comments
Labels: type/bug, severity/minor

#493 - backend: implement disk quota

Pull Request - State: closed - Opened by kennytm about 4 years ago - 14 comments
Labels: status/PTAL, CanMerge, status/LGT3

#491 - *: add method to check whether need local SST of table

Pull Request - State: closed - Opened by lance6716 about 4 years ago - 7 comments
Labels: status/LGT2

#490 - missing docs about how to use s3 as source for `data-source-dir`

Issue - State: closed - Opened by july2993 about 4 years ago
Labels: Should Update Docs

#489 - support assumerole

Pull Request - State: closed - Opened by july2993 about 4 years ago - 1 comment

#488 - During the lightning import process, tikv crashes and cannot restart again.

Issue - State: closed - Opened by shuijing198799 about 4 years ago - 2 comments
Labels: type/bug, severity/critical

#487 - backend/local: batch split region with batch limit

Pull Request - State: closed - Opened by glorv about 4 years ago
Labels: status/LGT1

#486 - When lightning using a cloud disk, the import speed drops and the tikv cpu cannot be full.

Issue - State: closed - Opened by shuijing198799 about 4 years ago - 2 comments
Labels: question

#481 - Lightning needs to set an upper limit of split keys in one BatchSplit RPC call

Issue - State: closed - Opened by overvenus about 4 years ago
Labels: type/bug, severity/major

#476 - backend/local: more robust range retry strategy

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment
Labels: status/LGT2

#464 - csv: add gbk option temporary

Pull Request - State: closed - Opened by 3pointer about 4 years ago - 1 comment

#451 - backend/local: serial import engines with range overlap

Pull Request - State: closed - Opened by glorv about 4 years ago - 1 comment

#446 - Support to specify a disk quota for intermediate files

Issue - State: open - Opened by shuijing198799 about 4 years ago - 5 comments
Labels: feature-request

#440 - Better progress updates

Issue - State: open - Opened by kolbe about 4 years ago - 1 comment
Labels: feature-request

#436 - Ingest failed due to EpochNotMatch error

Issue - State: open - Opened by amyangfei over 4 years ago - 5 comments
Labels: type/bug

#434 - Try to create tables in parallel

Issue - State: closed - Opened by kennytm over 4 years ago - 24 comments
Labels: feature-request, priority/P3, difficulty/1-easy, challenge-program, high-performance, picked

#433 - analyze table failed: Error 8229: TTL manager has timed out

Issue - State: closed - Opened by shuijing198799 over 4 years ago - 2 comments
Labels: type/bug

#432 - Lightning job is failed when meet aws network error

Issue - State: closed - Opened by shuijing198799 over 4 years ago - 2 comments
Labels: type/bug, priority/P0

#417 - support restore view

Pull Request - State: closed - Opened by glorv over 4 years ago - 1 comment
Labels: status/LGT2

#409 - allow use lightning tidb backend to load data to mysql

Issue - State: open - Opened by glorv over 4 years ago - 4 comments
Labels: feature-request, priority/P3, difficulty/2-medium

#396 - checksum: use gc ttl api for checksum gc safepoint in v4.0 cluster

Pull Request - State: closed - Opened by glorv over 4 years ago - 3 comments
Labels: status/LGT2

#358 - restore: decouple restore/import/post-process

Pull Request - State: closed - Opened by glorv over 4 years ago - 4 comments

#340 - add log for environment http proxy setting

Pull Request - State: closed - Opened by glorv over 4 years ago
Labels: status/LGT2

#297 - Support restoring VIEWs and SEQUENCEs

Issue - State: closed - Opened by kennytm almost 5 years ago - 6 comments
Labels: priority/P1, difficulty/2-medium, status/discussion, feature/accepted

#236 - backend, restore: Strip the first 11 bytes from key in WriteEngine, specify it in OpenEngine

Pull Request - State: closed - Opened by lance6716 over 5 years ago - 5 comments
Labels: status/DNM, type/enhancement

#205 - Inserting non-UTF-8 data into a VARCHAR column should produce an error in strict SQL_MODE

Issue - State: open - Opened by kennytm over 5 years ago
Labels: type/bug, priority/P2, difficulty/2-medium

GitHub / pingcap/tidb-lightning issues and pull requests