pingcap/dm issues and pull requests

#2301 - restoring count greater than total count

Issue - State: open - Opened by que0080 over 2 years ago - 1 comment

#2299 - README: update link for tiflow

Pull Request - State: closed - Opened by GMHDBJD over 2 years ago - 1 comment
Labels: status/LGT1, size/XS

#2298 - update contact info

Pull Request - State: closed - Opened by luzizhuo almost 3 years ago - 2 comments
Labels: status/LGT2, first-time-contributor, size/XS

#2296 - build(deps): bump url-parse from 1.5.3 to 1.5.10 in /dm/portal/frontend

Pull Request - State: closed - Opened by dependabot[bot] almost 3 years ago - 2 comments
Labels: contribution, dependencies, javascript, size/XS

#2295 - build(deps): bump url-parse from 1.5.3 to 1.5.7 in /dm/portal/frontend

Pull Request - State: closed - Opened by dependabot[bot] almost 3 years ago - 2 comments
Labels: contribution, dependencies, javascript, size/XS

#2294 - build(deps): bump follow-redirects from 1.13.0 to 1.14.8 in /dm/portal/frontend

Pull Request - State: open - Opened by dependabot[bot] almost 3 years ago - 1 comment
Labels: contribution, dependencies, javascript, size/XS

#2293 - why dm must save table structure info in cache？

Issue - State: closed - Opened by lddlww almost 3 years ago - 2 comments
Labels: question

#2292 - build(deps): bump ajv from 6.10.0 to 6.12.6 in /dm/portal/frontend

Pull Request - State: open - Opened by dependabot[bot] almost 3 years ago - 1 comment
Labels: contribution, dependencies, javascript, size/S

#2291 - build(deps): bump follow-redirects from 1.13.0 to 1.14.7 in /dm/portal/frontend

Pull Request - State: closed - Opened by dependabot[bot] about 3 years ago - 3 comments
Labels: contribution, dependencies, javascript, size/XS

#2290 - DM is unavailable when create view on source mysql

Issue - State: closed - Opened by jnf009 about 3 years ago - 1 comment

#2288 - support json type for mysql downstream

Pull Request - State: closed - Opened by D3Hunter about 3 years ago - 4 comments
Labels: status/LGT2, size/S

#2287 - dmctl, scheduler: specify worker when create upstream source

Pull Request - State: closed - Opened by jerrylisl about 3 years ago - 3 comments
Labels: contribution, size/XL

#2285 - handle-error skip throw error

Issue - State: closed - Opened by lddlww about 3 years ago - 5 comments

#2283 - optimize: add method check worker status

Pull Request - State: closed - Opened by fatelei about 3 years ago - 5 comments
Labels: contribution, first-time-contributor, size/M

#2281 - dm mariadb binlog parse timestamp panic

Issue - State: open - Opened by wentaojin about 3 years ago - 4 comments

#2277 - lightning: Add checkpoint test and fix some bug

Pull Request - State: closed - Opened by Little-Wallace about 3 years ago - 2 comments
Labels: size/XXL

#2276 - README: prepare to archive project dm

Pull Request - State: closed - Opened by lichunzhu over 3 years ago - 6 comments
Labels: status/LGT2, status/can-merge, size/XS

#2275 - scheduler: add Relay as a worker stage and fix bug (#2219)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: needs-update-docs, status/LGT2, needs-update-release-note, status/can-merge, size/XXL, do-not-merge/hold, type/cherry-pick-for-release-2.0

#2274 - upgrade, scheduler: recover memory status of relay when upgrade from <2.0.2

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 2 comments
Labels: size/L

#2273 - .*: add multiple-rows for syncer[WIP]

Pull Request - State: closed - Opened by GMHDBJD over 3 years ago - 2 comments
Labels: size/XXL

#2272 - config: don't write `enable-relay` when exporting (#2268)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 7 comments
Labels: needs-update-docs, status/LGT2, needs-update-release-note, status/can-merge, size/S, type/cherry-pick-for-release-2.0

#2271 - openapi: add clusters api (#2194)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 2 comments
Labels: status/PTAL, size/L, type/cherry-pick-for-release-2.0

#2270 - relay/streamer: move binlog log reader into relay

Pull Request - State: closed - Opened by D3Hunter over 3 years ago - 3 comments
Labels: contribution, size/XXL, needs-rebase

#2269 - relay/syncer: relay notifies syncer of new write to reduce sync latency (#2225)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 2 comments
Labels: needs-update-release-note, contribution, size/XXL, type/cherry-pick-for-release-2.0

#2268 - config: don't write `enable-relay` when exporting

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 5 comments
Labels: needs-update-docs, status/LGT2, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/S

#2265 - DM could not read mariabinlog (unsupport type 140 in binlog)

Issue - State: open - Opened by kzinas-adv over 3 years ago - 2 comments

#2264 - syncer: refactor ddl.go (#2090)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: needs-update-docs, status/LGT2, status/PTAL, needs-update-release-note, status/can-merge, size/XXL, type/cherry-pick-for-release-2.0

#2263 - *: replace dumpling with tidb/dumpling

Pull Request - State: open - Opened by Little-Wallace over 3 years ago - 7 comments
Labels: status/LGT2, status/can-merge, size/M, do-not-merge/hold

#2262 - [WIP] Async Checkpoint with Causality Optimization

Pull Request - State: open - Opened by db-will over 3 years ago - 2 comments
Labels: size/XXL, do-not-merge/work-in-progress

#2261 - .*: add compactor for syncer

Pull Request - State: open - Opened by GMHDBJD over 3 years ago - 5 comments
Labels: needs-update-docs, status/LGT2, status/PTAL, needs-cherry-pick-release-2.0, size/XXL

#2260 - test: move install_test_python_dep from test script (#2255)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 4 comments
Labels: status/LGT1, status/can-merge, size/XS, require-LGT1, type/cherry-pick-for-release-2.0

#2258 - *: change pingcap/parser to pingcap/tidb/parser (#2254)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: status/LGT1, first-time-contributor, status/can-merge, size/L, require-LGT1, type/cherry-pick-for-release-2.0

#2257 - *: change pingcap/parser to pingcap/tidb/parser (#2254)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 1 comment
Labels: first-time-contributor, size/L, type/cherry-pick-for-release-2.0

#2256 - sync: refactor dml.go (#2234)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: status/LGT2, status/PTAL, status/can-merge, size/XXL, type/cherry-pick-for-release-2.0

#2255 - test: move install_test_python_dep from test script

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 6 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/XS

#2254 - *: change pingcap/parser to pingcap/tidb/parser

Pull Request - State: closed - Opened by Leavrth over 3 years ago - 6 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, first-time-contributor, status/can-merge, size/L

#2253 - openapi: add more spec (#2187)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 4 comments
Labels: status/LGT2, status/PTAL, status/can-merge, size/XXL, type/cherry-pick-for-release-2.0

#2252 - openapi: add list/staus task API (#2173)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: status/LGT2, status/can-merge, size/XXL, type/cherry-pick-for-release-2.0

#2251 - openapi: add more spec (#2187)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 1 comment
Labels: status/PTAL, size/XXL, type/cherry-pick-for-release-2.0

#2249 - *: add etcd key for `start-relay` without worker name

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 7 comments
Labels: status/LGT1, needs-cherry-pick-release-2.0, size/L

#2248 - test: remove send lark notify (#2245)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 4 comments
Labels: status/LGT2, status/can-merge, size/L, type/cherry-pick-for-release-2.0

#2247 - [WIP] Add async checkpoint draft implementation

Pull Request - State: closed - Opened by db-will over 3 years ago - 1 comment
Labels: size/XL, do-not-merge/work-in-progress

#2246 - [DNM]syncer: test if we can enable semi sync without changing code

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 2 comments
Labels: size/XS

#2245 - test: remove send lark notify

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 8 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/L

#2244 - [WIP] config: fix panic when some field is empty

Pull Request - State: open - Opened by lance6716 over 3 years ago - 1 comment
Labels: size/M, do-not-merge/work-in-progress

#2243 - relay: move dailing upstream and other action out of Init (#2227)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 5 comments
Labels: status/LGT2, needs-update-release-note, status/can-merge, size/L, type/cherry-pick-for-release-2.0

#2242 - master: don't display "start-relay" message when stop source (#2238)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 4 comments
Labels: status/LGT2, status/can-merge, size/S, type/cherry-pick-for-release-2.0

#2241 - make `start-relay` easier to use

Issue - State: open - Opened by lance6716 over 3 years ago - 5 comments

#2240 - shardddl: fix data race in test (#2236)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 13 comments
Labels: status/LGT2, status/can-merge, size/L, type/cherry-pick-for-release-2.0

#2238 - master: don't display "start-relay" message when stop source

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 4 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/S

#2237 - syncer: refactor sync dml (#2061)

Pull Request - State: closed - Opened by ti-chi-bot over 3 years ago - 3 comments
Labels: status/LGT2, status/PTAL, needs-update-release-note, status/can-merge, size/XXL, type/cherry-pick-for-release-2.0

#2236 - shardddl: fix data race in test

Pull Request - State: closed - Opened by gozssky over 3 years ago - 6 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/L

#2234 - sync: refactor dml.go

Pull Request - State: closed - Opened by GMHDBJD over 3 years ago - 9 comments
Labels: status/LGT2, status/PTAL, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2233 - handle the upgrading problem of removing `disable-detect`

Issue - State: open - Opened by lance6716 over 3 years ago

#2227 - relay: move dailing upstream and other action out of Init

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 4 comments
Labels: status/LGT2, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/L

#2225 - relay/syncer: relay notifies syncer of new write to reduce sync latency

Pull Request - State: closed - Opened by D3Hunter over 3 years ago - 13 comments
Labels: status/LGT2, needs-update-release-note, contribution, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2222 - openapi: add more task api

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 1 comment
Labels: needs-cherry-pick-release-2.0, size/XXL

#2219 - scheduler: add Relay as a worker stage and fix bug

Pull Request - State: closed - Opened by lance6716 over 3 years ago - 7 comments
Labels: needs-update-docs, status/LGT2, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2217 - support explicitly set time_zone and change default time_zone to target db tz

Pull Request - State: closed - Opened by glorv over 3 years ago - 15 comments
Labels: needs-update-docs, status/LGT1, needs-update-release-note, needs-cherry-pick-release-2.0, size/XXL

#2216 - relay: add pullBinlogs interface for dm-worker to get local/grpc relay log

Pull Request - State: closed - Opened by lichunzhu over 3 years ago - 7 comments
Labels: status/LGT1, size/XXL, needs-rebase

#2213 - RFC: Add async checkpoint flush rfc doc

Pull Request - State: closed - Opened by db-will over 3 years ago - 4 comments
Labels: status/LGT2, status/can-merge, size/L

#2209 - openapi: add more source api

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 1 comment
Labels: status/LGT1, status/PTAL, needs-cherry-pick-release-2.0, size/XL

#2206 - speed up operate-source show

Issue - State: open - Opened by GMHDBJD over 3 years ago - 1 comment
Labels: type/feature-request

#2204 - mysql source worker %s has already started with source %s, but get a request with source %s

Issue - State: closed - Opened by GMHDBJD over 3 years ago - 2 comments
Labels: type/bug, severity/major, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#2203 - Worker should not offline when enable relay failed

Issue - State: closed - Opened by GMHDBJD over 3 years ago
Labels: type/bug, severity/major, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#2202 - follow the package move of parser

Issue - State: closed - Opened by lance6716 over 3 years ago
Labels: help wanted, difficulty/easy, good first issue

#2196 - RFC: DML Execution Optimization

Pull Request - State: closed - Opened by GMHDBJD over 3 years ago - 13 comments
Labels: status/LGT2, status/PTAL, type/doc, status/can-merge, size/L

#2194 - openapi: add clusters api

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 9 comments
Labels: status/LGT2, status/PTAL, needs-cherry-pick-release-2.0, status/can-merge, size/L

#2187 - openapi: add more spec

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 10 comments
Labels: status/LGT2, status/PTAL, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2178 - loader, syncer: support table transfer column

Pull Request - State: closed - Opened by yufan022 over 3 years ago - 10 comments
Labels: contribution, needs-cherry-pick-release-2.0, first-time-contributor, size/XL

#2173 - openapi: add list/staus task API

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 5 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2165 - feature: pause/resume/stop (sub)tasks related to a upstream source in batch mode

Issue - State: closed - Opened by D3Hunter over 3 years ago - 1 comment

#2163 - syncer: use downstream PK/UK to generate DML

Pull Request - State: closed - Opened by WizardXiao over 3 years ago - 13 comments
Labels: contribution, needs-cherry-pick-release-2.0, first-time-contributor, size/XXL

#2136 - relay: start-relay failed with `no such file or directory`

Issue - State: closed - Opened by GMHDBJD over 3 years ago
Labels: type/bug, severity/minor, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#2122 - high cpu usage in dm-worker

Issue - State: closed - Opened by Ehco1996 over 3 years ago - 1 comment
Labels: question

#2090 - syncer: refactor ddl.go

Pull Request - State: closed - Opened by okJiang over 3 years ago - 19 comments
Labels: needs-update-docs, status/LGT2, status/PTAL, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2087 - Unable to reach batch with a large worker count

Issue - State: closed - Opened by GMHDBJD over 3 years ago - 1 comment
Labels: type/bug, severity/minor, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6

#2064 - refactor: handleQueryEvent

Issue - State: closed - Opened by okJiang over 3 years ago - 1 comment

#2055 - openapi: add source releated API

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 6 comments
Labels: needs-update-docs, status/LGT2, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#2047 - syncer, relay: avoid read duplicate event when retry binlog streamer

Pull Request - State: closed - Opened by glorv over 3 years ago - 9 comments
Labels: status/LGT2, needs-cherry-pick-release-2.0, status/can-merge, size/XL

#2013 - misleading relay helping message when stop source

Issue - State: closed - Opened by lance6716 over 3 years ago
Labels: type/bug, severity/minor, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#1982 - Develop OpenAPI for DM

Issue - State: closed - Opened by Ehco1996 over 3 years ago
Labels: type/feature

#1975 - syncer: schema tracker support track skipped ddl

Pull Request - State: closed - Opened by okJiang over 3 years ago - 12 comments
Labels: status/LGT2, status/PTAL, status/can-merge, size/XL

#1930 - binlog pos not catch up with master after upstream master-slave switch

Issue - State: closed - Opened by GMHDBJD over 3 years ago - 1 comment
Labels: type/bug, severity/major, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#1913 - Need to improve the log while dm cluster upgrade, change ERROR to WARNING.

Issue - State: closed - Opened by XuJianxu over 3 years ago - 1 comment
Labels: type/bug, severity/minor

#1857 - Compactor: compact dml to reduce binlog writing

Pull Request - State: closed - Opened by GMHDBJD over 3 years ago - 3 comments
Labels: status/DNM, status/WIP, size/XL, needs-rebase

#1831 - check replication privileges of source DB for mariadb 10.5.11

Issue - State: open - Opened by luyomo over 3 years ago - 7 comments
Labels: type/feature-request

#1802 - [WIP] dumpling: support dump phase network speed limit

Pull Request - State: closed - Opened by feloxx over 3 years ago - 5 comments
Labels: contribution, status/Stale, first-time-contributor, size/XL, needs-rebase, do-not-merge/work-in-progress

#1801 - Support dump phase network speed limit

Issue - State: closed - Opened by feloxx over 3 years ago

#1778 - syncer, loader: add more metrics

Pull Request - State: closed - Opened by Ehco1996 over 3 years ago - 14 comments
Labels: needs-update-docs, status/LGT2, status/PTAL, needs-update-release-note, needs-cherry-pick-release-2.0, status/can-merge, size/XXL

#1719 - DM automaticly choose `enable-gtid` for sources

Issue - State: closed - Opened by lance6716 over 3 years ago - 1 comment

#1627 - WIP: async flush checkpoints

Pull Request - State: closed - Opened by hidehalo almost 4 years ago - 2 comments
Labels: contribution, status/Stale, size/XL, needs-rebase, do-not-merge/work-in-progress

#1460 - relay can't continue after upstream turn off GTID

Issue - State: closed - Opened by Tammyxia almost 4 years ago - 3 comments
Labels: type/bug, severity/minor, affected-v2.0.2, affected-v2.0.3, affected-v2.0.4, affected-v2.0.5, affected-v2.0.6, affected-v2.0.7

#1328 - Official document about version restriction

Issue - State: closed - Opened by Carl-Hee about 4 years ago - 8 comments
Labels: question

#1034 - cache relay log in memory

Issue - State: closed - Opened by lance6716 over 4 years ago - 4 comments
Labels: type/feature-request, help wanted, difficulty/medium, challenge-program, high-performance

#924 - new table filter based on `TableMapEvent` in go-mysql

Issue - State: open - Opened by csuzhangxc over 4 years ago
Labels: type/enhancement, type/feature-request, help wanted

#463 - MySQL 8.0 support

Issue - State: closed - Opened by tkaven about 5 years ago - 5 comments
Labels: type/feature-request, TiDB-5.0

#427 - Add `Lightning` struct to replace loader

Pull Request - State: closed - Opened by imtbkcat about 5 years ago - 4 comments
Labels: priority/normal, status/DNM, type/feature, status/Stale, size/XXL, needs-rebase

#335 - relay: fix GTID recover after relay log recovered

Pull Request - State: closed - Opened by csuzhangxc over 5 years ago - 7 comments
Labels: priority/normal, status/LGT2, type/bug-fix, priority/release-blocker, already-cherry-pick-1.0, already-update-release-note

#282 - update load unit with tidb-lightning's `tidb` backend

Issue - State: closed - Opened by csuzhangxc over 5 years ago - 1 comment
Labels: type/feature-request

GitHub / pingcap/dm issues and pull requests