From b94e95cbfb0cd4a5dcf8ce69f77b0d22698964b5 Mon Sep 17 00:00:00 2001 From: Ti Chi Robot Date: Thu, 25 Nov 2021 15:13:51 +0800 Subject: [PATCH] ticdc: add description about gc-ttl (#6835) (#6963) --- media/ticdc-state-transfer.png | Bin 0 -> 18424 bytes ticdc/deploy-ticdc.md | 2 +- ticdc/manage-ticdc.md | 27 +++++++++++++++++++++++++++ ticdc/troubleshoot-ticdc.md | 21 ++++++++++++++++++--- 4 files changed, 46 insertions(+), 4 deletions(-) create mode 100644 media/ticdc-state-transfer.png diff --git a/media/ticdc-state-transfer.png b/media/ticdc-state-transfer.png new file mode 100644 index 0000000000000000000000000000000000000000..48770525e803852e03bae4d460d210eb4182450f GIT binary patch literal 18424 zcmeHvWmJ@3`z|1eG>U+N0+P}wARU5$ba#Vvcb5W+Gzf^q(A`}_OLzC6G{evgJ#!v@ z@2l_s%USDuIA^W%;r%ePp7q3j_T2mK>)I2hq#%WdO@@tvf`TXg{+$X63R(mT3aZkB z`@k7)26jpm6m)zmad9OZaVc>JTL))VM`KenDKmRBXDd?`DKQij-pELGeamO+kA+hj ztC?v>K27E2#o;5kztz~Pj0Z1lBh0GpmRRC#Yu?86?=7cU(Q~fd2%@7m!vhUYiN${dxzlt7P4zSh~c06U=SS($~`pCc`xWlB=0 zUzS7WN_YpTf19Boh<{e;2co~d?!%fjxxnfcuuY}<{iv%JMe|8I!C}>Ca_s9bh7v3< ziy{!+i(fFeXy7{Nm@bElQG(nBrHs^r68&$Ae<;vQft(d+HMrvBV={^2( z(XdHkj^?+|YGK7cJI0r5{`D=(e)!t)LydglZq35P5h(R))`&jn_Be-F z9+Kv8tf=$AQk|v+*Wb&s*li5U+>vJLl{C9_+^36Y)bZ;aPhVtH#WD1&eu(%m&M$+{ z-J3}5^5LX$e98-zMg_zZ-V(m;@wNwH@!|Vw&FD`V5D($p=-jByK*FrO0l%NUW_Yut z2B>+)Wyh7)g3OxLwQpf6&3P2rX}C38VYtPkgNwlQzZU>q)Trl%at&!<`!zY}c1xWI zDSQylWmUH|uFlTV=GM4EqZ~x>YxHb>U~ymfX8pWhB+jP)JdTn+U~Oex_}7RF$Qk4W z3GCBfWpg%kHguwN0ZCa;c^z=s?3ZU(VsBa{DKCMg?+LAgj1d92$&e z%ZQ%n>|s^5ISx5D8=v0q6bX`#!WeM$AqFA+7##QO}sd20up_Y~~cf@!2ho>GU{ zHG2oc&hp&-WrY^XgL+(!Yy~k)d<}iMgddA^I(~Wz32#;2JDPIdsT#!p9buJLQ~P80 zYghmJnhAFKYbFxhjrNR}(5CI?XXAPJwMmv6C>1`hc{?4X5x1m^Ub$v2p!>Wx3@8sST1f?MZc@IhFiSyHRW)N@?yk=U`=JN6=Ou+F26x7dFDCocuD)1o#K7cRD zK>KqBEh6LIpJP;|yNiu9VWuc3qA1eu-l}<`!j>^T)uv|xeTnm%`!p7P=2_B z_K`~BVI|GiNJtdexT84BfVh&UA}A~HE39a#_=}9Pnr%klDRoS6jLdPlTVJrWSX^?< zP-^@o{G?=PsL-d)N5Op9ibm`$3Mx9G=zqWdugl;;kZ61z4Bw|#y4pO&W~v~$5IXpx z(?*H&#fwtulf*V2+qrcaSoj=a3#JwZ+5`~?V`RVo66hXCV$fMNMuvvpD8X6kddpktv z1KN!K2ULWCqOK^D99U?;VTEX^POSsE5FGiQMzDD+WADsVJ7tM z^4&e23W34nF8Y!o5C3f?<>E4Tp^2f^`*>e=Y_bKc#)TK~R*?~8DSI!o2qCKQPTrJfcSgOxk1f!kQ-Xu%y zCunZ@(O}jJsA=3BXX|mAH=I6mERt)u9`~I*Lc6o<)plS_35KE@0d+{lK%DPfzqZ)q zvMTa$t$@9$vzx&(mpBO@t<6v8`P}G)wW7Y*G$1cgFTPZaI~V+JWtXQfEqy#W z5fTSx&|UBllq7gHJF2VE!7xa|>X_#+)}Y;?+;X>AV)Vc|y|&f}MnS`*uJD>{3N%Na z-fEltVvbhyQRMf4?YH%>Y$Ud-H&OXA@*@gX`eNhV;DD)t(HGId~| zZu4kuj-;}ciy(tJq4T7MtWN5`!}a8PM|x$;;}wU=Aw|O-BPW`9!nEvyh`<`lY00vt zGwZ@UtlysxS{M!e5Se;DnFd}ra0{;!+r<{;BK2anwKA|g8IK(!`Alh|*Fg&#rKRmk zg91g$8xKg0E{}BWF87Be?)v={_ZgdG#A5kCVkC59JP9(KGE-(>=kB`anwsje!yOl& zMl&iREWP4)D`B-#R2o6%(#Q$h6+y=6_JU~Kdp5O6Z$Z!8hOnyqVN6~Qo6J=bP|3Tn zA;wy90JSZc9l9bE&B(%DXVI#xmRp1`wH+kPru!}Nc~nXc>rChpb-J*FM;cWY>a*x@ z+P*Q5l2dm{Ml-sO%Qo!~lY5)^goQ;V&I)U@VAVpe%w6nNO*JVLy`7s*_e8p%`g@nt z(6O?ruOQ9MR$P6ms#1lb+in`v=tX$Mo8V-t5#-}1j{O5e-x>{(u?`DPG}i+TBJA-} z2B~ztZU@Ya&F=k&`>js>a64TyHAs}VWlN(R=)9D3FRHkw&*Eey z0qb0lscYm}eEpJPfDRLB zz4$WZyTh0aKm8CXmHRe3@Ab`I_*ebV=PGp*H4@BQ<48qjFkN&4D{3muJUoUb)r!YK zYfF&iJbyT|adOw#iaBNGAZ@GKtJ>}0*9vXb>J4Lm|48Gv{xE@`@En~unL8y|qG}JI z;W6xBv& zy-X(z%$)pOzE4c*WqOWknX^xK3VrfRYdjh&8~Y6*Z@WIU7iMG2JKXzStl<{g+pQ7D zB80B+&nu}#JGT?lGbn&~^G&puO+RfX{w$^}pLA}m(}PtAF-*$aKk&%=Yw%xr{^ zN0^t;Xv5sI4p{h)h+jZ75bZ<%dZ|EB#a}@UNIc_x5a={L461R^e9_I5sjqFDYc=>O zwRaP-oR^FGKa-9>m!h^R+;V&r*ihafc&pp1!Dzcy5i zSDTI7^LRyvAD1k_2` zZ$Mnu6LQwmWi$ead3p;y$HoW>0Rs)hRkfZQqVOu5Ltw)wt<^hH=NPI8ku5U76GDVG zpV(WOf=x7~9rW5}q-k}xyq+TcZrWVi*IU6ild(dX%KADbT5Q?)__GbEHa=nc)ZM#g4ef(1>xPgw~&x?u4S9)^Md^wB0uUBq{d<_ z2LbC|K}+pP*i+e?&)|HKDLXaU?BD!9DUR}#f-8g)*cH=Q+IC=Gi21sCX*~jKk1r8V z1LAA=)(?Fr7t{Nq&D%14SY~CK(uuU|4a6&j3K?v`zIFpVU8pUqb^Mrty(JIc1p|VINLQcr9G;_c|IPIE zSOFv2-OqIXcQOxZ=R@#}z`cE_GZ8a}%F4>XL21oHRCE~z(M~OXo=q{7AZqlYp5A=hg^Ic_mALNN zfoGa(azh$CGm-o+0s{qrWM+AsUTSVM5K@d78V>jg!J4`+$$*wi5=5e z_=19#3#4T%Y2+?10!1I9Sv7kI9m7v8IQPzD8TUym{Jqyg7@z7)?(CPda=$|fa>VKm zw)t5?ii*yZCn_n~!>-KtnxE0i0?fATePpA;cCaZ$uP}Gf73VPX-W`s|R?ajnjuOOi zmkK@vsnaMaV@ym=uG~WFLA|sLun6cxDUWovtiV-AbJ-%7M-Q`)b5+%q4RO4_j(kxF zkl+)pQa0l72Qg78y~X&UR%~Eu0A$TNX|FcFlIi=v!|i8^?6gvTBqTFdCNPE6;{P(Z zY?@}?7#tOm^Ip4TaHrc}I;#JXn&-AaxbIyF`22rl{lzxup_9{*%i7u+5A&zAx%a{2 z8O|FGkqemBT#}Yb|0!^8(08{_-bM1Z8E5(rB#35`Soi_CHa(gioj!d83y`@8QgLWN zwN$e|VeZNh|H*uT^`@#&m`yHp@_I4@)1~uy;`itu|MHIlu@P;Toz3SOV=cCD%tQvi zinu5t`%_rHR9IzwZq=4xi?t~7Q(kLi?fsL%r{90l{K=qmA6A6xPjInlS66gR{AxN3 z306L0{G*nEDHxq;6(K&i_WR_!Kq|#XvdUyd>VdB={*QkB6M+Ct4mHTY|NBTdpriUr zd}?@qX5jb<1uL7}JBa^Zi9hgSw!0d{X-kRwucG1sifX@&vHNFM4;r+9-2Z2q`1D`N z@jQs(Xv!olxc9e$Faauv|4s%4_5VmRgwRkKB}_ozMj~j_ZgWo}L&=iK;7BI~HZ5E*H{nsizC~ZG#YJ%QqXlsH3ii~~8{c_8N8<)+|idh&rfzqC$Keft4-qoFJ*|^XMHGtuc;? z(_2NIi7T8sq=SCfEmb6A&TO-83J;Cjt1gx#uUM8A?QUYktc#V{%Fwz2y7P6g2!+SMmIyk2pm zJ@{5GYN3C_gId-J=kG!1E!CtyacG0d*U--6OY2s4jW=^8F5<8fSKj*Q_86iQI;H{2 z4s8m?enB{nro3>qM}__|`OTM~p>`8l3jvig+tQIZTyb2!xmmT4SvHD?cRt$v%cqaP zOB*DNqBU~jLYE~OVpPUkPf2Xs=whNRac8#6D&@M`)N0_@^^sdZfn-woy{~w`>#@wa2k0SbkI#v&Z zC9_I*XQ|W}EB4?SIQPmoKD0bFThV`ZZkt@`EyeAk!+H7*sHY!e0sf;^ST38ou1!?c zD-8IB|2TlhtYZdJLYd>@UGS#MfsU*0eOcZi9;&|HIQSt(V?zc5f$QzYG$Mm}2p4!D z5bFX-BMG=gLdW>PG*dfLAJ_2;@oM+)-U&U6WC%@c=wM(to$ariHqxQ1!R%X9@mDYY zI0(W*w4nW8%xv|RFhU~T_27>uLO}&W*Sg!H9Q%JRTu%UFg5p|H$xvFCV~iX!L!HBo+3p;oGLuOIw0}rT(Bnu05$Hq)8`w z8{5Nj?n*P*d!vNlj~fxCatv~$i>OO_B|#&*mf2oB`0YOnmPztJv(pmh`?hNaGHdWZ z0_zeZ;Yjc}{58F`BO*%xLOzB4XFNyr&SVZ9425jUJ2%CS{m!d$0%Lb6M>#&PKI|Qy z;(UUd2p=P3Uc0A3s1{YGdzz5jF3-|JgH^b;mGokncGU-I^Do8iyL!}0`3h;9ktwxT z9=}ImU@q%QztA>QYr3hCl4KqG4%pd=m4D&HE!TQB?fWjSmj8K_@TH;m(v^Q6`I zXdVX>d4rxUdW<<5U%U3EbkzH`in!>EG_`5kDay}J^Kf#yBnwzev5L_;>g)O5qzPT6 zKY}@m*PijJI!_2`ja40DTayG-Hh5%jD9*c!52o#a zG^wv$OW6_4#k_?@QOI*E{eC1F{^d!uh%m0beIC3>6t>`&uU4MGVSntx$yDjrR8MMm zo$8D%ZT85|NzJL%+g|yhQvLez_Z*+95pVNN2G;pEgG#j#q-Kkolko=we4D{5rXry8 zeOa@X3l-LpVl2~opz$)CeEGAgsTMlLtlpK(=!$kCl1_6D5frx5bap1!hlY-oCUb{K zXXpY+9r9#>A-t%c4NR{7~$OL?>mW&$2+Av);PMxZnS#AUt>)nwv1 zSLFuyA>Kz7S|vPL(nFxuB`R${*R3s&vMqfG7ZlNNmjgOvFW-leKPm- z0TMjLq^X)IGF#BfZs%s{LihUm`kWs%vr1uEWF>5Ek?`#9UO z|7Ipjq*^I8ZsW8ag-r44WtZIz^pU7SToE1uHO5;^kD6$ZF^w>sOIQV2sZCfGzkQ1m zgaQ;u_e4z|p$~|z%IWu=!J;mqbB%P2Z*)W%;!zHLd3;dIh*g zW-GuH^JE%tY^I$4x%uP6?GmDZc!5v)dvQfai9HIDB3ugNhY4JMDzPJrr?ufy=mQdg z!IgSi+Aq;U(4B8W)uy+eb5V@HpK5q-S{52`L>G{-jF)e y~Lo=2+ zP9Px6%5(Yt>*z->sS&jw_RDJ zs?@-5jFXKY;R;DzQGz<@$(L5Klce0gf5-Zn!HU{kSE4s!XrkDxt9-ixwCmJn$`Gnm zuQ^Zf*rQ2PcuEo=0hh{A2VN>(EW&X~jbh{uq}4357ZNn$U1c$KRq9>B+tzb9te94F zFRW!Aq5;j)cm4)frMP5HQEKH@r0Jw=lr7x)ug^d9S8(<|rq~I3;Zs$;{`n_PuK3oP zppx#anp4nBPEzQtOP$LT0c+piq`Mwy5tOy-{L$cpE0vK9Dss?PUf>sv3Rt*46U5=9X=T_#o&EeQ@)uf6o@%@b~pprcg+ zKhF=E$mFRgRrlO+fNk4Ss&FzNCBxEid`1O zp2ELF!KL4jsrM(}J$~1HCKr+$dTye$a(d}4%oq0ukpgZYQ|%lGk4BxxDw2PnN?dMs|@ z#iiDW>(mK%^LzR-R`B<8~X^dda)Lj=v+469Kw36i`}s`nSa1OOgqt==D@6D`w-`pep4&AuYyw(vB{=^SllzLv>KmFB41m(hJd z_rz=%#QY&Us#pUY`mAv6N3At9Lbvd9g~rWQwpyW%dX#WkGwoCv6!-jgKKt{8|D|#4 zP31mPxk5RWJgR8dZARR0S!!Vg$p}{is*O=d(qNT@ zVL0pt$TSS@AhO#LbI=AnxnT`dI?=lJ>N<^H1v8H0{``q9_lsvj8R4m8Hi3etOSl&M zjhu$DnD({VX&@F%>IFg5%tVz1nEOVxQ)MlE8l^NzVW=# z;!oYwT~ke4UJN^o`-%S*>~3&R|cjHJsgojWbSes zJdr6}y!n6!Vg*oLZSximiFChpgDsrV*tBSNcMXB_oqcF;f52Hx9bLFaR#w(}w=l!t zyJguOB! z%OdLu&!5BR8v93$3g1q@)kLLiy>FM7GE_9Y;4l1Z4j{UDqXWe;9nh`O465 z3H~v-64$%C%(u?@cuaZ1VwJ<9e1(0Gq`&xTv-u!za07NJB0X(Aecqf`pDzS$iSZuF8pzqYSVT zYg{Z=jt6$a*p*w}C$&k^w5HCi&HP-zVCQu1Ds?-32QE@8WQtGs)-R9RWA@PFmdx|3 zs2EFsfDF~D;zh2Vug}?oH%h|GrtBDXR(y}JE|04THtLvr*Zr_+yxeUeY>_{>;*WSB z%IQRV+3ySoYpkW`)`dsmiP3h=x*zJwaG{|I2 zMd5bVZo*^ru%&6<04YG}udwiZrbAjw$1P!8Of?SkOE>mDt|pH%N|o&Ju)0Q z!TvMFMPuChe5PWpHH=KrN^a88&&s7Q)_E|8VSTkLI*u2tVbtG=9GLpN|4r&3nF`=0 z^q=Rl#q=!sZ+MMZl)$+70C0}ZY0Ev?x3_jAO*D$PDExHW0>XHjA0YglPEpwNGneJu z`})i4)aS2@HE!q~cA^pped+H{e5+6t@6^h`d1I%=Am033#i+pE&cQ#`LD3)+%Qf&h z$q7teu(emZ>em7H@vl7|vtKvSxd)8-Fb5Lt>!jyG(QOM|efb z@fl8qwNtz1yzytta%i_?lm&2aHv%@Ldlh>7O9>W`pTR%jIuR6(B|~YK&IX+q$KO7u z3bCBaC)2lrUrRmr$=XLK#w?zFs(vObr4QF6tCM=AW9pE7{`~dC+sEi=q!p8#WvwvO z#`B)RjdZM}fls5YjgVx!>kCLeB`?-84Lf*^*7}X{R+-R;y^8dz!!}SKwoqwz9Is(v zf|8Us$X4K^+x7m~JOEThgoVY$ho+|Uu;`qtt$4vCOcuviW4HLan&FQs#f>S4yyZz) zFZ8Z($$sHFEc~XbJS4uZYFLLN`>W_6eE=Sts{p=gRnGK3ecpt3=B;fwkHa;rp94;& zm~LP`cblW6Xg%S#_#6@-p|B_Lo_^`JAbmwyU*V~j{mRR0!5g#rN6F{=;f*KD`TL<)<-7tVT1>6pV= zYBzXCN61O(-5MtESA72j=d{%?dmhs0TgN~%2cSjxU5_N2=@gWI;)@I?^T{7PcLV3- z!DfWMb)BRwYEAjRSz4J2fL6_xY41#V1?_7Ojf^DrcTyOJSoVI)zr>_#9xEGqXv!q~+U~oC1iwGf684B!*TJUL|+&qIG%TL3{ zy3%G-csAQq<6yZp1nu(BSzaF+KhlYLz6oQwC-e9xXXzG(b8jqtv{bqGV#e3V+$AnV z$c)+Lb!!s&&&bz{rDWS|F!z?aL2XD4kEW7DYi?^9Vj)^PIwuRqY2WH5a zpF#ub_JlCKMj|xtCaOob^0dYdYTiHdoUs*W0b8LL3I@=HjSGc}lWa7`Ed%egRQG+l z;~8efot0S9Zudxbq<^g7n_-1E#-?|~bBvmN=PNO!`d*X%1VK{J#%PVblmwVMBU>!1 zcc~eF&!b)&Zi<(axm6Wk9v7(8{%~RH;Wm}*^Wz~w;H%J`cXc4C*(ue&t~9pG=-sRk z5JC=(D6-Ge9j}>{F+!1ulk?XSqY2gpTa1vLEzvrm)Aw8VyOFJ1_b)XFK+1$K@1Y7j zgDn*2gj<8sa0I0lSu3v}FM35hZ+4v?Ty$BF+{)kM`NeF_*ZM2r)Uhhzh-W2RQwOw1 zo_hWy`*TLAT4|k!g^ai4xPZs8`PWqj0RP+ZUBq!hY!H3;wnDb?)BNn zthLY?7mdS|^cX|ELN!JOrk!+>W~m}%o$iuggn0WPS}VJ}d!|;!!KEkIFCpQMND>X- zq6N=Q*=wF9uPArpyIqrBGrmQdY`tBCx!O1Ww%xM0f7^THTaM!Mr0Yh(6F%N-hLCc} zl@8ZXklzdT5a2_+TqcHO#2!%Bw=-E$vek>6mbi>EHv9EW5-h){g>uKJEkD@XJ=lU= z>McC0I!E^vz(q_>NF3K1bO=>>U|QvA+Ah2}1zgeny4QJP?YU@9-rJW~VFZK0P8OTR zna};3T#l=q*K)HrLS-eP!)J^9`Q{}vx)8N#@$ov?+#9u(-1C0%jga005Bu=5lXHl4 z>4ICTI*DMwgaWx0s8?Pf40H{=*5ZG9uiaQXFMd+p7%67|1~8!5@y^6X z(ZLEG3U4dJCs!^$D6c3!G;p0R9hsgBCq*bqZo@a12=xx8n_@@11-+Y%D@X_RP0s|u zRV?sPK0c?)I$hYe8H)r`lsgQqDeM(%QXI%0@3pqW2Vdzc z?8STFMB)k^E#qT?#;QRs%Ca@|R)vL(aXHXB6Y?+1?7QAzaNt3bQPt_@3f`H&WAFKx z;m5;kJZOoKwl}xgz32XMD;oKUoNde9i)=ZS%$cfZ1Lb>rLL+I%&G3EpUXKHYqejgX zZJ%op|HS-DmQ1-x{<#Ws@3S9i(D8u2ry~g|BVvQwqv76hZHZxKHM}Hi20^bO!Z>fH z;lgw5qH}L7&IMSsfRy0QZj4mgaNcHQ4O)tMu1m=d`o}ZQmag5i$4f2t7R* z^P#5jULSAmPwk}z8>TG(Y!`0FPUHexmV~T~Y-ugm0mPNBstmUf$L)twF!B=QgFVR( zfVZ`F(-ge?z71sWv}`7m?pn%gv{LpnYGqTHb;* z`(B~kB>(v;*vi+)dI3V$8J{0Im80cE-epS0HPiUxc^B`E|~5D^HE1{Ymx} zR_NT<%MuXu)+ zUx*|KfW(;{w|i@okvLud?lNs>S6f^B z#eAD4nvAbn0rSY|Kzeg(cAV|yxr@D16-<6m+Lg#Oo*Vo_XTiC`Vx84Jp6~8mE{^lTDknt@`CT*OIM1xYgt3uHzT35v`Hqy=2-E8b}7?E z>aqlryCh@kS_P6mUz<8=U3P= zLgckUff=r2WZ>E4kY@TqTI#op?>0;l5(Dy7uU_rM*5`@DkHEF2c}oE{SIrJB4K5xsG6bclTO+~wCcU%mLSz zA9K39i>D5yC~2FVZN58$|x7)k*jI zb+OBEx=%^EvuL4Vp4Y8W^fMvuO7*=$CwqS#8ur+s6xHn3G@vvGAe6fGrPG=J(b@<4xu z1)SFF?N>868pc7^tx?wUmdH!s#`ae1tx<3*rTOBu7~|ZVF58&v0Ov$F#v;Sw=E~^E zwxs}FkR9jH{RHM-yNJl}l&-q|&^u5$*sxvrahLk;_Sbl>-<|5HGvUC=ZyN2zq~LFL z;GxfVx5%!V=vSsWEWgkrHUj?#OQgdIb|J`4du>`@-k7y+{TkQ_@Nc^oZ9wl#;BcS4 zpAVpuBKVqX+U)k=5Db2(S!? zuzwZ(yUkEr6d*kStjz`)ej_IOzwk1(YGClI*Vkzpe;GQcI58ae z<$ebLeZ>a=vz9b(o3#GpPN<9k&Rt;Pcfvo2=NCEPMBko=PUIid9i0W>Lvs)l-Ek8C z87P(!IFWp-Q2d8_0ZauzFY-*p{*L+@I6+elu>x2S{}Kyf1*2-2Mm(8hf%Q|O={o9iV-Fv*9d7?ODncSRe z-5AY%dUQWh*2NI>I)-Qu*G$ka1Ij+ml{)l~>)HweKcmtQOlm>=A$0hJvJ`YlL8H zrma>u&n9BP&+c=+hgJ7RYpV?9;-)ac>5G_P)-kgL^QO3&1BgH5IAtdufV_BDk~kI` zCTbv?*?*%`Itj0YO@Np^&K`#=PTNe)?AAP4t@CH~@m>LE5ayMVN+-#-vy6bgH1yn| z&EYxaZoCiI8=DJ;h+L~Shva`4W^b_^6I_+_kEiZ%q@B5Bv-q7tpeW&L`S#>li5O$(;>Mq-*b3)PwAL!Ll#;$#6j5KS7wvkqX+XB={H^DJ%-wTA zM#2WUqHzR}3-uVdM1$4B z6)jK4D!}%wCjC>lWL>`ZKKkMUJSpecxAGL*SA)g3Z`BjS?u-!>h!in_Z~%;>JHpr; zMNbErKG&WJp@1A%X3Z{=Hge*z>|Ez%0Q>i|B&lmz(;mUU2Kx>Rz3Fp#i&7^TacoUG zD1j1$&1M8K`pXgo1oIg1CR((3G=JH8=yHL@gXiWI;O0Hf4TV}bc>-erj40MMArS;4EMcoy%1q|v7B0ngI?9g3pY>VPE@ z0?9$>lho-KO5+%>IXR>E7m5QU9Lz(k4G-RSEl5g9c@!!|X1xM{`#it^%?A2AfekC% zthL_R^us}iF`}PB<+EIzop*f-2GocF(cGm8CXO1PMI}i4Mh3oq4cmbG8|+#@+2x;H z3LdKDD{BJxw2OQp{8W9%IsZp9+HHWL4WO@f|GLQFy8zz3T7v(_+7EvKw8&ZSh^xOb z?!{fA@QSziZ`srWY%ANYrO0mmqphM}FdEJ!zI13m2lPt8Xme22tZRW=qU^9`uq=uH ztl`!uRy5*n2F^g9;>8U3kPzYvOL)rh^)Y3*Eu=7;jmnrsP0=#i- zro+7<#azkKV6jr0i5B%tW88m!#Y^CqYt03}03_9c{-e&C71$6(vRL#@zj+;irT}UH z@rY~fqg|PL;d{B>!$0o!?X}%hyayo6>JJtNu|?BGgRdA)<0R#E*I7>v+BEt+4E^XC zo8xkaJ3hA#lIp{AJVV&N%p|xsOb@eTA72HI(T0}g6SpMUeHG#ygsYJyWyC#CS@r=Y%HQXa9YP0wf<85u8oBHMNho(j3Q?9Eq8Q8a8I z*Si`yB?3rZIs5=vJAJo`U^dKJAzFvIxnDvX^`N8;a27E%_s!g<=*Qt>=EL|45V0V5am^6<_GsGM_DxrEU!Ua0W9y?gv(_SuebF zg4g5VH^9+~BUtg$kK)~ZQb}7SDfayG!#=JTtg(0FsxrSHO3Ch=Xn`XmE1z&tq`nc9 zZ}I*%G?EKTK5-ynO>D(L#js2G3=K4BsG`BT<-@~-1VV)6u=FzmHs;M$vMG7CYC;&trek!v6W6^9&Wbp&g z2u?ks8EqSSY9Fx2;kH$_d}45NMl*(H;-?g zBerK`Z`inevgv);zsw(v&WNo&xl6V^gF}w2b#o#~O zyas(cvLJ}#G5AgmU`Xmkn&ph-v*ig)-Ztsv`+jm{T-IdUS>NwW+!5H^n{Cq^`t?O% zdk}W2;GW#hSffpBxD_O`nsa2okoUMnHfQoEq&zk1>sRLQ4k0Bqq3L(~!DC3c*9f2t2ubYH+V31j`UcK>o$a6sc43`y?) zbwm#?fR@hx+)eRdPctyssf`8q9m?KK9q<<<_tfwH3*fIS1EhaN>j`XJdHrzAP`H0S zK0%#+(Bwtt!wSU2A|?!LctHyXSWsnPLBqk4X%8JMMW-(=zR8o%G&O{(m1YEKmAMz_G#Zv+IcQvxlFfV%7p zFW|<$K%L1VL@%*v_va9Oy5)jtKjPz6TbWIE%&3iSPkX{u_nv*ccOBXNx)2WsSm=7} z?uJ^EyB$LfM7D*T>6Y;g^;~Zt<(35A z!|}V?8l9==Zb!}%z%6n02Pm(vfcD^^!%TBc_CeduF=PvTZLThVtT@9&-(2%U4S0th zRr^6`QwC818XB=$hI9hcQFZZb$@K4`S4q8YB34Rb)f#rpma5>%5;q%-O<(?V7%^wQ z5K&5vORr?< p<8K=Cr^fy7h5uhga!qs*uxZ1EpwLNFy!+D)X$ggQWnxAj{}m&s literal 0 HcmV?d00001 diff --git a/ticdc/deploy-ticdc.md b/ticdc/deploy-ticdc.md index d81e85a31dabf..70e2331003de3 100644 --- a/ticdc/deploy-ticdc.md +++ b/ticdc/deploy-ticdc.md @@ -50,7 +50,7 @@ cdc server --pd=http://10.0.10.25:2379 --log-file=ticdc_3.log --addr=0.0.0.0:830 The following are descriptions of options available in the `cdc server` command: -- `gc-ttl`: The TTL (Time To Live) of the service level `GC safepoint` in PD set by TiCDC, in seconds. The default value is `86400`, which means 24 hours. +- `gc-ttl`: The TTL (Time To Live) of the service level `GC safepoint` in PD set by TiCDC, and the duration that the replication task can suspend, in seconds. The default value is `86400`, which means 24 hours. Note: Suspending of the TiCDC replication task affects the progress of TiCDC GC safepoint, which means that it affects the progress of upstream TiDB GC, as detailed in [Complete Behavior of TiCDC GC safepoint](/ticdc/troubleshoot-ticdc.md#what-is-the-complete-behavior-of-ticdc-garbage-collection-gc-safepoint). - `pd`: The URL of the PD client. - `addr`: The listening address of TiCDC, the HTTP API address, and the Prometheus address of the service. - `advertise-addr`: The access address of TiCDC to the outside world. diff --git a/ticdc/manage-ticdc.md b/ticdc/manage-ticdc.md index 54473d9cb5121..2cf02137e49e7 100644 --- a/ticdc/manage-ticdc.md +++ b/ticdc/manage-ticdc.md @@ -73,6 +73,33 @@ If you deploy TiCDC using TiUP, replace `cdc cli` in the following commands with ### Manage replication tasks (`changefeed`) +#### State transfer of replication tasks + +This feature is available in TiDB v4.0.16 and later versions. + +The state of a replication task represents the running status of the replication task. During the running of TiCDC, replication tasks might fail with errors, be manually paused, resumed, or reach the specified `TargetTs`. These behaviors can lead to the change of the replication task state. This section describes the states of TiCDC replication tasks and the transfer relationships between states. + +![TiCDC state transfer](/media/ticdc-state-transfer.png) + +The states in the above state transfer diagram are described as follows: + +- `Normal`: The replication task runs normally and the checkpoint-ts proceeds normally. +- `Stopped`: The replication task is stopped, because the user manually pauses the changefeed. The changefeed in this state blocks GC operations. +- `Error`: The replication task returns an error. The replication cannot continue due to some recoverable errors. The changefeed in this state keeps trying to resume until the state transfers to `Normal`. The changefeed in this state blocks GC operations. +- `Finished`: The replication task is finished and has reached the preset `TargetTs`. The changefeed in this state does not block GC operations. +- `Failed`: The replication task fails. Due to some unrecoverable errors, the replication task cannot resume and cannot be recovered. The changefeed in this state does not block GC operations. + +The numbers in the above state transfer diagram are described as follows. + +- ① Execute the `changefeed pause` command +- ② Execute the `changefeed resume` command to resume the replication task +- ③ Recoverable errors occur during the `changefeed` operation, and the operation is resumed automatically. +- ④ Execute the `changefeed resume` command to resume the replication task +- ⑤ Recoverable errors occur during the `changefeed` operation +- ⑥ `changefeed` has reached the preset `TargetTs`, and the replication is automatically stopped. +- ⑦ `changefeed` suspended longer than the duration specified by `gc-ttl`, and cannot be resumed. +- ⑧ `changefeed` experienced an unrecoverable error when trying to execute automatic recovery. + #### Create a replication task Execute the following commands to create a replication task: diff --git a/ticdc/troubleshoot-ticdc.md b/ticdc/troubleshoot-ticdc.md index 6c19bd2c04c88..78a5f61a12d03 100644 --- a/ticdc/troubleshoot-ticdc.md +++ b/ticdc/troubleshoot-ticdc.md @@ -139,13 +139,28 @@ cdc cli changefeed update -c --sort-engine="unified" --sort-dir= ## What is `gc-ttl` in TiCDC? -Since v4.0.0-rc.1, PD supports external services in setting the service-level GC safepoint. Any service can register and update its GC safepoint. PD ensures that the key-value data later than this GC safepoint is not cleaned by GC. When the replication task is unavailable or interrupted, this feature ensures that the data to be consumed by TiCDC is retained in TiKV without being cleaned by GC. +Since v4.0.0-rc.1, PD supports external services in setting the service-level GC safepoint. Any service can register and update its GC safepoint. PD ensures that the key-value data later than this GC safepoint is not cleaned by GC. -When starting the TiCDC server, you can specify the Time To Live (TTL) duration of GC safepoint by configuring `gc-ttl`, which means the longest time that data is retained within the GC safepoint. This value is set by TiCDC in PD, which is 86,400 seconds by default. +When the replication task is unavailable or interrupted, this feature ensures that the data to be consumed by TiCDC is retained in TiKV without being cleaned by GC. + +When starting the TiCDC server, you can specify the Time To Live (TTL) duration of GC safepoint by configuring `gc-ttl`. The default value is 24 hours. In TiCDC, this value means: + +- The maximum time the GC safepoint is retained at the PD after the TiCDC service is stopped. +- The maximum time a replication task can be suspended after the task is interrupted or manually stopped. If the time for a suspended replication task is longer than the value set by `gc-ttl`, the replication task enters the `failed` status, cannot be resumed, and cannot continue to affect the progress of the GC safepoint. + +The second behavior above is introduced in TiCDC v4.0.13 and later versions. The purpose is to prevent a replication task in TiCDC from suspending for too long, causing the GC safepoint of the upstream TiKV cluster not to continue for a long time and retaining too many outdated data versions, thus affecting the performance of the upstream cluster. + +> **Note:** +> +> In some scenarios, for example, when you use TiCDC for incremental replication after full replication with Dumpling/BR, the default 24 hours of `gc-ttl` may not be sufficient. You need to specify an appropriate value for `gc-ttl` when you start the TiCDC server. ## What is the complete behavior of TiCDC garbage collection (GC) safepoint? -If a replication task starts after the TiCDC service starts, the TiCDC owner updates the PD service GC safepoint with the smallest value of `checkpoint-ts` among all replication tasks. The service GC safepoint ensures that TiCDC does not delete data generated at that time and after that time. If the replication task is interrupted, the `checkpoint-ts` of this task does not change and PD's corresponding service GC safepoint is not updated either. The Time-To-Live (TTL) that TiCDC sets for a service GC safepoint is 24 hours, which means that the GC mechanism does not delete any data if the TiCDC service can be recovered within 24 hours after it is interrupted. +If a replication task starts after the TiCDC service starts, the TiCDC owner updates the PD service GC safepoint with the smallest value of `checkpoint-ts` among all replication tasks. The service GC safepoint ensures that TiCDC does not delete data generated at that time and after that time. If the replication task is interrupted, or manually stopped, the `checkpoint-ts` of this task does not change. Meanwhile, PD's corresponding service GC safepoint is not updated either. + +If the replication task is suspended longer than the time specified by `gc-ttl`, the replication task enters the `failed` status and cannot be resumed. The PD corresponding service GC safepoint will continue. + +The Time-To-Live (TTL) that TiCDC sets for a service GC safepoint is 24 hours, which means that the GC mechanism does not delete any data if the TiCDC service can be recovered within 24 hours after it is interrupted. ## How do I handle the `Error 1298: Unknown or incorrect time zone: 'UTC'` error when creating the replication task or replicating data to MySQL?