Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add flatten plugin #2004

Merged
merged 3 commits into from
Nov 8, 2022
Merged

add flatten plugin #2004

merged 3 commits into from
Nov 8, 2022

Conversation

z7658329
Copy link
Member

@z7658329 z7658329 commented Nov 4, 2022

No description provided.

@z7658329
Copy link
Member Author

z7658329 commented Nov 4, 2022

see #114

@codecov
Copy link

codecov bot commented Nov 4, 2022

Codecov Report

Merging #2004 (0373c06) into master (89ebbfd) will decrease coverage by 0.00%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master    #2004      +/-   ##
============================================
- Coverage     70.51%   70.50%   -0.01%     
+ Complexity      978      976       -2     
============================================
  Files           453      453              
  Lines         39024    39024              
  Branches       5556     5556              
============================================
- Hits          27517    27514       -3     
- Misses         8808     8812       +4     
+ Partials       2699     2698       -1     
Impacted Files Coverage Δ
.../hugegraph/backend/store/rocksdb/RocksDBTable.java 67.11% <0.00%> (-2.02%) ⬇️
...hugegraph/backend/store/raft/rpc/RpcForwarder.java 69.49% <0.00%> (-1.70%) ⬇️
...ugegraph/backend/store/raft/StoreStateMachine.java 64.86% <0.00%> (-0.91%) ⬇️
...hugegraph/backend/store/raft/rpc/RaftRequests.java 18.78% <0.00%> (-0.24%) ⬇️
...va/com/baidu/hugegraph/util/collection/IntMap.java 72.80% <0.00%> (+0.39%) ⬆️
...va/com/baidu/hugegraph/util/collection/IntSet.java 75.00% <0.00%> (+1.27%) ⬆️
...c/main/java/com/baidu/hugegraph/util/JsonUtil.java 71.15% <0.00%> (+3.84%) ⬆️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@javeme
Copy link
Contributor

javeme commented Nov 8, 2022

ci error of rocksdb-raft :

2022-11-08 11:47:02 [main] [INFO] c.b.h.StandardHugeGraph - Init system info for graph 'hugegraph'
2022-11-08 11:47:03 [main] [INFO] c.b.h.StandardHugeGraph - Init server info [server3-WORKER] for graph 'hugegraph'...
2022-11-08 11:47:03 [JRaft-FSMCaller-Disruptor-0] [WARN] c.a.s.j.c.NodeImpl - Node <hugegraph/127.0.0.1:8093> got error:
    Error [type=ERROR_TYPE_STATE_MACHINE, status=Status[ESTATEMACHINE<10002>:
    StateMachine meet critical error when applying one or more tasks since index=4, Status[ESTATEMACHINE<10002>:
    StateMachine occurred critical error:
    java.lang.RuntimeException: Too many listeners for: cache]]].
2022-11-08 11:47:03 [JRaft-FSMCaller-Disruptor-0] [WARN] c.a.s.j.c.FSMCallerImpl - FSMCaller already in error status, ignore new error.
com.alipay.sofa.jraft.error.RaftException: null
	at com.alipay.sofa.jraft.core.IteratorImpl.getOrCreateError(IteratorImpl.java:182) ~[jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.IteratorImpl.setErrorAndRollback(IteratorImpl.java:173) ~[jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.IteratorWrapper.setErrorAndRollback(IteratorWrapper.java:83) ~[jraft-core-1.3.11.jar:?]
	at com.baidu.hugegraph.backend.store.raft.StoreStateMachine.onApply(StoreStateMachine.java:99) ~[hugegraph-core-0.13.0.jar:0.13.0.0]
	at com.alipay.sofa.jraft.core.FSMCallerImpl.doApplyTasks(FSMCallerImpl.java:577) [jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.FSMCallerImpl.doCommitted(FSMCallerImpl.java:541) [jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.FSMCallerImpl.runApplyTask(FSMCallerImpl.java:449) [jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.FSMCallerImpl.access$100(FSMCallerImpl.java:72) [jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.FSMCallerImpl$ApplyTaskHandler.onEvent(FSMCallerImpl.java:149) [jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.core.FSMCallerImpl$ApplyTaskHandler.onEvent(FSMCallerImpl.java:141) [jraft-core-1.3.11.jar:?]
	at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:137) [disruptor-3.3.7.jar:?]
	at java.lang.Thread.run(Thread.java:750) [?:1.8.0_352]
2022-11-08 11:47:03 [Bolt-default-executor-4-thread-10] [WARN] c.b.h.b.s.r.r.StoreCommandProcessor - Failed to process StoreCommandRequest: COMMIT_TX
com.baidu.hugegraph.backend.BackendException: Failed to wait store command StoreCommand{type=SYSTEM,action=COMMIT_TX}
	at com.baidu.hugegraph.backend.store.raft.RaftNode.submitAndWait(RaftNode.java:144) ~[hugegraph-core-0.13.0.jar:0.13.0.0]
	at com.baidu.hugegraph.backend.store.raft.rpc.StoreCommandProcessor.processRequest(StoreCommandProcessor.java:58) ~[hugegraph-core-0.13.0.jar:0.13.0.0]
	at com.baidu.hugegraph.backend.store.raft.rpc.StoreCommandProcessor.processRequest(StoreCommandProcessor.java:37) ~[hugegraph-core-0.13.0.jar:0.13.0.0]
	at com.alipay.sofa.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:53) ~[jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.rpc.RpcRequestProcessor.handleRequest(RpcRequestProcessor.java:35) ~[jraft-core-1.3.11.jar:?]
	at com.alipay.sofa.jraft.rpc.impl.BoltRpcServer$2.handleRequest(BoltRpcServer.java:124) ~[jraft-core-1.3.11.jar:?]
	at com.alipay.remoting.rpc.protocol.RpcRequestProcessor.dispatchToUserProcessor(RpcRequestProcessor.java:235) ~[bolt-1.6.4.jar:?]
	at com.alipay.remoting.rpc.protocol.RpcRequestProcessor.doProcess(RpcRequestProcessor.java:146) ~[bolt-1.6.4.jar:?]
	at com.alipay.remoting.rpc.protocol.RpcRequestProcessor$ProcessTask.run(RpcRequestProcessor.java:393) ~[bolt-1.6.4.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_352]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_352]
	at java.lang.Thread.run(Thread.java:750) [?:1.8.0_352]
	at com.baidu.hugegraph.task.ServerInfoManager.call(ServerInfoManager.java:298)
	at com.baidu.hugegraph.task.ServerInfoManager.serverInfo(ServerInfoManager.java:311)
	at com.baidu.hugegraph.task.ServerInfoManager.initServerInfo(ServerInfoManager.java:114)
	at com.baidu.hugegraph.StandardHugeGraph.serverStarted(StandardHugeGraph.java:267)
	at com.baidu.hugegraph.auth.HugeGraphAuthProxy.serverStarted(HugeGraphAuthProxy.java:675)
	at com.baidu.hugegraph.core.GraphManager.serverStarted(GraphManager.java:443)
	at com.baidu.hugegraph.core.GraphManager.init(GraphManager.java:119)
	at com.baidu.hugegraph.server.ApplicationConfig$GraphManagerFactory$1.onEvent(ApplicationConfig.java:132)
	at org.glassfish.jersey.server.internal.monitoring.CompositeApplicationEventListener.onEvent(CompositeApplicationEventListener.java:49)
	at org.glassfish.jersey.server.internal.monitoring.MonitoringContainerListener.onStartup(MonitoringContainerListener.java:56)
	at org.glassfish.jersey.server.ApplicationHandler.onStartup(ApplicationHandler.java:711)
	at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.start(GrizzlyHttpContainer.java:330)
	at org.glassfish.grizzly.http.server.HttpHandlerChain.start(HttpHandlerChain.java:376)
	at org.glassfish.grizzly.http.server.HttpServer.setupHttpHandler(HttpServer.java:268)
	at org.glassfish.grizzly.http.server.HttpServer.start(HttpServer.java:245)
	at com.baidu.hugegraph.server.RestServer.start(RestServer.java:73)
	at com.baidu.hugegraph.server.RestServer.start(RestServer.java:180)
	at com.baidu.hugegraph.dist.HugeRestServer.start(HugeRestServer.java:34)
	at com.baidu.hugegraph.dist.HugeGraphServer.<init>(HugeGraphServer.java:62)
	at com.baidu.hugegraph.dist.HugeGraphServer.main(HugeGraphServer.java:122)
Caused by: java.util.concurrent.ExecutionException: com.baidu.hugegraph.backend.BackendException: Failed to execute query: `Query * from VERTEX where id in [0x8673657276657233]`
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at com.baidu.hugegraph.task.ServerInfoManager.call(ServerInfoManager.java:295)
	... 19 more
Caused by: com.baidu.hugegraph.backend.BackendException: Failed to execute query: `Query * from VERTEX where id in [0x8673657276657233]`
	at com.baidu.hugegraph.backend.store.raft.RaftBackendStore.queryByRaft(RaftBackendStore.java:247)
	at com.baidu.hugegraph.backend.store.raft.RaftBackendStore.queryByRaft(RaftBackendStore.java:219)
	at com.baidu.hugegraph.backend.store.raft.RaftBackendStore.query(RaftBackendStore.java:154)
	at com.baidu.hugegraph.backend.tx.AbstractTransaction.query(AbstractTransaction.java:163)
	at com.baidu.hugegraph.backend.tx.GraphTransaction.query(GraphTransaction.java:532)
	at com.baidu.hugegraph.backend.tx.GraphTransaction.queryVerticesFromBackend(GraphTransaction.java:802)
	at com.baidu.hugegraph.backend.tx.GraphTransaction.queryVerticesByIds(GraphTransaction.java:750)
	at com.baidu.hugegraph.backend.tx.GraphTransaction.queryVertices(GraphTransaction.java:704)
	at com.baidu.hugegraph.task.ServerInfoManager.lambda$serverInfo$3(ServerInfoManager.java:312)
	at com.baidu.hugegraph.task.TaskManager$ContextCallable.call(TaskManager.java:354)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: com.baidu.hugegraph.backend.BackendException: Failed to do raft read-index: Status[EPERM<1008>: Invalid state for readIndex: STATE_ERROR.]
	at com.baidu.hugegraph.backend.store.raft.RaftBackendStore$1.run(RaftBackendStore.java:235)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl$ReadIndexResponseClosure.notifyFail(ReadOnlyServiceImpl.java:217)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl$ReadIndexResponseClosure.run(ReadOnlyServiceImpl.java:167)
	at com.alipay.sofa.jraft.core.NodeImpl.handleReadIndexRequest(NodeImpl.java:1508)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl.executeReadIndexEvents(ReadOnlyServiceImpl.java:239)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl.access$200(ReadOnlyServiceImpl.java:70)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl$ReadIndexEventHandler.onEvent(ReadOnlyServiceImpl.java:132)
	at com.alipay.sofa.jraft.core.ReadOnlyServiceImpl$ReadIndexEventHandler.onEvent(ReadOnlyServiceImpl.java:115)
	at com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:137)
	... 1 more
Error: Process completed with exit code 1.

@javeme javeme merged commit 0dfb124 into apache:master Nov 8, 2022
imbajin added a commit that referenced this pull request Aug 7, 2023
* init(pd): history merged until 2023.5.6

* refact: unify LF line separator

Change-Id: I3f38685af534468a51b79b7f45d24fdb30a74f34

* refact: add header & format in test & service & grpc & dist modules

Change-Id: Id2fa1374d7fa85635906a7e75655e7dad56f1807

* refact: add header/format in core & common & clitools & client modules

Change-Id: Id8ec0a0d754f646c59f7251158dd89de669b2016

* refact: format root/parent modules & pd-service package name & rearrange code

Change-Id: Id8ec0a0d754f646c59f7251158dd89de669b2016

* chore: search & replace to "org.apache" manually

- also replace "a/b/c" regrex
- replace pom version to ${revision}

Change-Id: Ia3a9ce891fcff58cef4a5a1f95adb44ef8ee8049

* chore: fix some code problems

- lack this with instance filed
- lack {} in 'if/while/for'

Change-Id: I37d21f1ab94529a8122f4598636fbe02b2264904

* refact: update code to Jun2 2023

GraphPlatform-2020 fix cache bug when direct put

Change-Id: I52428d8d5d4bb977ee7796c0fe1e4ced07aff12d

GraphPlatform-2020 fix cache bug when direct put

Change-Id: Id57427a94732e12f2d96429a2b677d5c5f71e8ff

GraphPlatform-1771 update code

Change-Id: Ic3b95ca22900453adbc3571734e1da2c97e28355

* build: add flatten plugin and fix dependency version

1. Added the
[flatten](#2004)
plugin.
2. Unified the global version to 1.5.0.
3. Modified the version of `jraft-core`.

---------

Co-authored-by: imbajin <[email protected]>

* build: fix build for community edition compatibility (WIP)

Please refer to
https://hugegraph.feishu.cn/wiki/Y6d2wys9KiWf24kpzNKct0Yknnr for
detailed fix documentation.

---------

Co-authored-by: imbajin <[email protected]>

* refact: adapt for jraft v1.3.13

* refact: GP-2141 handle low speed import - 6.9

from inner commit 0a95b1e587e65ea6a0a06774d53c80868f36af5b

---------

Co-authored-by: V_Galaxy <[email protected]>

* refact: GP-2141 handle low speed import - Compile OK

from inner commit 0a95b1e587e65ea6a0a06774d53c80868f36af5b

fix store compile problem
https://hugegraph.feishu.cn/wiki/Y6d2wys9KiWf24kpzNKct0Yknnr

---------
Co-authored-by: V_Galaxy <[email protected]>

* chore: enhance pom & start file

---------

Co-authored-by: V_Galaxy <[email protected]>

* refact: prepare before merge

* chore: fix pom for submodules in hugegraph-pd

* chore: add apache-rat-plugin for hugegraph-pd

and add some license headers

* chore: clean some comment/code

---------

Co-authored-by: imbajin <[email protected]>
Co-authored-by: What is broken can be reforged <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants