Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Show real outgoing bytes #236

Merged
merged 24 commits into from
Aug 24, 2022
Merged

Conversation

chinghongfang
Copy link
Collaborator

#226

我們的performance tool目前只會顯示"serialized value"大小,無法看到真正傳輸出去的資料量大小,由於我們的工具會支援"壓縮",所以我們更需要真正的傳輸量。

這隻pr在Producer介面新增一個新的方法,用來獲取producer/consumer的KafkaMetrics,讓我們可以取得producer/consumer內部紀錄的數據。
並且將暴露出來的KafkaMetrics放在astraea.performance.Metrics中保管(計算&轉型)。讓tracker輸出實際傳輸量,提供使用者更多資訊。

Track producers' "outgoing-byte-total" and consumers' "incoming-byte-total".
@chia7712
Copy link
Contributor

@chinghongfang 剛剛合併了 #214 就噴出一堆衝突了@@ 麻煩再修正一下

Add unit test for transactional producer on real bytes output.
Fix unit test and make more assertions.
@chia7712
Copy link
Contributor

@chinghongfang 這個進度如何?

@chinghongfang
Copy link
Collaborator Author

因為 #460 引進了local mbean ,接下來將使用local mbean 來改寫。

Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chinghongfang 感謝更新,兩個建議請看一下

app/src/main/java/org/astraea/app/producer/Builder.java Outdated Show resolved Hide resolved
app/src/main/java/org/astraea/app/performance/Metrics.java Outdated Show resolved Hide resolved
chia7712
chia7712 previously approved these changes Aug 17, 2022
Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chinghongfang 這次的修改也很棒,剩一個小意見請看一下

@chia7712
Copy link
Contributor

@chinghongfang 狀況如何?可否完成最後一個小修改後合併?

@chinghongfang
Copy link
Collaborator Author

我不了解要用什麼Utils的工具,來確定close()有完成,所以還沒更新。請問Utils有提供這種工具嗎?或者我再找找看再更新。

@chia7712
Copy link
Contributor

我不了解要用什麼Utils的工具,來確定close()有完成,所以還沒更新。請問Utils有提供這種工具嗎?或者我再找找看再更新。

我的意思是前一個close如果失敗,會導致後一個close沒有被執行,因此請用Utils.swallowException來包裝一下

Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chinghongfang 還有兩個小地方請看一下

Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chinghongfang 還有兩個細節請看一下

@chia7712
Copy link
Contributor

@chinghongfang 不好意思,麻煩修復一下衝突

Copy link
Contributor

@chia7712 chia7712 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chinghongfang 有兩個使用上的建議請看一下

@chia7712 chia7712 merged commit e98bd3b into opensource4you:main Aug 24, 2022
@chinghongfang chinghongfang deleted the compressedSize branch September 13, 2022 08:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants