The RemotePingPong benchmark of Akka 1.4.1 is slower than Akka 1.3.16

[ShawnYun]

• Akka.Net version : Akka 1.4.1 and Akka 1.3.16

• On which platform you are using Akka.Net : Windows 10 x64

• Question :
  I run the RemotePingPong benchmark test of Akka 1.4.1 and Akka 1.3.16. Then the result is below:
  You can see that 1.3.16 performs better than 1.4.1. This confused me because I saw that 1.4.1 was
  optimized for DotNetty TCP Transport.

  The figure above is 1.3.16 and the figure below is 1.4.1.
  
  

[Aaronontheweb]

We explain the details about the new batching system here https://getakka.net/articles/remoting/performance.html

First round of the RemotePingPong benchmark falls below the default batching threshold of 30 msg / batch and will always fall below it. For real-world use cases where message traffic is really that low, you should do what the article suggests and disable batching.

On my hardware, I consistently get 174,000 msg / s per connection on Akka.Remote using the default settings on rounds 2-6 of the benchmark. Your mileage may vary - looks like on your hardware the I/O batching doesn't make much of a difference. The reasons why that might be: different OS, different hardware, different runtime version (all of our benchmarks target .NET Core 3.1.)

You can disable the batching system in its entirety through configuration; the link I included earlier will show you how.

[Aaronontheweb]

I also took the liberty of producing a YouTube video today to help explain this in more detail:

https://www.youtube.com/watch?v=mP3amXEntmQ&feature=youtu.be

[Tommo-L]

I also run the benchmark in my local env. It seems v1.4.1 a little better than v1.3.16.

v1.3.15 benchmark code: https://github.com/akkadotnet/akka.net/releases/tag/1.3.16
v1.4.1 benchmark code: https://github.com/akkadotnet/akka.net/tree/dev/src/benchmark/RemotePingPong

Results:

v1.3.16 config

const long repeat = 100000L;  <--- original is 10000L

v1.4.1 config

var baseConfig = ConfigurationFactory.ParseString(@"
	akka {
  actor.provider = remote
  loglevel = ERROR
  suppress-json-serializer-warning = on
  log-dead-letters = off

  remote {
	log-remote-lifecycle-events = off

	dot-netty.tcp {
		port = 0
		hostname = ""localhost""
		batching{
			enabled = false/true
			max-pending-writes = 30
			max-pending-bytes = 16k
			flush-interval = 40ms
		}
	}
  }
}");

[Tommo-L]

Sorry, mistake for v1.3.16 configuration. v1.4.1 is a little better than v1.3.16.