Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set sock rx Buf size to 3MB. #5566

Merged
merged 2 commits into from
Oct 15, 2020
Merged

Set sock rx Buf size to 3MB. #5566

merged 2 commits into from
Oct 15, 2020

Conversation

rajkumar38
Copy link
Contributor

@rajkumar38 rajkumar38 commented Oct 8, 2020

- Why I did it
netlink out of memory seen for 8K neighbor updates.
- How I did it

  1. Config IP to 2 interfaces connected to ixia. Ethernet1 (21.0.0.1/16) and Ethernet4 (24.1.1.1/24)

  2. DUT copp rules are as ARP CIR=2000 and IP2ME CIR=6000

  3. Start Continuous Traffic (5G) is started from ixia connected to Ethernet4 with the DIP matching with the 8K ARP Host Range before learning ARP entries. These traffic will be software forwarded from linux kernel.

  4. DUT is configured to learn ARP through ARP Reply packets
    echo 1 > /proc/sys/net/ipv4/conf/Ethernet1/arp_accept

  5. Start continuous ARP Reply Packet is sent from IXIA connected to Ethernet1 Port at 2K Packet/Secs with Host IP starting from 20.20.0.2 and Incrementing for 8K.

After step (5), expectation is all 5G traffic must be forwarded from ASIC but not all NEIGH entries are updated to APP_DB and ASIC_DB because of out of memory error.

- How to verify it

- Which release branch to backport (provide reason below if selected)

  • 201811
  • 201911
  • 202006

- Description for the changelog

- A picture of a cute animal (not mandatory but encouraged)

@jleveque jleveque requested a review from prsunny October 8, 2020 20:04
@@ -34,6 +34,6 @@ net.ipv6.conf.all.keep_addr_on_down=1
net.ipv6.conf.eth0.keep_addr_on_down=1
net.ipv4.tcp_l3mdev_accept=1
net.ipv4.udp_l3mdev_accept=1
net.core.rmem_max=2097152
net.core.rmem_max=3145728
net.core.wmem_max=2097152
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need to update the wmem?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can increase both values

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can increase the send buffer size to 3M. Updated PR with the changes.

@keboliu
Copy link
Collaborator

keboliu commented Nov 17, 2020

in 201911 branch images sometimes see netlink out of memory error log, it would be good to cherry-pick this to 201911

syslog.2352.gz:Oct 21 13:37:08.196399 mtbc-sonic-03-2700 ERR swss#neighsyncd: :- readData: netlink reports out of memory on reading a netlink socket. High possiblity of a lost message
syslog.2353.gz:Oct 21 13:25:48.342516 mtbc-sonic-03-2700 ERR swss#neighsyncd: :- readData: netlink reports out of memory on reading a netlink socket. High possiblity of a lost message
syslog.2353.gz:Oct 21 13:29:38.205270 mtbc-sonic-03-2700 ERR swss#neighsyncd: :- readData: netlink reports out of memory on reading a netlink socket. High possiblity of a lost message
syslog.2354.gz:Oct 21 13:19:35.727520 mtbc-sonic-03-2700 ERR swss#neighsyncd: :- readData: netlink reports out of memory on reading a netlink socket. High possiblity of a lost message
syslog.2356.gz:Oct 21 12:35:15.737141 mtbc-sonic-03-2700 ERR swss#neighsyncd: :- readData: netlink reports out of memory on reading a netlink socket. High possiblity of a lost message

@keboliu
Copy link
Collaborator

keboliu commented Nov 18, 2020

@abdosi would you please help to cherry-pick this to 201911?

abdosi pushed a commit that referenced this pull request Nov 24, 2020
* Set sock rx Buf size to 3MB.
santhosh-kt pushed a commit to santhosh-kt/sonic-buildimage that referenced this pull request Feb 25, 2021
* Set sock rx Buf size to 3MB.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants