[Bugfix] use AF_INET6 instead of AF_INET for OpenAI Compatible Server

[jxpxxzj]

Currently the OpenAI Compatible Server creates a socket outside of vllm.entrypoints.launcher.serve_http, and this socket uses the socket.AF_INET address family. On machines with only IPv6 addresses, this limitation prevents the socket from being accessed externally.
I made a small modification, changing it to socket.AF_INET6, so that it supports both IPv4 and IPv6 addresses.

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can do one of these:

• Add ready label to the PR
• Enable auto-merge.

🚀

[piamo]

there's a simple implemention

addr = ("", args.port)
if socket.has_dualstack_ipv6():
    sock = socket.create_server(addr, family=socket.AF_INET6, dualstack_ipv6=True)
else:
    sock = socket.create_server(addr)

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @jxpxxzj.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[russellb]

This looks great now. Thanks for the IPv6 fix!

[shcheglovnd]

I made a small modification, changing it to socket.AF_INET6, so that it supports both IPv4 and IPv6 addresses.

AF_INET6 does not support both ipv4 and ipv6 by default. It can be ipv6 only, so we should not use it here by default.

[jxpxxzj]

hi @njhill please review this pr at your convenience and share more suggesstions :)

[russellb]

hi @njhill please review this pr at your convenience and share more suggesstions :)

It looks like the suggested change from previous review still needs to be completed.

[jxpxxzj]

hi @njhill please review this pr at your convenience and share more suggesstions :)

It looks like the suggested change from previous review still needs to be completed.

should all fixed and ci passed, please check again :)

[russellb]

lgtm!

It's ready for another look from you, @youkaichao

[youkaichao]

thanks for the fix!