Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

guard against None in leakreplay attempt history management #1081

Merged
merged 2 commits into from
Jan 16, 2025

Conversation

leondz
Copy link
Collaborator

@leondz leondz commented Jan 15, 2025

resolves #879

NoneType in attempt message history would cause a crash when leakreplay rewrites that message history. Guard against None here. It's unclear how a None would get in there in the first place, but the original report hasn't had updates, so this may have been a transient behaviour.

Thanks @bleszily

Verification

  • python -m pytest tests/probes/test_probes_leakreplay.py::test_leakreplay_handle_incomplete_attempt

@leondz leondz added bug Something isn't working probes Content & activity of LLM probes labels Jan 15, 2025
@leondz leondz requested a review from jmartin-tech January 15, 2025 12:55
Copy link
Collaborator

@jmartin-tech jmartin-tech left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, this will be something to watch for in future _postprocess_hook implementations.

@leondz leondz merged commit 8f84963 into NVIDIA:main Jan 16, 2025
11 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Jan 16, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working probes Content & activity of LLM probes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug in Leakreplay Probe
2 participants