Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Errors VWA #249

Closed
recursix opened this issue Nov 8, 2024 · 3 comments
Closed

Errors VWA #249

recursix opened this issue Nov 8, 2024 · 3 comments

Comments

@recursix
Copy link
Collaborator

recursix commented Nov 8, 2024 •
edited
Loading

Error report 3/3

11x : Exception uncaught by agent or environment in task <task_name>.
TimeoutError:
Timeout 10000ms exceeded.
========================

  • visualwebarena.282 seed: 22
  • visualwebarena.305 seed: 18
  • visualwebarena.314 seed: 0
  • visualwebarena.317 seed: 31
  • visualwebarena.318 seed: 24
  • visualwebarena.319 seed: 0
  • visualwebarena.410 seed: 18
  • visualwebarena.411 seed: 11
  • visualwebarena.427 seed: 4
  • visualwebarena.436 seed: 6
  • visualwebarena.440 seed: 1

Showing Max 3 stack traces:

2024-11-08 07:31:14,272 - 3894759 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22
2024-11-08 07:31:14,273 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,274 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,297 - 3894759 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,558 - 3894759 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,845 - 3894759 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,230 - 3894759 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:31,720 - 3894759 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful'>
2024-11-08 07:31:41,094 - 3894759 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.282.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================

2024-11-08 07:31:41,097 - 3894759 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:31:14,278 - 3894762 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18
2024-11-08 07:31:14,279 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,280 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,303 - 3894762 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,483 - 3894762 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,765 - 3894762 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,157 - 3894762 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,464 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,466 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:30,567 - 3894762 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new'>
2024-11-08 07:31:40,263 - 3894762 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.305.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
-------------------
## 11x : Exception uncaught by agent or environment in task <task_name>.<br>TimeoutError:<br>Timeout 10000ms exceeded.<br>========================

* visualwebarena.282 seed: 22
* visualwebarena.305 seed: 18
* visualwebarena.314 seed: 0
* visualwebarena.317 seed: 31
* visualwebarena.318 seed: 24
* visualwebarena.319 seed: 0
* visualwebarena.410 seed: 18
* visualwebarena.411 seed: 11
* visualwebarena.427 seed: 4
* visualwebarena.436 seed: 6
* visualwebarena.440 seed: 1

Showing Max 3 stack traces:

```bash
2024-11-08 07:31:14,272 - 3894759 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22
2024-11-08 07:31:14,273 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,274 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,297 - 3894759 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,558 - 3894759 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,845 - 3894759 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,230 - 3894759 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:31,720 - 3894759 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful'>
2024-11-08 07:31:41,094 - 3894759 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.282.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================

2024-11-08 07:31:41,097 - 3894759 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:31:14,278 - 3894762 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18
2024-11-08 07:31:14,279 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,280 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,303 - 3894762 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,483 - 3894762 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,765 - 3894762 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,157 - 3894762 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,464 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,466 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:30,567 - 3894762 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new'>
2024-11-08 07:31:40,263 - 3894762 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.305.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
-------------------
## 11x : Exception uncaught by agent or environment in task <task_name>.<br>TimeoutError:<br>Timeout 10000ms exceeded.<br>========================

* visualwebarena.282 seed: 22
* visualwebarena.305 seed: 18
* visualwebarena.314 seed: 0
* visualwebarena.317 seed: 31
* visualwebarena.318 seed: 24
* visualwebarena.319 seed: 0
* visualwebarena.410 seed: 18
* visualwebarena.411 seed: 11
* visualwebarena.427 seed: 4
* visualwebarena.436 seed: 6
* visualwebarena.440 seed: 1

Showing Max 3 stack traces:

```bash
2024-11-08 07:31:14,272 - 3894759 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22
2024-11-08 07:31:14,273 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,274 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,297 - 3894759 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,558 - 3894759 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,845 - 3894759 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,230 - 3894759 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,319 - 3894759 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:31,720 - 3894759 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful'>
2024-11-08 07:31:41,094 - 3894759 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.282.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================

2024-11-08 07:31:41,097 - 3894759 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:31:14,278 - 3894762 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18
2024-11-08 07:31:14,279 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,280 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,303 - 3894762 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,483 - 3894762 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,765 - 3894762 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,157 - 3894762 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,464 - 3894762 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,466 - 3894762 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:30,567 - 3894762 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new'>
2024-11-08 07:31:40,263 - 3894762 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.305.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================

2024-11-08 07:31:40,266 - 3894762 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:31:14,269 - 3894763 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.314_0 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-30-16_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.314_0
2024-11-08 07:31:14,271 - 3894763 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:14,273 - 3894763 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:31:14,305 - 3894763 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:31:15,572 - 3894763 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:31:15,851 - 3894763 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:31:17,262 - 3894763 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:31:18,435 - 3894763 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:31:18,436 - 3894763 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:31:30,952 - 3894763 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/mildlyinteresting'>
2024-11-08 07:31:40,356 - 3894763 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.314.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/mildlyinteresting", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
@recursix
Copy link
Collaborator Author

recursix commented Nov 8, 2024

Error report 2/3

11x : Exception uncaught by agent or environment in task <task_name>.
TimeoutError:
Timeout 10000ms exceeded.
========================

  • visualwebarena.282 seed: 22
  • visualwebarena.305 seed: 18
  • visualwebarena.314 seed: 0
  • visualwebarena.317 seed: 31
  • visualwebarena.318 seed: 24
  • visualwebarena.319 seed: 0
  • visualwebarena.410 seed: 18
  • visualwebarena.411 seed: 11
  • visualwebarena.427 seed: 4
  • visualwebarena.436 seed: 6
  • visualwebarena.440 seed: 1

Showing Max 3 stack traces:

2024-11-08 07:20:59,519 - 3886884 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-20-01_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.282_22
2024-11-08 07:20:59,520 - 3886884 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:20:59,521 - 3886884 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:20:59,546 - 3886884 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:21:00,662 - 3886884 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:21:00,912 - 3886884 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:21:02,285 - 3886884 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:21:03,443 - 3886884 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:21:03,443 - 3886884 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:21:16,425 - 3886884 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful'>
2024-11-08 07:21:26,001 - 3886884 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.282.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/dataisbeautiful", waiting until "load"
============================================================

2024-11-08 07:21:26,004 - 3886884 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:20:59,547 - 3886883 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-20-01_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.305_18
2024-11-08 07:20:59,548 - 3886883 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:20:59,549 - 3886883 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:20:59,572 - 3886883 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:21:00,772 - 3886883 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:21:01,031 - 3886883 - asyncio - DEBUG - Using selector: EpollSelector
2024-11-08 07:21:02,420 - 3886883 - datasets - INFO - PyTorch version 2.5.1 available.
2024-11-08 07:21:03,495 - 3886883 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:21:03,496 - 3886883 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
...
...truncated middle of the log
...
2024-11-08 07:21:15,456 - 3886883 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new'>
2024-11-08 07:21:25,350 - 3886883 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.305.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/memes/new", waiting until "load"
============================================================

2024-11-08 07:21:25,353 - 3886883 - browsergym.experiments.loop - INFO - Saving summary info.

2024-11-08 07:20:59,546 - 3886886 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.314_0 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-20-01_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.314_0
2024-11-08 07:20:59,547 - 3886886 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:20:59,548 - 3886886 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:20:59,572 - 3886886 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:20:59,573 - 3886886 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:21:00,590 - 3886886 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/preprocessor_config.json HTTP/11" 200 0
2024-11-08 07:21:00,624 - 3886886 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/tokenizer_config.json HTTP/11" 200 0
2024-11-08 07:21:00,784 - 3886886 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/processor_config.json HTTP/11" 404 0
2024-11-08 07:21:00,825 - 3886886 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/chat_template.json HTTP/11" 404 0
...
...truncated middle of the log
...
2024-11-08 07:21:09,169 - 3886886 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/mildlyinteresting'>
2024-11-08 07:21:19,937 - 3886886 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.314.
TimeoutError:
Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/mildlyinteresting", waiting until "load"
============================================================
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 224, in run
    step_info.from_reset(
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 415, in from_reset
    self.obs, env_info = env.reset(seed=seed)
                         ^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 75, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 61, in reset
    return self.env.reset(**kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 292, in reset
    task_goal, task_info = self.task.setup(page=self.page)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 228, in setup
    page.goto(url)
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 9303, in goto
    self._sync(
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 473, in goto
    return await self._main_frame.goto(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 138, in goto
    await self._channel.send("goto", locals_to_params(locals()))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.TimeoutError: Timeout 10000ms exceeded.
=========================== logs ===========================
navigating to "http://visualwebarenafast.eastus.cloudapp.azure.com:8080/f/mildlyinteresting", waiting until "load"
============================================================

2024-11-08 07:21:19,942 - 3886886 - browsergym.experiments.loop - INFO - Saving summary info.

1x : Exception uncaught by agent or environment in task <task_name>.
Error:
Execution context was destroyed, most likely because of a navigatio

  • visualwebarena.401 seed: 24

Showing Max 3 stack traces:

2024-11-08 07:21:25,524 - 3886887 - browsergym.experiments.loop - INFO - Running experiment GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.401_24 in:
  /home/toolkit/agentlab_results/2024-11-07_22-07-11_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena/2024-11-08_07-20-01_GenericAgent-gpt-4o-mini-2024-07-18_on_visualwebarena.401_24
2024-11-08 07:21:25,525 - 3886887 - httpx - DEBUG - load_ssl_context verify=True cert=None trust_env=True http2=False
2024-11-08 07:21:25,526 - 3886887 - httpx - DEBUG - load_verify_locations cafile='/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/certifi/cacert.pem'
2024-11-08 07:21:25,554 - 3886887 - browsergym.experiments.loop - DEBUG - Agent created.
2024-11-08 07:21:25,555 - 3886887 - browsergym.experiments.loop - DEBUG - Environment created.
2024-11-08 07:21:26,526 - 3886887 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/preprocessor_config.json HTTP/11" 200 0
2024-11-08 07:21:26,562 - 3886887 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/tokenizer_config.json HTTP/11" 200 0
2024-11-08 07:21:26,738 - 3886887 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/processor_config.json HTTP/11" 404 0
2024-11-08 07:21:26,771 - 3886887 - urllib3.connectionpool - DEBUG - https://huggingface.co:443 "HEAD /Salesforce/blip2-flan-t5-xl/resolve/main/chat_template.json HTTP/11" 404 0
...
...truncated middle of the log
...
action:
click('116')

2024-11-08 07:21:42,336 - 3886887 - browsergym.experiments.loop - DEBUG - Chat info sent.
2024-11-08 07:21:42,336 - 3886887 - browsergym.experiments.loop - DEBUG - Sending action to environment.
2024-11-08 07:21:42,336 - 3886887 - browsergym.core.env - DEBUG - Executing action
2024-11-08 07:21:42,445 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:42,449 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:42,454 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:42,457 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:42,459 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:45,452 - 3886887 - browsergym.core.env - DEBUG - Action executed
2024-11-08 07:21:45,979 - 3886887 - browsergym.core.env - DEBUG - Active page checked
2024-11-08 07:21:45,979 - 3886887 - browsergym.core.env - DEBUG - User message done
2024-11-08 07:21:45,980 - 3886887 - browsergym.core.env - DEBUG - Initiating task validation
2024-11-08 07:21:47,654 - 3886887 - browsergym.experiments.loop - WARNING - Exception uncaught by agent or environment in task visualwebarena.401.
Error:
Execution context was destroyed, most likely because of a navigation
Traceback (most recent call last):
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 254, in run
    step_info.from_step(env, action, obs_preprocessor=agent.obs_preprocessor)
  File "/home/toolkit/dev/BrowserGym/browsergym/experiments/src/browsergym/experiments/loop.py", line 389, in from_step
    self.obs, self.reward, self.terminated, self.truncated, env_info = env.step(action)
                                                                       ^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/time_limit.py", line 57, in step
    observation, reward, terminated, truncated, info = self.env.step(action)
                                                       ^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/gymnasium/wrappers/order_enforcing.py", line 56, in step
    return self.env.step(action)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 422, in step
    reward, done, user_message, task_info = self._task_validate()
                                            ^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/core/src/browsergym/core/env.py", line 447, in _task_validate
    reward, done, user_message, info = self.task.validate(self.page, self.chat.messages)
                                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/dev/BrowserGym/browsergym/visualwebarena/src/browsergym/visualwebarena/task.py", line 283, in validate
    score = self.evaluator(
            ^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/visualwebarena/evaluation_harness/evaluators.py", line 636, in __call__
    cur_score = evaluator(trajectory, config_file, page)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<@beartype(visualwebarena.evaluation_harness.evaluators.PageImageEvaluator.__call__) at 0x7f43f1f83380>", line 92, in __call__
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/visualwebarena/evaluation_harness/evaluators.py", line 532, in __call__
    elements = page.query_selector_all(locator)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/sync_api/_generated.py", line 8237, in query_selector_all
    self._sync(self._impl_obj.query_selector_all(selector=selector))
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_sync_base.py", line 109, in _sync
    return task.result()
           ^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_page.py", line 337, in query_selector_all
    return await self._main_frame.query_selector_all(selector)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 304, in query_selector_all
    await self._channel.send("querySelectorAll", dict(selector=selector)),
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 61, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 490, in wrap_api_call
    return await cb()
           ^^^^^^^^^^
  File "/home/toolkit/micromamba/envs/ui-assist/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 99, in inner_send
    result = next(iter(done)).result()
             ^^^^^^^^^^^^^^^^^^^^^^^^^
playwright._impl._api_types.Error: Execution context was destroyed, most likely because of a navigation

2024-11-08 07:21:47,657 - 3886887 - browsergym.experiments.loop - INFO - Saving summary info.
2024-11-08 07:21:47,667 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:47,684 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>
2024-11-08 07:21:47,685 - 3886887 - browsergym.core.env - DEBUG - _activate_page_from_js(page) called, page=<Page url='http://visualwebarenafast.eastus.cloudapp.azure.com:8080/'>

@gasse
Copy link
Collaborator

gasse commented Nov 15, 2024

#254 #256 #257 #258 #259 should help reduce those errors.
I'll close this issue, please open a new one if you still have errors

@gasse gasse closed this as completed Nov 15, 2024
@recursix
Copy link
Collaborator Author

Nicely done !! Thanks max

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gasse @recursix