Skip to content

Commit

Permalink
add information retrieval challenge to the wiki (#3876)
Browse files Browse the repository at this point in the history
  • Loading branch information
waynehamadi authored May 6, 2023
1 parent d184d0d commit ca5abff
Show file tree
Hide file tree
Showing 3 changed files with 26 additions and 0 deletions.
20 changes: 20 additions & 0 deletions docs/challenges/information_retrieval/challenge_a.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# Information Retrieval Challenge A

**Status**: Current level to beat: level 1

**Command to try**:

```
pytest -s tests/integration/challenges/information_retrieval/test_information_retrieval_challenge_a.py
```

## Description

The agent's goal is to find the revenue of Tesla in 2022.

It should write the result in a file called output.txt.

The agent should be able to beat this test consistently (this is the hardest part).
## Objective

The objective of this challenge is to test the agent's ability to retrieve information in a consistent way.
3 changes: 3 additions & 0 deletions docs/challenges/information_retrieval/introduction.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Information Retrieval

Information retrieval challenges are designed to evaluate the proficiency of an AI agent, such as Auto-GPT, in searching, extracting, and presenting relevant information from a vast array of sources. These challenges often encompass tasks such as interpreting user queries, browsing the web, and filtering through unstructured data.
3 changes: 3 additions & 0 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,9 @@ nav:
- Introduction: challenges/memory/introduction.md
- Memory Challenge A: challenges/memory/challenge_a.md
- Memory Challenge B: challenges/memory/challenge_b.md
- Information retrieval:
- Introduction: challenges/information_retrieval/introduction.md
- Information Retrieval Challenge A: challenges/information_retrieval/challenge_a.md
- Submit a Challenge: challenges/submit.md
- Beat a Challenge: challenges/beat.md

Expand Down

2 comments on commit ca5abff

@vercel
Copy link

@vercel vercel bot commented on ca5abff May 6, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@DanyPell
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's amazing. Hope there will be many ambitious challenges devised and AutoGPT nails them soon!

Please sign in to comment.