Ignore error: Directory already exists.

[viajerus]

Hello,
I am downloading tweets using a for loop and everytime a new loop begins, I get this error:

2: Directory already exists. Existing JSON files may be parsed and returned, choose a new path if this is not intended. 

The loop broke after 20 runs and this is the error I received:

Too many errors.

Is there a way to ignore the "Directory already exists" error?

My code:

query <- paste0('(','"COVID19" OR "COVID_19" ',')', ' has:geo')

for (item in res) {
  get_all_tweets(bbox = unname(item),
                 query,
                 start_tweets = "2020-01-01T00:00:00Z",
                 end_tweets = "2022-10-31T00:00:00Z",
                 file = NULL,
                 data_path = tmpdir,
                 export_query = TRUE,
                 bind_tweets = FALSE,
                 is_retweet = FALSE,
                 verbose = TRUE,
                 n = Inf)

  Sys.sleep(60)
  
} 

note: res is a list of bounding boxes.

[chainsawriot]

First, the message emitted is not an error, but a warning.

academictwitteR/R/utils.R

Line 145 in 49480f6

.vwarn(verbose, "Directory already exists. Existing JSON files may be parsed and returned, choose a new path if this is not intended.")

You can suppress the warning by wrapping the call with suppressWarnings()

suppressWarnings({
  get_all_tweets(...)
})

However, the "Too many errors" probably has nothing to do with the warnings. It is related to the actual call to the API.

academictwitteR/R/utils.R

Line 6 in bc0df8c

stop("Too many errors.")

One possible reason is that there are some malformed things in your res so that it breaks at exactly 20. I suggest running the query on-by-on rather than in a loop for a small batch of item in your res to debug the actual problem.