entities.url is NULL

[yuqingcuiyuki]

Hi,

I was searching for some tweets related to traveling to the US. But in the results, entities.url is NULL for many entries. I can accept it to be NULL if it's location but I think every tweet must at least have the url of itself. I searched them on Twitter manually according to the text. Most of them are replies (some are not). These tweets look perfectly normal to me and are not private or restricted.

My code is as below:

q=build_query(query ='(travel OR flight OR visit OR trip) (play OR go OR went OR fly OR flew OR get OR arrive OR arriving) (America OR (United State) OR USA OR (the States) OR Usa)',
country = "GB",
lang='en',
is_retweet = FALSE
)

tweets <- get_all_tweets(query=q,
start_tweets ="2015-11-01T00:00:00Z",
end_tweets ="2020-11-30T00:00:00Z",
n=30,
verbose=TRUE,
context_annotations=TRUE,
bearer_token)

I wonder why this will happen and is there any way to fix it.

Thanks in advance,
Yuki

[yuqingcuiyuki]

now I figured it out. It only returns for tweets with text urls or media. Pure text tweets return NULL. For media urls, it will direct to the tweets instead of specific pics, but for text urls it will directly go to that website. That's why I took entities.url as it can return tweet url. It CANNOT.

[yuqingcuiyuki]

And to get the url of the tweet itself, just use the id column. It gives you an id string.
https://twitter.com/i/web/status/{id} is the url.