Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Search by changeset metadata ? #189

Open
pyrog opened this issue Jan 23, 2015 · 18 comments
Open

Search by changeset metadata ? #189

pyrog opened this issue Jan 23, 2015 · 18 comments
Labels

Comments

@pyrog
Copy link

pyrog commented Jan 23, 2015

I would like to search for changesets with specific metadata, but I don't find any information in the wiki.

Examples:

  • searching changesets with comment starting with "#hotosm-task-"
  • or with source equal to "bing"

Syntax:

<changeset comment~"^#hotosm-task-"/>
<changeset source="bing"/>

Note: The use case is to search the numbers of changeset made by one hot task manager user (see hotosm/osm-tasking-manager2#538

@mmd-osm
Copy link
Contributor

mmd-osm commented Jan 23, 2015

Overpass API doesn't support queries on changeset metadata at this time, but you could use the main API instead. A bit of post processing (=filtering) on the result will be required, though.

Due to the limit of 100 changesets, you might have to create several requests with different timestamps as selection criteria or even use the bbox restriction.

Example:

https://api.openstreetmap.org/api/0.6/changesets?display_name=pyrog

@kolesar-andras
Copy link

I also need this feature, especially filtering for source tag of the changeset.

Or simply filter objects by changeset id? Similar to user or type filter:

changeset:1234567

This data is available for overpass, returns with objects. Related to #162.

@mmd-osm
Copy link
Contributor

mmd-osm commented Mar 19, 2015

@kolesar-andras : can you shed some more light on your use case?

Applying today's logic to query by user name, filtering by changeset (changeset:1234567) would only return objects which have been last modified in that changeset 1234567. It will certainly not return an object, it any of its versions was modified in changeset 1234567.

Is this what you're expecting?

@mmd-osm
Copy link
Contributor

mmd-osm commented Mar 19, 2015

@pyrog : there are also some other approaches available to query changeset metadata. One example is OpenStreetMap Changeset Sync for PostgreSQL.

@kolesar-andras
Copy link

I would like to follow progress digitizing objects of a high resolution ortohoto. Searching objects for source tag matches only objects explicitly tagged with source, misses objects where changeset was tagged with source.

Best solution would be if an object does not have a source tag, overpass would substitute it with changeset source. In this case a simple search for source would return objects of both tagging scheme.

One more solution: searching for changeset:source would match source tag of the objects's changeset. In this case simple source search would match source tag of the object only.

@rmikke
Copy link

rmikke commented Dec 20, 2015

I got here when looking for a way to find a changeset created by me using OpenMaps. Pascal Neis says there is one: http://hdyc.neis-one.org/?rmikke but it's most probably something accidental as I didn't even know it's possible to edit with OpenMaps.

So, there is no way to find it?

@mmd-osm
Copy link
Contributor

mmd-osm commented Dec 20, 2015

@rmikke : it's actually in changeset 26767766. No, you can't find it via Overpass API. I use a dedicated database based on https://github.com/zhm/osmchanges-postgres for it.

@rmikke
Copy link

rmikke commented Dec 20, 2015

@mmd-osm : Wow, thanks. So it wasn't accidental after all, I just didn't remember it.

@rmikke
Copy link

rmikke commented Dec 20, 2015

Could you also identify my change with editor reported as unknown? Or not
one of:
iD
Potlatch
JOSM
Vespucci
OpenMaps
?

2015-12-20 20:54 GMT+01:00 mmd [email protected]:

@rmikke https://github.com/rmikke : it's actually in changeset 26767766
http://www.openstreetmap.org/changeset/26767766. No, you can't find it
via Overpass API. I use a dedicated database based on
https://github.com/zhm/osmchanges-postgres for it.


Reply to this email directly or view it on GitHub
#189 (comment)
.

http://tnij.com/WyszukiwarkaRowerowa http://jolanta.korwin-mikke.pl/
[email protected] [email protected]

دراجة أكبر

@mmd-osm
Copy link
Contributor

mmd-osm commented Dec 21, 2015

It's this empty changeset: http://www.openstreetmap.org/changeset/26767650

@d1g
Copy link

d1g commented Mar 27, 2016

Regardless of OPAPI, even simplest form of this would be nice to have:

  • query change-sets by their tags (type:changeset + source:survey + user:myfriend)
  • get ids as result (out:ids)

there are also some other approaches available to query changeset metadata. One example is OpenStreetMap Changeset Sync for PostgreSQL.

This tool is great, thanks for suggestion! But overpass API is integrated in simple-to-use JOSM dialogues and overpass-turbo, they are more easily reachable than suggested solution!

While, change-sets are not part of our data model (in the strict or "academic" sense) they are heavily utilized in workflows (I guess people asking for change-sets because they seen how it is powerful could be in JOSM Ctrl+F), but they are not familiar with true databases

Instead of re-writing overpass, we could adapt some other solution to mimic overpass syntax, but translate queries (to, say, PostgreSQL). At least one online solution would help our users (no need to setup their own servers, if they cannot do this).

@drolbr drolbr added the question label Jun 4, 2016
@erickdeoliveiraleal
Copy link

I think created_by tag should be searchable also because of the many changesets created by Maps.Me app, filter out it would be great.

@mmd-osm
Copy link
Contributor

mmd-osm commented Mar 25, 2017

Also check the discussion on openstreetmap/openstreetmap-website#1500

@mmd-osm
Copy link
Contributor

mmd-osm commented Dec 28, 2018

By the way, OSMCha supports changeset metadata queries.

@pyrog
Copy link
Author

pyrog commented Jul 25, 2020

OSMCha supports changeset metadata queries

Yes, but it is not possible to answer questions like:

  • what are all OSM edit used this year ?
  • what are the most editor used ?

And/or draw editor's statistics (cf. graphs below)

Instead of re-writing overpass, we could adapt some other solution to mimic overpass syntax, but translate queries (to, say, PostgreSQL). At least one online solution would help our users (no need to setup their own servers, if they cannot do this).

👍

It could be done in other tools like https://resultmaps.neis-one.org, ohsome (see graphs below)
This will help i.e. OSM API developer to check API downstream consumer… (See discussion)

But we need more details : which editors are used, and which version…

ohsome

osmstats

HDYC

Browser Statistics

@mmd-osm
Copy link
Contributor

mmd-osm commented Jul 25, 2020

Sorry, what you wrote is totally off topic for the Overpass API repository.

Also, downstream consumers include tools like osm2pgsql and many others, so your analysis is unfortunately irrelevant for the problem at hand.

@pyrog
Copy link
Author

pyrog commented Oct 17, 2020

Sorry, what you wrote is totally off topic for the Overpass API repository.

I don't want to draw graphics from overpass-API, I would collect easily osm data and export them in other tools 😃

By the way, OSMCha supports changeset metadata queries.

Yes, that's nice. But we must:

  1. copy manually the link of each changeset
  2. edit them to get only the id
  3. make a query in overpass to find all objects edited… ?

After the storm Alex, I would like to display changes made with Alpes-Maritimes 2020 (Storm Alex) imagery.
Partial search of Alex Storm destructions

An alternative is to use osm-changesets from Pascal Neis 😃
Unfortunately, it is not possible to:

  • display this imagery
  • get the changeset id

@mmd-osm and @drolbr Could you, please, support at least a changeset: filter ?

@gdprdatasubect
Copy link

Just wanted to chime in with another usecase.
Related to: streetcomplete/StreetComplete#5180 get all railway-crossings that have a non-standard-height (e.g. https://overpass-turbo.eu/s/1Ag3 ) and then color the ones that have StreetComplete:quest_type=AddMaxHeight differently since those got changed by that quest.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

8 participants