Are there plans for an influxdb v2 addon in the near future?

[ericvb]

I was looking around for moving my current HA Core installation, running in a Python virtual environment, to a more robust production environment. More and more things at home are depending on the HA installation :-)

So I dowloaded the Home Assistant VM (HA OS, HA core and the Supervisor) and imported it in my virtualization environment.
Because I'm running HA Core together with a MariaDb docker image and InfluxDb v2 docker image, I was looking how to move the data.
And here I stumbled on a problem, the current InfluxDb add-on is a 1.x version one.
I don't want to lose my current influxdb data, so this is a problem...

Are there plans for an influxdb v2 addon in the near future?

The move to a more robust system is not urgent, so I can wait if it is in the pipeline.
If not, than I have 2 options:

• install myself InfluxDb v2 as docker image in HA OS, but I don't know if this will be possible without too much changes in this limited linux OS image. I don't want to break future update.
  Maybe possible as custom addon, but then I have to read the documentation more thoroughly ;-)
• change course and go for a Home Assistant Supervised installation on a fresh full Ubuntu server.

[frenck]

Absolutely! I want to update to InfluxDB 2, however, for me, that is not a top priority right now.

Any help is welcome though 😉

[ViperRNMC]

I use this one
https://github.com/Jays-Home-Assistant-Add-ons/j-addon-influxdb2

[diamant-x]

I was going to follow this community guide and saw that the official addon is v1 still https://community.home-assistant.io/t/influxdb-2-data-retention-my-approach/457557 . would be great if this can be looked at again. Key requirements for it are: low disk size for long-term storage with downsampling statistical storage.

[shbatm]

Revisiting this again for my personal setup--last time I had looked at migrating it was going to be a pain to move all the data from V1 to V2; sometime since it looks like they've upgraded the migration tool https://docs.influxdata.com/influxdb/v2.6/upgrade/v1-to-v2/automatic-upgrade/

However, it doesn't look like the path re-write issue has been resolved to be able to support ingress: influxdata/influxdb#15721

Anyways -- just wanted to drop an update on status.

[diamant-x]

I did a manual migration from HA's v1 to official V2 docker, and at the end the 'autonated' script method was to export all current bucket data to a linepoint (compressed!) Per-day collection of files, and import to V2 with retry for any failed day (dua to strange timeouts). It took about 1 minuto or 2 per day so it takes some time to complete but at the end it works.
No ingress, but should be better than keeping an outdated (and possibly with security issues if left unmnantained?) I guess?

[Dattel]

I did a manual migration from HA's v1 to official V2 docker, and at the end the 'autonated' script method was to export all current bucket data to a linepoint (compressed!) Per-day collection of files, and import to V2 with retry for any failed day (dua to strange timeouts). It took about 1 minuto or 2 per day so it takes some time to complete but at the end it works. No ingress, but should be better than keeping an outdated (and possibly with security issues if left unmnantained?) I guess?

I also tried the manual migration way but i used Jay-Home-Assistant-Add-Ons as template to create my own addon with latest influx2-version and + CLI. Tried to adapt the ingress implementation from the influx1 plugin but failed to get it working with it.

I'm not happy with the current state...so currently i still sticked my live system on official influx.
you said,you are using the official docker images. is it running on the same machine as homeassistant? how are you planning to update.. commandline? i read, it's not recommended to use other docker images beside the homeassistant installed.

[Dattel]

Here is my current playground for the latest influx DB2 implementation.
it provides latest InfluxDB 2.7.0 + CLI, the latest debian image with s6-overlay..

It can be installed using these repository in homeassistant: https://github.com/Dattel/homeassistant-influxdb2

Would be glad for any feedback or contribution to make that work :-D
Please be kind with me - it's my first try of an plugin for HA

[mbalasz]

i assume, you can just install both plugins at the same time and change the port of the second one to e.g. 8087... Shutdown both databases and then trying to copy datafiles between these plugins (located in /usr/share/hassio/addons/data/XXXX_influxdb2)

I'm considering to upgrade to InfluxDB v2 with your add-on and I saw your post on migrating data. I'm running a Home Assistant OS version on my Raspberry Pi, but I don't have the /usr/share/hassio/ folder at all. I'm using the SSH addon to check that. I couldn't find any documentation on where the addon data files are stored on a HAOS installation. Do you know if I should check some other locations?

[Dattel]

That a bit tricky on hassio and maybe the reason i installed homeassistant as supervised on a debian :-)
With the SSH-Addon you are inside the SSH-Docker container and not on the host..
But i assume, there is a way around.

Have a look here:
https://community.home-assistant.io/t/access-addons-data/428429/3

[mbalasz]

Thanks a lot for the pointers. I managed to get the backup following those steps:

1. Follow https://developers.home-assistant.io/docs/operating-system/debugging/ to get debug SSH access to HAOS. Make sure you upload the public key of your other host machine from which you want to SSH.
2. ssh to the host with ssh -i <path_to_private_key> [email protected] -p 22222
3. Find out the <container_id> of the influxdb container with docker ps
4. Create the local backup of influxdb with docker exec -it <container_id> bash -c 'influxd backup -portable /opt/data'
5. Copy over the backup directory to local /tmp docker cp <container-id>:/opt/data /tmp/influxdb/
6. Get the copy of the data over to your machine via scp scp -r -P 22222 -O -i <path_to_private_key> [email protected]:/tmp/influxdb/data/ .

[Dattel]

very nice, that you posted a complete walkthrough here :-D
If i have time, i will include that in the doc and point to this thread :-D

[Dattel]

Just want to mention, that there is also a shared directory on "Home Assistant OS"
So with a small adaptation, my initial export/import also works without copy
Just replace @org@ @token@ and @bucket@

## Export
docker exec addon_a0d7b954_influxdb \         
  influx_inspect export \
    -datadir "/data/influxdb/data" \
    -waldir "/data/influxdb/wal" \     
    -out "/share/influxdb/export" \                
    -database homeassistant \        
    -retention autogen \  
    -lponly
   
## Import
docker exec addon_ec9cbdb7_influxdb2 \
	influx write \
		--org-id @org@ \
		--token @token@
		--bucket @bucket@ \
		--file "/share/influxdb/export"

[smoki3]

Thanks a lot for the pointers. I managed to get the backup following those steps:

1. Follow https://developers.home-assistant.io/docs/operating-system/debugging/ to get debug SSH access to HAOS. Make sure you upload the public key of your other host machine from which you want to SSH.
2. ssh to the host with ssh -i <path_to_private_key> [email protected] -p 22222
3. Find out the <container_id> of the influxdb container with docker ps
4. Create the local backup of influxdb with docker exec -it <container_id> bash -c 'influxd backup -portable /opt/data'
5. Copy over the backup directory to local /tmp docker cp <container-id>:/opt/data /tmp/influxdb/
6. Get the copy of the data over to your machine via scp scp -r -P 22222 -O -i <path_to_private_key> [email protected]:/tmp/influxdb/data/ .

how do you import then this backup file?