Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TestFlight builds 2024.13 - 2024.21 battery reports #54

Closed
biblicabeebli opened this issue Feb 28, 2024 · 12 comments
Closed

TestFlight builds 2024.13 - 2024.21 battery reports #54

biblicabeebli opened this issue Feb 28, 2024 · 12 comments

Comments

@biblicabeebli
Copy link
Member

biblicabeebli commented Feb 28, 2024

This issue is open to anyone running Testflight builds 2024.13 - 2024.20 to report your experience of the app.

(ignore versions 2024.9-2024.12, I made a bunch of dumb mistakes.) This issue will be updated or retired to reflect updated build numbers if/when they appear.

Please edit previous messages with updates instead of posting a new comment, do not remove old entries.
You do not need to include Beiwe ids or the exact Beiwe server in use.

  • Please report the Maximum Capacity health percentage visible in Settings > Battery > Battery Health & Charging prominently in your post.
  • Make sure to include the iPhone model you are testing on.
  • Report your experience of battery drain in a brief description.
  • If you have exact numbers and want to report them, please do so.
  • If you have it, please report whether there is an observable change in your data quality/quantity. (We will have historical information to review, but immediate feedback is very helpful.)

(I am working on automating recording some of this information)

2024.18 is looking really good, but:

@biblicabeebli biblicabeebli changed the title TestFlight build 2024.9 battery reports TestFlight builds 2024.13, 2024.14, and 2024.15 battery reports Feb 29, 2024
@biblicabeebli biblicabeebli changed the title TestFlight builds 2024.13, 2024.14, and 2024.15 battery reports TestFlight builds 2024.13 - 2024.16 battery reports Feb 29, 2024
@biblicabeebli
Copy link
Member Author

biblicabeebli commented Feb 29, 2024

I'm running 3 devices, my study has extremely rapid timer intervals and all data streams enabled, it should record data ~50% of the time and reliably test edge cases like creating and uploading hundreds of files. Using heartbeat as my proxy for persistence, will look at data stream persistence later.

as of version 2024.18 I am seeing two instances of evidence for basically-perfect background persistence. Heartbeats come in almost perfectly regularly, and data files are uploaded perfectly. I am not actively monitoring upload lag or actual data quantities due to just time in the day.

(my old phone)

  • 2024.16 2024.17 2024.18 2024.19 2024.20 2024.21
  • iphone 8+
  • (getting 14% total battery drain after 6 hours of perfect persistence and a few hours on 2023.13)
  • update 1: about 25% battery drain, persistence lasted from 1am to ~9:42am - then there was a crash, reopened app at ~4:25pm
  • ~9:20pm - 55% battery
  • this device does not have a SIM card, so no cellular radio drain, would normally expect only a handful of % loss.
  • persistence good over the weekend even though there were crashes, plugged in
  • updated to 2024.18, unplugging at 5 am monday - at 2pm the battery had dropped to 74% - at 1 am battery was at 40%
  • (100% maximum battery life, using this one to test battery)
  • on March 6 I unplugged the device at 6:12am and enabled low power mode. Device was uploading data as per usual up until this point. --- 2:30pm: battery at 78%, uploads are still going fine as far as I can tell. Background Refresh tasks (e.g. one of the heartbeats) have stopped. And then at 12:33pm on march 7 I disabled it. battery had dropped to 9% -- oof didn't hit the "authorize accessory" button and the battery died just around 4pm -- ok at 6:34pm I saw the phone was somewhat charged and back on, I opened the beiwe app and turned off low power mode.
  • march 25, 5pm - installed 2024.21, unplugged and letting device run for several hours. at 8:15am the next day it was at 79%.... that's 21% in 15 hours.... 69% at 1:55pm, that's 10% in ~6 hours... then 26% by 1:54pm march 27

Red Phone

  • 2024.16 2024.17 2024.18 2024.19 2024.20 2024.21
  • iphone 8+
  • still going perfect [heartbeat] persistence at 4pm
  • crash at ~5:10pm, installed 2024.17 at ~5:40pm with hopefully the fix
  • persistence good over the weekend even though there were crashes, plugged in
  • updated to 2024.18 5 am monday
  • (89% maximum battery life, strongly suspect it is worse, possibly Much worse, plugged in)
  • on March 6 at 7:45am I set the beiwe app setting to disable precise location accuracy. Device was uploading data as per usual up until this point. --- 2:30pm: device still uploading data at normal rate, will need to look at quality of data return to determine if there is a change there. And then at 12:35pm on march 7 I disabled it.
  • march 25, 5pm - installed 2024.21, unplugged and letting device run for several hours - ok I got the popup showing the updated app message when I opened the app around 10pm... I have no idea what this means about the version of the app that was running. battery was at 79%. At 8:15am the next day it was at 31%, going to let it run to zero to see if that kicks the battery rating way down. 5% at 1:55pm.... and last heartbeat before dying was at 3:08pm.

Primary phone

  • 2024.16 2024.17 2024.18 2024.19 2024.20 currently on active development duty
  • iphone 15 pro max
  • Perfect persistence after installing at 3:20am
  • only 10% battery drain after sitting not plugged in for ~6ish hours.
  • about 15% more battery drain including general usage by 9:20pm, another 6ish hours.
  • battery life was perfectly usable over the weekend, listened to audiobooks on speaker / bluetooth for many hours
  • Ran about a 6 hour test while this sat unplugged while I slept, only about 7% drain.

@biblicabeebli biblicabeebli changed the title TestFlight builds 2024.13 - 2024.16 battery reports TestFlight builds 2024.13 - 2024.17 battery reports Mar 1, 2024
@biblicabeebli biblicabeebli changed the title TestFlight builds 2024.13 - 2024.17 battery reports TestFlight builds 2024.13 - 2024.18 battery reports Mar 4, 2024
@hydawo
Copy link
Collaborator

hydawo commented Mar 6, 2024

Hassan

  • iPhone 13 Pro Max
  • Maximum Capacity health percentage = 89%
  • Persistence: FOR ALL RA'S AT ONNELA LAB we will evaluate persistence by comparing data volumes prior to v2.5 (through TestFlight) to data volumes on v2.5 TestFlight versions
  • We are looking for a consistency in both data collection and sensor on/off cycles. For example, if a study is configured to collected 1 minute of GPS data every 11 minutes (1 min on, 10 min off), in v2.5 we should see the data follow this cycling pattern very closely. We should then evaluate coverage % of the day. I.E. 25% of the day we have GPS data collected.

I installed v2.5 (2024.15) last Thu, 2/29/24 evening with a nearly full battery. I did anecdotally notice significantly increased battery drain - see screenshot which shows ~75% over 7 hours and 100% over 12 hours. Note I was using my phone quite a bit during this period (heavier than during the workday).

IMG_9032

Interestingly, since I installed v2.5 (2024.18) I haven't noticed anymore significant battery drain as compared to prior to v2.5. I will pull a screenshot similar to the above this evening.

@biblicabeebli biblicabeebli changed the title TestFlight builds 2024.13 - 2024.18 battery reports TestFlight builds 2024.13 - 2024.20 battery reports Mar 14, 2024
@daimm2000
Copy link

daimm2000 commented Mar 15, 2024

Michelle

  • iPhone 11
  • Maximum Capacity health percentage = 78%😭
  • Test on v2.5 (2024.20)
  • It took me about 10 hours to drain battery from 100% to 6%

@ZhimengL
Copy link

  • iPhone 15
  • Maximum Capacity health percentage = 100%:)
  • Test on v2.5 (2024.20)
  • It took me about 10 hours 35 mins to drain battery from 100% to 19%
  • Normally longer than 12 hours (having a game that day)

@jprince127
Copy link
Collaborator

  • IPhone 14 Pro Max
  • Maximum Capacity Health Percentage: 86%
  • Test on v2.5 (2024.20)
  • 17 hours to drain from 100% to 25%
  • Beiwe drains ~20% on average for a full day, in the past 17 hours it has drained 16%

@MMel099
Copy link
Collaborator

MMel099 commented Mar 22, 2024

  • IPhone XR
  • Maximum capacity 81%
  • Testing on v2.5 (2024.20)
  • Battery usage by app: 23% Beiwe is highest (instagram second), also 11h32m background usage
  • Personal experience: Have not noticed a big difference with the new update. My battery settings indicate that Beiwe uses a lot of battery but I would not say that I can notice this in real life. Occasionally, it will die throughout the day, however most days it lasts me until I am home.

@biblicabeebli biblicabeebli changed the title TestFlight builds 2024.13 - 2024.20 battery reports TestFlight builds 2024.13 - 2024.21 battery reports Mar 25, 2024
@hydawo
Copy link
Collaborator

hydawo commented Mar 29, 2024

iPhone 13 Pro Max
Maximum Capacity health percentage = 89%

~25 hours from 96% → 20%
~31 hours from 96% → 0%

ImageImage

@jprince127
Copy link
Collaborator

jprince127 commented Mar 30, 2024

  • IPhone 14 Pro Max
  • Maximum Capacity Health Percentage: 86%
  • Test on v2.5 (2024.21)
  • 10 hours to drain from 100% to 18%
  • Beiwe drains significantly less since the update, I've noticed

@ZhimengL
Copy link

ZhimengL commented Apr 2, 2024

  • iPhone 15
  • Battery Health: 100%
  • ~ 11 hours from 100% to 18%
  • Test on v2.5 (2024.21)
  • Beiwe used 3%

@MMel099
Copy link
Collaborator

MMel099 commented Apr 4, 2024

iPhone XR
Battery Health: 81%
~ 18 hours (including overnight) from 100% to 20% (home for most of they day)
Test on v2.5 (2024.21)
Noticeable improvement in battery drain from previous version

@daimm2000
Copy link

daimm2000 commented Apr 4, 2024

iPhone 11
Battery Health: 77%
~10 Hours for battery to drain from 100% to 20%

Test on v2.5 (2024.21)
Beiwe on the background running 22 hours plus
Yes, the battery drainage is improved compared with last version.

@biblicabeebli
Copy link
Member Author

Thank you everyone for your time and attention on this, 2.5.0 was a really important release.

I am closing this issue now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants