Lots of files too big #168
Assignees
Comments
|
Hi @nigelharpur! Thank you for your feedback and for sharing your experience with the app — we’re glad to hear that it’s been working well for you! To address your questions:
Once again, thank you for your kind words and your support! If you have any other questions or suggestions, feel free to share them. |
|
Hi and thanks for getting back to me, much appreciated.
I wondered if the size limit was as per the free tier - that's
understandable and something to think about in the future perhaps.
I should have run a recursive file count in the NC directory first!
Hundreds of thousands in total... blimey.... so I think that is a 'silly
me' non issue tbh.
I only have 1 file tagged */won't scan/* though - so (cuz you rightly
guessed me haha!) I will run the rescan as you indicated and get a new
log full.
This app has certainly one great virtue (for me at least) over the other
antivirus NC app in that it didn't hobble my whole server with whatever
is was doing with ClamAV... Luckily I can actually get to my server
physically to push in that old power button for the proverbial and
legendary 4 seconds!
On 18/12/2024 13:38, Lennart Dohmann wrote:
Hi @nigelharpur! Thank you for your feedback and for sharing your
experience with the app — we’re glad to hear that it’s been working
well for you! To address your questions: File Size Limit: Currentl
*DuckDuckGo* removed one tracker. More
<https://duckduckgo.com/-Y_ghpNzGgliK-vU7emuDMdj6Vnu-1LIueF8sSLQ9oaSIFFiAG_26toAUdgiBn5va-dsupEdqOIoRHO_FONxMjlVXtQ7tMRbKpk2NIUZBGABAOUg1gI7Ypsk2NFpgS8U0QMXkaOVMFMxZntdfdTmhdnTzVPQidSg4R63SpatU533CQZ1KAWkacSbirGS9fmnxVG7YpSQlAFF3iOLe35XmsdO2iZomn2CgnBqegyo5QQFNM6QAfTgxp96HMx4oXeSZEkqQj3C_5AER0idzfOaHxxqaYy0Plzz3wZ4y-LeJActEzJ0PN3GfzQiVFGkyfL8AwdyNzmcZSX1W5Echs9TEg5_8ZXhlphF-k9KGvPj5K6tGb2XvlFmibqrU-mzvIvRHESl7WOJFShzrXka3Dj0dnOE7btNjGCtMi7UHZ9T1qjw2e2r2Fooqb88yWKbAYYcHQcehYxPT3Dz9O4nI8W_kpB1NUi6KzEpVBDimX0_sD>
Report Spam
<https://duckduckgo.com/-Y_ghpNzGgliK-vU7emuDMdj6Vnu-1LIueF8sSLQ9oaSIFFiAG_26toAUdgiBn5va-dsupEdqOIoRHO_FONxMjlVXtQ7tMRbKpk2NIUZBGABAOUg1gI7Ypsk2NFpgS8U0QMXkaOVMFMxZntdfdTmhdnTzVPQidSg4R63SpatU533CQZ1KAWkacSbirGS9fmnxVG7YpSQlAFF3iOLe35XmsdO2iZomn2CgnBqegyo5QQFNM6QAfTgxp96HMx4oXeSZEkqQj3C_5AER0idzfOaHxxqaYy0Plzz3wZ4y-LeJActEzJ0PN3GfzQiVFGkyfL8AwdyNzmcZSX1W5Echs9TEg5_8ZXhlphF-k9KGvPj5K6tGb2XvlFmibqrU-mzvIvRHESl7WOJFShzrXka3Dj0dnOE7btNjGCtMi7UHZ9T1qjw2e2r2Fooqb88yWKbAYYcHQcehYxPT3Dz9O4nI8W_kpB1NUi6KzEpVBDimX0_sD>
Hi @nigelharpur <https://github.com/nigelharpur>! Thank you for your
feedback and for sharing your experience with the app — we’re glad to
hear that it’s been working well for you!
To address your questions:
1.
File Size Limit: Currently, the 250MB file size limit for scans is
not adjustable. However, I will bring up the idea of making this
configurable for self-hosted scan backends with the team for
discussion. For the free-tier cloud variant (the default
settings), unfortunately, this limit cannot be changed due to
resource constraints.
2.
File Count in Nextcloud: Regarding the file count, the number
displayed (28013 files) represents all files in your Nextcloud
instance that fullfill the requirements to be scanned, including
files that are more than 250MB. These should be tagged with |Won't
scan|. Can you confirm that big files get tagged like this?
3.
If I understand this correctly, you do not have that much files in
your Nextcloud instance but the app settings say there are 28013
scannable files? If so, can you double check that and pick out a
few log entries as an example in which the app tries to continue
scanning? I hope to see paths to the files that you don't think
are there. You can of course black out file names, etc. That would
help on reproducing the issue. If you need to trigger the scan
process to get the log entries again, you can use this
<https://github.com/GDATASoftwareAG/nextcloud-gdata-antivirus?tab=readme-ov-file#gdatavaasscan>
app command.
Once again, thank you for your kind words and your support! If you
have any other questions or suggestions, feel free to share them.
—
Reply to this email directly, view it on GitHub
<#168 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BFPWYXTCFNBW5YZODDQJQOD2GF3HDAVCNFSM6AAAAABTZHI57WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJRGM2TCNZWGY>.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--=_cSDgA0L0+wQGW+ypzQbcZD_=
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: 8bit
<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hi and thanks for getting back to me, much appreciated.</p>
<p>I wondered if the size limit was as per the free tier - that's
understandable and something to think about in the future perhaps.</p>
<p>I should have run a recursive file count in the NC directory
first! Hundreds of thousands in total... blimey.... so I think
that is a 'silly me' non issue tbh.</p>
<p>I only have 1 file tagged <b><i>won't scan</i></b> though - so
(cuz you rightly guessed me haha!) I will run the rescan as you
indicated and get a new log full.</p>
<p>This app has certainly one great virtue (for me at least) over
the other antivirus NC app in that it didn't hobble my whole
server with whatever is was doing with ClamAV... Luckily I can
actually get to my server physically to push in that old power
button for the proverbial and legendary 4 seconds!<br>
</p>
<div class="moz-cite-prefix">On 18/12/2024 13:38, Lennart Dohmann
wrote:<br>
</div>
<blockquote type="cite" ***@***.***">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div>
</div>
<p dir="auto">Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/nigelharpur/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/nigelharpur" ***@***.***</a>!
Thank you for your feedback and for sharing your experience with
the app — we’re glad to hear that it’s been working well for
you!</p>
<p dir="auto">To address your questions:</p>
<ol dir="auto">
<li>
<p dir="auto">File Size Limit: Currently, the 250MB file size
limit for scans is not adjustable. However, I will bring up
the idea of making this configurable for self-hosted scan
backends with the team for discussion. For the free-tier
cloud variant (the default settings), unfortunately, this
limit cannot be changed due to resource constraints.</p>
</li>
<li>
<p dir="auto">File Count in Nextcloud: Regarding the file
count, the number displayed (28013 files) represents all
files in your Nextcloud instance that fullfill the
requirements to be scanned, including files that are more
than 250MB. These should be tagged with <code class="notranslate">Won't scan</code>. Can you confirm
that big files get tagged like this?</p>
</li>
<li>
<p dir="auto">If I understand this correctly, you do not have
that much files in your Nextcloud instance but the app
settings say there are 28013 scannable files? If so, can you
double check that and pick out a few log entries as an
example in which the app tries to continue scanning? I hope
to see paths to the files that you don't think are there.
You can of course black out file names, etc. That would help
on reproducing the issue. If you need to trigger the scan
process to get the log entries again, you can use <a href="https://github.com/GDATASoftwareAG/nextcloud-gdata-antivirus?tab=readme-ov-file#gdatavaasscan" moz-do-not-send="true">this</a> app command.</p>
</li>
</ol>
<p dir="auto">Once again, thank you for your kind words and your
support! If you have any other questions or suggestions, feel
free to share them.</p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br>
Reply to this email directly, <a href="#168 (comment)" moz-do-not-send="true">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/BFPWYXTCFNBW5YZODDQJQOD2GF3HDAVCNFSM6AAAAABTZHI57WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJRGM2TCNZWGY" moz-do-not-send="true">unsubscribe</a>.<br>
You are receiving this because you were mentioned.<span style="color: transparent; font-size: 0; display: none; visibility: hidden; overflow: hidden; opacity: 0; width: 0; height: 0; max-width: 0; max-height: 0; mso-hide: all">Message
ID: <span><GDATASoftwareAG/nextcloud-gdata-antivirus/issues/168/2551351766</span><span>@</span><span>github</span><span>.</span><span>com></span></span></p>
<script type="application/ld+json">[
{
***@***.***": "http://schema.org",
***@***.***": "EmailMessage",
"potentialAction": {
***@***.***": "ViewAction",
"target": "#168 (comment)",
"url": "#168 (comment)",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
***@***.***": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]</script>
</blockquote>
</body></html>
--=_cSDgA0L0+wQGW+ypzQbcZD_=--
|
|
Juggling too many things pre Xmas but did run the occ command - but
hasn't worked as expected?
Here's what happened:
From Terminal in the Nextcloud dir:
sudo -u www-data php occ gdatavaas:scan
/[info] scanning files
[info] Scanned 0 files in 23.600407123566 seconds/
Tried again - same result - any suggestions?
Have turned the automatic scan option off for the moment in the
Nextcloud settings - it's probably me!
On 18/12/2024 15:06, Nigel Harpur wrote:
Hi and thanks for getting back to me, much appreciated.
I wondered if the size limit was as per the free tier - that's
understandable and something to think about in the future perhaps.
I should have run a recursive file count in the NC directory first!
Hundreds of thousands in total... blimey.... so I think that is a
'silly me' non issue tbh.
I only have 1 file tagged */won't scan/* though - so (cuz you rightly
guessed me haha!) I will run the rescan as you indicated and get a new
log full.
This app has certainly one great virtue (for me at least) over the
other antivirus NC app in that it didn't hobble my whole server with
whatever is was doing with ClamAV... Luckily I can actually get to my
server physically to push in that old power button for the proverbial
and legendary 4 seconds!
On 18/12/2024 13:38, Lennart Dohmann wrote:
> Hi @nigelharpur! Thank you for your feedback and for sharing your
> experience with the app — we’re glad to hear that it’s been working
> well for you! To address your questions: File Size Limit: Currentl
> *DuckDuckGo* removed one tracker. More
> <https://duckduckgo.com/-Y_ghpNzGgliK-vU7emuDMdj6Vnu-1LIueF8sSLQ9oaSIFFiAG_26toAUdgiBn5va-dsupEdqOIoRHO_FONxMjlVXtQ7tMRbKpk2NIUZBGABAOUg1gI7Ypsk2NFpgS8U0QMXkaOVMFMxZntdfdTmhdnTzVPQidSg4R63SpatU533CQZ1KAWkacSbirGS9fmnxVG7YpSQlAFF3iOLe35XmsdO2iZomn2CgnBqegyo5QQFNM6QAfTgxp96HMx4oXeSZEkqQj3C_5AER0idzfOaHxxqaYy0Plzz3wZ4y-LeJActEzJ0PN3GfzQiVFGkyfL8AwdyNzmcZSX1W5Echs9TEg5_8ZXhlphF-k9KGvPj5K6tGb2XvlFmibqrU-mzvIvRHESl7WOJFShzrXka3Dj0dnOE7btNjGCtMi7UHZ9T1qjw2e2r2Fooqb88yWKbAYYcHQcehYxPT3Dz9O4nI8W_kpB1NUi6KzEpVBDimX0_sD>
>
>
> Report Spam
> <https://duckduckgo.com/-Y_ghpNzGgliK-vU7emuDMdj6Vnu-1LIueF8sSLQ9oaSIFFiAG_26toAUdgiBn5va-dsupEdqOIoRHO_FONxMjlVXtQ7tMRbKpk2NIUZBGABAOUg1gI7Ypsk2NFpgS8U0QMXkaOVMFMxZntdfdTmhdnTzVPQidSg4R63SpatU533CQZ1KAWkacSbirGS9fmnxVG7YpSQlAFF3iOLe35XmsdO2iZomn2CgnBqegyo5QQFNM6QAfTgxp96HMx4oXeSZEkqQj3C_5AER0idzfOaHxxqaYy0Plzz3wZ4y-LeJActEzJ0PN3GfzQiVFGkyfL8AwdyNzmcZSX1W5Echs9TEg5_8ZXhlphF-k9KGvPj5K6tGb2XvlFmibqrU-mzvIvRHESl7WOJFShzrXka3Dj0dnOE7btNjGCtMi7UHZ9T1qjw2e2r2Fooqb88yWKbAYYcHQcehYxPT3Dz9O4nI8W_kpB1NUi6KzEpVBDimX0_sD>
>
>
> Hi @nigelharpur <https://github.com/nigelharpur>! Thank you for your
> feedback and for sharing your experience with the app — we’re glad to
> hear that it’s been working well for you!
>
> To address your questions:
>
> 1.
>
> File Size Limit: Currently, the 250MB file size limit for scans
> is not adjustable. However, I will bring up the idea of making
> this configurable for self-hosted scan backends with the team for
> discussion. For the free-tier cloud variant (the default
> settings), unfortunately, this limit cannot be changed due to
> resource constraints.
>
> 2.
>
> File Count in Nextcloud: Regarding the file count, the number
> displayed (28013 files) represents all files in your Nextcloud
> instance that fullfill the requirements to be scanned, including
> files that are more than 250MB. These should be tagged with
> |Won't scan|. Can you confirm that big files get tagged like this?
>
> 3.
>
> If I understand this correctly, you do not have that much files
> in your Nextcloud instance but the app settings say there are
> 28013 scannable files? If so, can you double check that and pick
> out a few log entries as an example in which the app tries to
> continue scanning? I hope to see paths to the files that you
> don't think are there. You can of course black out file names,
> etc. That would help on reproducing the issue. If you need to
> trigger the scan process to get the log entries again, you can
> use this
> <https://github.com/GDATASoftwareAG/nextcloud-gdata-antivirus?tab=readme-ov-file#gdatavaasscan>
> app command.
>
> Once again, thank you for your kind words and your support! If you
> have any other questions or suggestions, feel free to share them.
>
> —
> Reply to this email directly, view it on GitHub
> <#168 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/BFPWYXTCFNBW5YZODDQJQOD2GF3HDAVCNFSM6AAAAABTZHI57WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJRGM2TCNZWGY>.
> You are receiving this because you were mentioned.Message ID:
> ***@***.***>
>
--=_g+XHZeqRrwDUdU278ydt8I_=
Content-Type: text/html;
charset=UTF-8
Content-Transfer-Encoding: 8bit
<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Juggling too many things pre Xmas but did run the occ command -
but hasn't worked as expected?</p>
<p>Here's what happened:</p>
<p>From Terminal in the Nextcloud dir: </p>
<p>sudo -u www-data php occ gdatavaas:scan<br>
<i>[info] scanning files<br>
[info] Scanned 0 files in 23.600407123566 seconds</i></p>
<p>Tried again - same result - any suggestions?</p>
<p>Have turned the automatic scan option off for the moment in the
Nextcloud settings - it's probably me!<br>
</p>
<div class="moz-cite-prefix">On 18/12/2024 15:06, Nigel Harpur
wrote:<br>
</div>
<blockquote type="cite" ***@***.***">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<p>Hi and thanks for getting back to me, much appreciated.</p>
<p>I wondered if the size limit was as per the free tier - that's
understandable and something to think about in the future
perhaps.</p>
<p>I should have run a recursive file count in the NC directory
first! Hundreds of thousands in total... blimey.... so I think
that is a 'silly me' non issue tbh.</p>
<p>I only have 1 file tagged <b><i>won't scan</i></b> though - so
(cuz you rightly guessed me haha!) I will run the rescan as you
indicated and get a new log full.</p>
<p>This app has certainly one great virtue (for me at least) over
the other antivirus NC app in that it didn't hobble my whole
server with whatever is was doing with ClamAV... Luckily I can
actually get to my server physically to push in that old power
button for the proverbial and legendary 4 seconds!<br>
</p>
<div class="moz-cite-prefix">On 18/12/2024 13:38, Lennart Dohmann
wrote:<br>
</div>
<blockquote type="cite" ***@***.***">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div>
</div>
<p dir="auto">Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/users/nigelharpur/hovercard" data-octo-click="hovercard-link-click" data-octo-dimensions="link_type:self" href="https://github.com/nigelharpur" ***@***.***</a>!
Thank you for your feedback and for sharing your experience
with the app — we’re glad to hear that it’s been working well
for you!</p>
<p dir="auto">To address your questions:</p>
<ol dir="auto">
<li>
<p dir="auto">File Size Limit: Currently, the 250MB file
size limit for scans is not adjustable. However, I will
bring up the idea of making this configurable for
self-hosted scan backends with the team for discussion.
For the free-tier cloud variant (the default settings),
unfortunately, this limit cannot be changed due to
resource constraints.</p>
</li>
<li>
<p dir="auto">File Count in Nextcloud: Regarding the file
count, the number displayed (28013 files) represents all
files in your Nextcloud instance that fullfill the
requirements to be scanned, including files that are more
than 250MB. These should be tagged with <code class="notranslate">Won't scan</code>. Can you confirm
that big files get tagged like this?</p>
</li>
<li>
<p dir="auto">If I understand this correctly, you do not
have that much files in your Nextcloud instance but the
app settings say there are 28013 scannable files? If so,
can you double check that and pick out a few log entries
as an example in which the app tries to continue scanning?
I hope to see paths to the files that you don't think are
there. You can of course black out file names, etc. That
would help on reproducing the issue. If you need to
trigger the scan process to get the log entries again, you
can use <a href="https://github.com/GDATASoftwareAG/nextcloud-gdata-antivirus?tab=readme-ov-file#gdatavaasscan" moz-do-not-send="true">this</a> app command.</p>
</li>
</ol>
<p dir="auto">Once again, thank you for your kind words and your
support! If you have any other questions or suggestions, feel
free to share them.</p>
<p style="font-size:small;-webkit-text-size-adjust:none;color:#666;">—<br>
Reply to this email directly, <a href="#168 (comment)" moz-do-not-send="true">view it on GitHub</a>, or <a href="https://github.com/notifications/unsubscribe-auth/BFPWYXTCFNBW5YZODDQJQOD2GF3HDAVCNFSM6AAAAABTZHI57WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJRGM2TCNZWGY" moz-do-not-send="true">unsubscribe</a>.<br>
You are receiving this because you were mentioned.<span style="color: transparent; font-size: 0; display: none; visibility: hidden; overflow: hidden; opacity: 0; width: 0; height: 0; max-width: 0; max-height: 0; mso-hide: all">Message
ID: <span><GDATASoftwareAG/nextcloud-gdata-antivirus/issues/168/2551351766</span><span>@</span><span>github</span><span>.</span><span>com></span></span></p>
<script type="application/ld+json">[
{
***@***.***": "http://schema.org",
***@***.***": "EmailMessage",
"potentialAction": {
***@***.***": "ViewAction",
"target": "#168 (comment)",
"url": "#168 (comment)",
"name": "View Issue"
},
"description": "View this Issue on GitHub",
"publisher": {
***@***.***": "Organization",
"name": "GitHub",
"url": "https://github.com"
}
}
]</script> </blockquote>
</blockquote>
</body></html>
--=_g+XHZeqRrwDUdU278ydt8I_=--
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
After switching on the automatic scan option all works fine but the background scan has thrown up many thousands of log entries regarding files unscanned due to size being greater than 250Mb - at the moment it's all quiet on the scanning front and in the admin page it says Files scanned: 4294 / 28013
All individually requested scans happen as requested (impressively fast too) as do automatic scans of newly uploaded files.
Is the limit on file size something I can change?
Also I don't know whether the 28013 files are all within Nextcloud?
Also if they all are Nextcloud files, would approx 24000 of them really be greater than 250Mb in size?
The app as a whole is impressive I must say, thanks.
Nextcloud 30.0.4 - Ubuntu 22.04 - GDATA 30.1.3
The text was updated successfully, but these errors were encountered: