Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crash when training cluster model #239

Closed
hxl9654 opened this issue Apr 5, 2023 · 5 comments · Fixed by #250
Closed

Crash when training cluster model #239

hxl9654 opened this issue Apr 5, 2023 · 5 comments · Fixed by #250
Assignees
Labels
bug Something isn't working

Comments

@hxl9654
Copy link

hxl9654 commented Apr 5, 2023

Describe the bug
Crash when training cluster model.

To Reproduce
conda activate so-vits-svc-fork
cd xxx
svc train-cluster

Additional context
Crash log:
Loading features from dataset\44k\yyy train_cluster.py:24
Training clusters: 100%|█████████████████████████████████████████████████████████████████| 1/1 [00:05<00:00, 5.20s/it]
joblib.externals.loky.process_executor._RemoteTraceback:
"""
Traceback (most recent call last):
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\externals\loky\process_executor.py", line 428, in process_worker
r = call_item()
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\externals\loky\process_executor.py", line 275, in call
return self.fn(*self.args, **self.kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib_parallel_backends.py", line 620, in call
return self.func(*args, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\parallel.py", line 288, in call
return [func(*args, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\parallel.py", line 288, in
return [func(*args, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\so_vits_svc_fork\cluster\train_cluster.py", line 71, in train_cluster

return input_path.stem, train_cluster(input_path, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\so_vits_svc_fork\cluster\train_cluster.py", line 29, in train_cluster
features = np.concatenate(features, axis=0).astype(np.float32)
File "<array_function internals>", line 180, in concatenate
ValueError: need at least one array to concatenate
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\runpy.py", line 86, in run_code
exec(code, run_globals)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\Scripts\svc.exe_main
.py", line 7, in
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\click\core.py", line 1130, in call
return self.main(*args, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\click\core.py", line 1055, in main
rv = self.invoke(ctx)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\click\core.py", line 1657, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\click\core.py", line 1404, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\click\core.py", line 760, in invoke
return _callback(*args, **kwargs)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\so_vits_svc_fork_main
.py", line 810, in train_cluster
main(
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\so_vits_svc_fork\cluster\train_cluster.py", line 74, in main
parallel_result = Parallel(n_jobs=-1)(
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\parallel.py", line 1098, in call
self.retrieve()
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib\parallel.py", line 975, in retrieve
self._output.extend(job.get(timeout=self.timeout))
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\site-packages\joblib_parallel_backends.py", line 567, in wrap_future_result
return future.result(timeout=timeout)
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\concurrent\futures_base.py", line 458, in result
return self.__get_result()
File "C:\Users\xxx\anaconda3\envs\so-vits-svc-fork\lib\concurrent\futures_base.py", line 403, in __get_result
raise self._exception
ValueError: need at least one array to concatenate

@hxl9654 hxl9654 added the bug Something isn't working label Apr 5, 2023
@ThrowawayAccount01
Copy link

Having the same problem as well.

@hxl9654
Copy link
Author

hxl9654 commented Apr 7, 2023

@34j 3.0.4 still the same problem

@tovaru
Copy link

tovaru commented Apr 8, 2023

Same problem here. I even tried downgrading, but the same error keeps appearing.

@34j 34j self-assigned this Apr 8, 2023
@34j 34j closed this as completed in #250 Apr 8, 2023
@34j
Copy link
Collaborator

34j commented Apr 20, 2023

@allcontributors add hxl9654 bug

@allcontributors
Copy link
Contributor

@34j

I've put up a pull request to add @hxl9654! 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants