Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The infer function gave 0 probability for all topics for some documents #23

Open
wenxipu opened this issue Nov 9, 2022 · 0 comments
Open

Comments

@wenxipu
Copy link

wenxipu commented Nov 9, 2022

Hello,

I hope you are doing great. I used the infer function to get the topic distributions for my data, but I noticed there are documents that are assigned 0 probabilities for all topics.

Would you please let me know why and how could I fix it? I checked the documents and they are fine. I also tried increasing the number of iterations, but the results are still like this.

Here is a sample of the output of the infer function:


1.84 3 124.42 19.16 51.98 62.94 5.98 61.58 13.34 4.32 10 2.8 1.62 7.88 31.48 10.24 1.32 4.96 2.46 2.82 16.56 77.02 72.28
1.8 1.14 3.26 4.52 3.88 7.38 1.18 3.06 2.4 2.38 3.28 1.36 0.88 3.34 65.28 2.34 0.78 13.14 3.98 1.64 2.5 138.32 3.16
4.3 9.6 4.14 1.64 3.56 3.96 7.18 2.46 22.76 3.72 0.78 2.14 0.88 2.64 4.92 0.92 1.5 1.96 3.06 10.3 3.88 73.98 0.72
4.28 6.42 2.88 5.18 34.42 58.28 16.88 72.58 8.7 2.6 30.36 7.42 0.94 2.58 5.78 88.86 22.84 4.78 2.38 23.14 8.82 43.1 4.78
0.68 1.78 65.5 2.08 2.48 9.6 6.62 10.4 9.06 1.14 1.78 1.62 0.78 1.64 6.7 3.6 1.48 1.98 1.36 1.06 16.6 35.96 5.1
23.7 18.9 6.46 6.92 106.28 26.5 26.22 6.24 61.48 12.36 8.18 41.34 2.12 49.42 11.4 2.54 21.74 5.28 15.1 11.16 10.84 473.64 16.18
1.66 2.7 0.98 0.82 2.18 2.66 0.9 3.02 4.54 0.86 4.28 5.8 0.58 3.06 1.68 10.2 0.58 3.5 1.5 0.54 5.82 8.86 2.28
4.78 5.82 92.82 4.18 36.2 13.74 4.26 2.72 16.42 15.62 2.12 2.18 2.88 2.26 19.1 8 2.78 3.46 4.3 33.22 4.72 250.78 8.64
1.58 4 86.2 2.26 5.54 5.72 2.72 3.34 4.76 1.28 6.2 9.5 3.16 25.64 2.46 1.8 4.74 2.24 3.3 4.54 4.36 85.08 3.58
3.54 7.44 51.42 19.7 27.76 35.6 7.46 4.16 66.88 11.28 3.28 4.8 3.56 41.4 3.42 2.48 3.28 3.54 4.02 1.92 17.3 118.14 4.62
2.4 4.54 5.52 2.26 3 6.48 3.18 1.88 4.88 3.2 3.38 1.06 1.86 67.56 52.84 0.72 1.1 0.68 1.64 1.62 13.94 44.22 2.04
1.42 5.78 0.86 7.72 2.88 1.92 0.8 8.06 37.16 2 22.12 1.32 1.38 1.72 1.34 9.66 0.96 1.4 1 0.66 3.88 36.52 3.44
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
3.52 3.44 20.44 3.24 8.84 76.44 3.3 6.88 14.24 1.12 4.56 8.44 0.76 2.12 6.88 47.56 2.06 4.14 1.4 2.52 8.62 18.9 5.58
3.2 7.3 35.98 1.06 27.3 64.36 2.16 15.04 9.58 0.96 2.64 2.06 1.76 78.96 4.9 2.74 4 2.16 3.18 8.56 4.66 156.68 4.76
3.36 15.14 533.24 5.76 108.2 80.98 13.96 12.66 14.28 17.22 68.86 10.02 13.58 16.66 30.06 8.62 5.38 14.04 11.8 7.22 32.96 38.54 9.46
2.4 44.88 40.48 36.88 89 33.62 9.18 255.44 26.24 2.22 8.26 15.14 13.5 3.96 72.28 11.28 1.48 2.12 4.86 5.18 6.18 22.12 5.3
4.32 24.46 38.06 18.42 39.34 8.7 5.1 8.6 31.26 14.32 18.16 5.74 3.04 6 30.02 10.38 2.48 6.94 5.4 10.56 6.56 200.78 5.36
0.56 3.92 0.88 2.28 1.8 1.12 0.36 0.58 2.86 0.7 4.74 4.16 0.24 0.86 0.28 2.56 0.48 2.84 0.26 0.48 4.5 9.38 0.16
1.12 6.9 0.56 1.42 1.96 0.78 1.08 1.02 7.4 5.98 3 3.24 1.76 0.56 0.88 10.62 1.88 1.96 0.94 0.42 2.62 18.26 0.64
3.5 4.6 71.44 4.64 21.94 22.7 49.68 9.62 24.04 3.04 2.9 3.34 3.48 24.66 19.56 80.4 6.54 2.94 4.64 31 4.08 27.26 15
14.52 3.24 12.1 1.74 32.34 63.7 2.96 49.18 3.14 0.44 8.6 13.72 2.18 2.78 7.56 14.4 4.66 2.38 9.04 1.94 19.4 72.42 89.56
12.14 11.74 3.22 5.62 61.28 21.54 16.92 11.3 4.36 5.12 9.62 42.18 4.8 4.28 3.32 6.74 49.88 7.28 10.2 158.74 24.78 2.86 6.08
0.4 6.76 0.68 0.96 1.06 1.2 0.34 0.64 5.2 1.14 1.94 8.48 0.18 0.4 0.26 2.84 0.26 1.12 0.34 0.7 2.78 6.08 0.24
1.28 6.76 0.96 3.54 2.98 1.5 2.08 0.72 6.24 8.52 5.52 8.1 0.44 0.78 0.82 13.58 2.5 4.44 1.68 1.9 2.78 18.26 0.62
1.78 3.74 1.7 4.74 5.62 10.32 2.2 21.22 95.88 4.34 27.44 2.7 4.3 4.04 5.8 6.98 2.2 5.26 5.6 7.32 5.46 18.08 2.28
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
1.06 46.92 16.08 55.7 1.12 19.52 1.5 1.24 4.66 1.28 2.78 2.1 0.96 150.66 3.56 7 2.18 4.22 2.04 5.92 2.92 16.42 1.16
14.46 4.42 3.1 11.56 14.44 15.4 2.16 15.62 59 3.46 47.44 3.72 14.48 5.76 50.8 3.36 2.72 5 4.06 9.52 7.3 127.04 3.18
1.2 12.76 22.36 7.6 6.34 3.66 5.84 27.82 19.02 0.8 5.46 3.92 4 3.14 6.06 3.12 2 3.44 7.84 4.92 2.9 7.94 40.86
2.88 2.8 9.54 3.3 4.3 3.42 4.76 2.38 6.38 2.64 10.3 10.38 2.7 3.58 7 33.7 8.74 2.78 5.56 4.66 11.36 33.16 2.68
1.06 18.9 3.44 4.16 8 6.9 2.68 6.34 38.8 0.52 28.42 1.84 2.1 2.46 14.42 24.34 0.9 1.56 4.94 1.76 5.18 34.32 1.96
1.56 22.44 145.48 18.6 8.8 12.98 2.44 51.3 43.52 3.02 31.84 3.58 1.52 9.46 32.88 43.98 1.02 7.8 3 13.24 110.98 21.74 14.82
2.48 4.54 2.74 1.76 1.18 0.82 4.66 5.48 6.38 1.2 6.08 11.52 0.48 1.8 1.14 9.9 0.48 3.04 1.36 1.94 3.8 5.26 1.96
5.06 6.78 26.02 8.06 35.86 60 6.64 8.02 51.84 3.58 11.68 36.74 4.18 74.14 22.72 2.92 2.64 21.94 3.18 201.9 16.22 27.7 12.18
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2.8 10.2 6.94 9.34 65.18 40.36 3.76 12.54 10.3 12.6 7.02 5.66 22.76 41.02 28.52 8.5 3.78 1.56 3.84 16.92 3.26 200.1 10.04
1.42 2.4 6.6 7 2.74 26.58 44.64 3.98 5.22 7.36 2 5.22 0.6 116.64 4.84 0.68 0.78 0.64 5.6 2.38 7.82 7.48 14.38
4.76 8.8 15.62 4.54 11.06 51.5 3.06 4.46 19.96 2.66 7.92 8.02 1.88 4.78 4.62 29.76 3.72 18.4 5.8 5.66 6.6 34.16 2.26
1.4 1.54 120.48 2.98 12.44 41.52 54.02 1.96 13.84 2.18 2.36 1.22 0.92 4.58 9.6 1.58 1.98 1.68 2.06 2.86 7.44 208.26 6.1
3.68 17.74 46.4 12.26 43.18 26.6 193.62 13.56 42.4 11.44 23.94 8.54 4.04 101.88 284.76 62 19.22 6.64 8.34 35.56 53.94 7.18 41.08
7.2 13.54 82.32 24.94 33.66 187.82 10.5 18.34 16.22 2.64 8.08 21.72 3.26 58.32 77.26 2.12 7.98 5.5 6.66 372.94 24.72 45.96 30.3
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
2.56 2.52 0.5 2.58 2.3 0.82 0.96 1.2 20.1 1.34 2.44 7.96 1.38 0.76 0.28 11.5 0.72 4.18 0.4 1.54 2.32 7.7 0.94
8.42 10.08 3.06 2.18 4 3.06 1.62 7.56 9.84 1.84 8.28 4.3 0.96 4.02 1.3 4.78 3.86 4.6 6.5 1.84 3.2 57.92 3.78
0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0


Thank you for any help.

Best,
Wenxi

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant