We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
I want to evaluate SPTAG on the streaming track of the big-ann-benchmarks. (https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md) However, during the Search process, there was a double free or corruption (out) error. (It has to process 10K queries, but an error occurs in the middle)
double free or corruption (out)
Is there a problem with memory allocation and deallocation in the library? Or do I need to set some parameters?
Below is the benchmark code.
def setup(self, dtype, max_pts, ndim): self.index = SPTAG.AnnIndex("BKT", "Float", ndim) self.index.SetBuildParam("NumberOfThreads", str(self.insert_threads), "Index") self.index.SetBuildParam("DistCalcMethod", self.translate_dist_fn(self._metric), "Index") self.max_pts = max_pts print('Index class constructed and ready for update/search') def insert(self, X, ids): self.index.SetBuildParam("NumberOfThreads", str(self.insert_threads), "Index") self.index.SetBuildParam("DistCalcMethod", self.translate_dist_fn(self._metric), "Index") p_meta = '' for i in ids: p_meta += str(i+1) + '\n' p_meta.encode() res = self.index.AddWithMetaData(X, p_meta, X.shape[0], True, False) def delete(self, ids): p_meta = '' for i in ids: p_meta += str(i+1) + '\n' p_meta.encode() self.index.DeleteByMetaData(p_meta) def query(self, X, k): result1 = [] result2 = [] for t in range(X.shape[0]): result = self.index.SearchWithMetaData(X[t], k) result1.append(result[2]) result2.append(result[1]) self.res = np.array(result1).reshape(-1, 10) self.query_dist = np.array(result2).reshape(-1, 10)
The text was updated successfully, but these errors were encountered:
i have the same problem, have you fixed it?
Sorry, something went wrong.
No branches or pull requests
I want to evaluate SPTAG on the streaming track of the big-ann-benchmarks. (https://github.com/harsha-simhadri/big-ann-benchmarks/blob/main/neurips23/README.md)
However, during the Search process, there was a
double free or corruption (out)
error. (It has to process 10K queries, but an error occurs in the middle)Is there a problem with memory allocation and deallocation in the library? Or do I need to set some parameters?
Below is the benchmark code.
The text was updated successfully, but these errors were encountered: