[aarch64] sstableloader fails when snappy compression is used

[fruch]

when using sstableloader with snappy compression on top of arm (aarch64) platform it fails like the following:

WARN  18:56:50,815 Cannot initialize native Snappy library. Compression on new sstables will be disabled.
  org.apache.cassandra.exceptions.ConfigurationException: SnappyCompressor.create() threw an error: java.lang.NoClassDefFoundError Could not initialize class org.xerial.snappy.Snappy
  	at org.apache.cassandra.schema.CompressionParams.createCompressor(CompressionParams.java:273)
  	at org.apache.cassandra.schema.CompressionParams.<init>(CompressionParams.java:164)
  	at org.apache.cassandra.schema.CompressionParams.fromMap(CompressionParams.java:105)
  	at org.apache.cassandra.cql3.statements.TableAttributes.build(TableAttributes.java:107)
  	at org.apache.cassandra.cql3.statements.TableAttributes.validate(TableAttributes.java:55)
  	at org.apache.cassandra.cql3.statements.CFProperties.validate(CFProperties.java:35)
  	at org.apache.cassandra.cql3.statements.CreateTableStatement$RawStatement.prepare(CreateTableStatement.java:216)
  	at com.scylladb.tools.BulkLoader$CQLClient.getCFMetaData(BulkLoader.java:701)
  	at com.scylladb.tools.BulkLoader.process(BulkLoader.java:1571)
  	at com.scylladb.tools.BulkLoader.lambda$main$1(BulkLoader.java:1369)
  	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  	at java.base/java.lang.Thread.run(Thread.java:829)
  Caused by: java.lang.reflect.InvocationTargetException
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  	at org.apache.cassandra.schema.CompressionParams.createCompressor(CompressionParams.java:245)
  	... 14 more
  Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
  	at org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:48)
  	... 19 more
  org.apache.cassandra.exceptions.ConfigurationException: SnappyCompressor.create() threw an error: java.lang.NoClassDefFoundError Could not initialize class org.xerial.snappy.Snappy
  	at org.apache.cassandra.schema.CompressionParams.createCompressor(CompressionParams.java:273)
  	at org.apache.cassandra.schema.CompressionParams.<init>(CompressionParams.java:164)
  	at org.apache.cassandra.schema.CompressionParams.fromMap(CompressionParams.java:105)
  	at org.apache.cassandra.cql3.statements.TableAttributes.build(TableAttributes.java:107)
  	at org.apache.cassandra.cql3.statements.TableAttributes.validate(TableAttributes.java:55)
  	at org.apache.cassandra.cql3.statements.CFProperties.validate(CFProperties.java:35)
  	at org.apache.cassandra.cql3.statements.CreateTableStatement$RawStatement.prepare(CreateTableStatement.java:216)
  	at com.scylladb.tools.BulkLoader$CQLClient.getCFMetaData(BulkLoader.java:701)
  	at com.scylladb.tools.BulkLoader.process(BulkLoader.java:1571)
  	at com.scylladb.tools.BulkLoader.lambda$main$1(BulkLoader.java:1369)
  	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
  	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  	at java.base/java.lang.Thread.run(Thread.java:829)
  Caused by: java.lang.reflect.InvocationTargetException
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
  	at org.apache.cassandra.schema.CompressionParams.createCompressor(CompressionParams.java:245)
  	... 14 more
  Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.xerial.snappy.Snappy
  	at org.apache.cassandra.io.compress.SnappyCompressor.create(SnappyCompressor.java:48)
  	... 19 more

this is the table that was used:
CREATE COLUMNFAMILY cf (key varchar, c varchar, v varchar, PRIMARY KEY(key, c)) WITH compression = { 'sstable_compression': 'SnappyCompressor' }

Logs

https://jenkins.scylladb.com/view/staging/job/scylla-staging/job/fruch/job/arm-based-dtest-job/7/testReport/junit/sstable_generation_loading_test/TestSSTableGenerationAndLoading/Run_Dtest_Parallel_Cloud_Machines___FullDtest___full_split007___test_sstableloader_compression_None_Snappy_/

[fruch]

look like the version we are using of java-snappy is quite old and doesn't support arm yet very well

[mykaul]

I wouldn't be surprised - and we need to update it as well due to some other issues. We are using:

scylla-tools-java/build.xml

Line 363 in 3c09ab9

<dependency groupId="org.xerial.snappy" artifactId="snappy-java" version="1.1.1.7"/>

which is from 2015 or so...

Latest is https://github.com/xerial/snappy-java/releases/tag/v1.1.10.5
I just hope there are no interface changes.