Does Velox support custom file systems?

[rshkv]

We have a custom file system scheme (custom://) for which, in Java/Spark, we implement a custom Hadoop file system client.

I was wondering if we could connect to our custom file system from Velox. (In the context of Gluten.)

It seems we could implement the FileSystems.h interface. But I'm unsure if FileSystem's registerFileSystem is meant to be used outside of Velox.

[rshkv]

I learned that the Gluten folks already do call registerFileSystem to register their own file system. Still curious if from Velox' point of view that's meant to be public API.

(For other folks stumbling over this trying to make Velox work with Gluten, I asked about custom file systems in Gluten: apache/incubator-gluten#2832.)

[majetideepak]

Yes, you can register your own filesystem. All Velox registration APIs are meant to be public afaik.
You can see some more examples here https://github.com/facebookincubator/velox/tree/main/velox/connectors/hive/storage_adapters