EnableIoT and GearPump

Apache Gearpump

Apache Gearpump is a lightweight real-time big data streaming engine using Akka, it can also be used as an underlying platform for other general distributed applications, like distributed cron job, distributed log collection. Apache Gearpump is inspired by recent advances in the Akka framework and a desire to improve on existing streaming frameworks. Apache Gearpump draws from a number of existing frameworks including MillWheel, Apache Storm, Spark Streaming, Apache Samza, Apache Tez and Hadoop YARN while leveraging Akka actors throughout its architecture.

Apache Gearpump can be used standalone, but it a great fit to Trusted Analytics Platform. It can be used for high velocity data ingestion, stream data processing, online analytics, etc. At present, new Apache Gearpump Cluster can be created on demand by TAP user from Marketplace. (Master's and workers are deployed to YARN and Apache Gearpump Dashboard is ran as Cloud Foundry application.) Apache Gearpump instance is available to all users of given Organization.

TAP console also includes Apache Gearpump section in Data Science tab. Users are able to list service instances there. They can also deploy Apache Gearpump apps directly from TAP console.

• Create Apache Gearpump instance on TAP
• Deploy application on Apache Gearpump
• Example ingestion using Apache Gearpump

see documentation on http://gearpump.apache.org