Row too big to fit into CursorWindow

[daniel1up]

Current behavior

Hello everyone,

I was using expo and I didn't faced any error while using AsyncStorage but after eject from Expo I have the issue:

Possible Unhandled Promise Rejection (id: 3):
Error: Row too big to fit into CursorWindow requiredPos=0, totalRows=1
convertError@http://10.0.2.2:8081/index.bundle?platform=android&dev=true&minify=false:138878:24
map@[native code]...

The error is showing when I call:
const appData = await AsyncStorage.getItem('@MakinaIMEAppDATA');

I just need to know why is working on Expo and why not in bare workflow, and what should i do to solve the issue.

Best regards

Expected behavior

To work fine exactly as in Expo managed.

Environment

• Platforms tested:
  • Android
• AsyncStorage version: ^1.15.5
• React Native: ~0.63.4

[krizzu]

Hey,

This error will be thrown if you try to read a data larger than 2MB at once (some sources say 1MB, but that's different per Android device). Expo uses AsyncStorage from React Native directly, so it has the same limitation. Are you use you use the same big data in both cases?

I suggest to either chop down data into smaller chunks (different entries) or use File system to deal with blobs.

[daniel1up]

Hello @krizzu,

Thanks for the reply. Yes, I use the the same big data with Expo managed and Expo eject. I didn't understand why it was happening. But, I have solved this by increasing the size of CursorWindow, I found the solution in another ask by someone else. I am writing the solution below if is needed.

Tried to add these lines inside onCreate method in MainApplication.java:

try {
      Field field = CursorWindow.class.getDeclaredField("sCursorWindowSize");
      field.setAccessible(true);
      field.set(null, 100 * 1024 * 1024); //100MB
    } catch (Exception e) {
      if (BuildConfig.DEBUG) {
        e.printStackTrace();
      }
    }

Don't forget to import these classes:

import android.database.CursorWindow;
import java.lang.reflect.Field;

[kkureli]

Hello @krizzu,

Thanks for the reply. Yes, I use the the same big data with Expo managed and Expo eject. I didn't understand why it was happening. But, I have solved this by increasing the size of CursorWindow, I found the solution in another ask by someone else. I am writing the solution below if is needed.

Tried to add these lines inside onCreate method in MainApplication.java:

try {
      Field field = CursorWindow.class.getDeclaredField("sCursorWindowSize");
      field.setAccessible(true);
      field.set(null, 100 * 1024 * 1024); //100MB
    } catch (Exception e) {
      if (BuildConfig.DEBUG) {
        e.printStackTrace();
      }
    }

Don't forget to import these classes:

import android.database.CursorWindow;
import java.lang.reflect.Field;

thanks!

[mikekreeki]

If you have Expo managed project, you don't need to eject to be able to modify MainApplication.java with the code from above. You can write an Expo plugin that will do this on build time. I'll leave it here as someone might find it useful in the future.

{
  "expo": {
    "plugins": [
      "./plugins/withIncreasedAndroidCursorWindowSize"
    ]
  }
}

Object.defineProperty(exports, "__esModule", { value: true });

const config_plugins_1 = require("expo/config-plugins");
const addImports = require('@expo/config-plugins/build/android/codeMod').addImports;
const mergeContents = require('@expo/config-plugins/build/utils/generateCode').mergeContents;
const withMainActivity = require('expo/config-plugins').withMainActivity;

function injectCode(src) {
  return mergeContents({
    tag: 'withIncreasedAndroidCursorWindowSize-onCreate',
    src,
    newSrc: `
      try {
        Field field = CursorWindow.class.getDeclaredField("sCursorWindowSize");
        field.setAccessible(true);
        field.set(null, 100 * 1024 * 1024); //the 100MB is the new size
      } catch (Exception e) {
      }
    `,
    anchor: /super\.onCreate\(\w+\);/,
    offset: 1,
    comment: '//',
  });
}

const withIncreasedAndroidCursorWindowSize = (config) => {
  return withMainActivity(config, async (config) => {
    const src = addImports(
      config.modResults.contents,
      ['android.database.CursorWindow', 'java.lang.reflect.Field'],
      config.modResults.language === 'java',
    );

    if (config.modResults.language !== 'java') {
      throw new Error(
        'withIncreasedAndroidCursorWindowSize config plugin does not support kotlin MainActivity yet.',
      );
    }

    config.modResults.contents = injectCode(src).contents;

    return config;
  });
};

exports.default = (0, config_plugins_1.createRunOncePlugin)(withIncreasedAndroidCursorWindowSize, "withIncreasedAndroidCursorWindowSize");