pandera not working with pyspark dataframes

[george-moussa]

I'm trying to use pandera with pyspark dataframe. It says here that it's working.

schema = pa.DataFrameSchema({
    "state": pa.Column(str),
    "city": pa.Column(str),
    "price": pa.Column(int, pa.Check.in_range(min_value=5, max_value=20))
})
print(schema(df))

I get error TypeError: expected pd.DataFrame, got <class 'pyspark.sql.dataframe.DataFrame'>

Does pandera not support 'pyspark.sql.dataframe.DataFrame'?

[cosmicBboy]

hi @george-moussa you have to use the pyspark.pandas API. pyspark.sql is currently not supported