Ignore error and filter invalid data

[ghost]

I want to validate my dataframe but I don't want pandera to throw an error if any row is invalid. I want to filter the valid rows from the invalid rows. I've looked at the documentation but couldn't find anything.

[cosmicBboy]

Hi @muhammadkashif-10p so currently the solution for this would be:

try:
    schema.validate(df, lazy=True)
except pa.errors.SchemaErrors as err:
    invalid_data = err.data.loc[err.failure_cases["index"]]
    valid_data = err.data.loc[~err.data.index.isin(err.failure_cases["index"])]

You can create a utility function for this and reuse it in your codebase.