[Malpedia] Rate limite Error

[Megafredo]

Description

When the connector starts up, it will make the API calls needed to retrieve the data, but there was a “rate limit” problem from Malpedia.

{"timestamp": "2024-08-20T10:59:31.351778Z", "level": "ERROR", "name": "Malpedia", "message": "[API] Some error occurred during yara rule creation", "exc_info": "NoneType: None", "attributes": {"family_name": "win.stampedo"}}
{"timestamp": "2024-08-20T11:00:37.591599Z", "level": "ERROR", "name": "Malpedia", "message": "[API] Some error occurred during yara rule creation", "exc_info": "NoneType: None", "attributes": {"family_name": "win.sykipot"}}

Current logger info - Rate limite in connector

{"timestamp": "2024-08-27T06:23:47.241095Z", "level": "INFO", "name": "Malpedia", "message": "[API] You have exceeded the speed or frequency limit allowed by the server, your request will automatically retry in seconds.", "attributes": {"status_code": 429, "reason": "Too Many Requests", "retry_delay": 20}}

Message returned by Malpedia's api request

{"message":"We have noted excessive query behavior against our API from your IP address. Please note that we only allow a quota of 60 requests per min or 2000 requests per hour. All information that is scraped this way can be typically acquired through way fewer requests to other endpoints. If you need help with proper API usage, please don't hesitate to contact us: [email protected] / [email protected]","available_in":"16 seconds"}

Additional information

• Identification of another error when creating intrusion set (Fix - KeyError "refs")

Screenshots (optional)