Plugin
botcity.plugins.crawler.plugin.BotCrawlerPlugin
javascript_enabled: bool
property
writable
Whether or not JavaScript should be enabled when making the request.
__init__(self, javascript_enabled=False)
special
BotCrawlerPlugin
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
javascript_enabled |
bool |
Whether or not JavaScript should be enabled when making requests. Defaults to False. |
False |
request(self, url, wait_time=0)
Executes a request to the given URL
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
url |
str |
The desired URL. |
required |
wait_time |
int |
The number of milliseconds to wait after initial render. |
0 |
Returns:
| Type | Description |
|---|---|
HTML |
an HTML object which can be used to parse elements. See HTML |