-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathdebug.txt
More file actions
34 lines (30 loc) · 2.27 KB
/
debug.txt
File metadata and controls
34 lines (30 loc) · 2.27 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
useful:
https://www.twilio.com/blog/asynchronous-http-requests-in-python-with-aiohttp
https://stackoverflow.com/questions/32456881/getting-values-from-functions-that-run-as-asyncio-tasks
https://docs.python.org/3/library/asyncio-task.html
https://bbc.github.io/cloudfit-public-docs/asyncio/asyncio-part-2.html
https://docs.aiohttp.org/en/stable/client_reference.html
https://docs.aiohttp.org/en/v0.20.0/client.html
info/todo:
-item should only contain pattern_ok or pattern_nok, not both of them
-todo: check out if ascyncio request is with or without redirects - we can set parameter
-todo: add allow_redirects parameter - done
-default requests user_agent: requests.utils.default_headers()
-TikTok warning, while using custom user-agent: Can not load response cookies: Illegal key 'httponly,msToken'
-https://user-agents.net/
-import webbrowser; webbrowser.open(url)
-data visualization possibilites:
-tkinter gui
-html file & browser view
-jupyter -> qgrid
-plotly -> table
-todo: make some options
-todo: get supported domains - get from json
-todo: set domains - pass as argument to check function
errors:
ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'XXXXXXX_XXXXXXX.contently.com'. (_ssl.c:1129)
aiohttp.client_exceptions.ClientConnectorCertificateError: Cannot connect to host XXXXXXX_XXXXXXX.contently.com:443 ssl:True [SSLCertVerificationError: (1, "[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'XXXXXXX_XXXXXXX.contently.com'. (_ssl.c:1129)")]
https://stackoverflow.com/questions/63347818/aiohttp-client-exceptions-clientconnectorerror-cannot-connect-to-host-stackover
aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host blip.fm:443 ssl:default [The semaphore timeout period has expired]
[x] error catched: Cannot connect to host XXXXXXX_XXXXXXX.tumblr.com:443 ssl:True [SSLCertVerificationError: (1, "[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Hostname mismatch, certificate is not valid for 'XXXXXXX_XXXXXXX.tumblr.com'. (_ssl.c:1129)")]
occurs when url contains uderscore (_)