Crawlector v2.0
Photoid Release.
[?] Released on (September 18, 2023)
[?] This is a milestone release
[+] Added Deep Object Extraction (DOE)
- Check README "Deep Object Extraction (DOE)" section for in-depth description
[+] Added full support for HTTP redirection
- Check README "Redirection Functionality" section for more information
[+] In release 2.0, the ids have their types explicitly assigned by appending a specific type substring to the id itself
[+] Added the command line options "-v" and "-c".
- The option "-v" is for printing version info to the console.
- The option "-c" is for reading a different configuration file, other than the default "cl_config.ini"
[+] Added the options clear_dns and upg_2_https to the [default] section
[+] Added the options rapid_api_weeks and rapid_api_limit to the [site] section for configuring the API request to RapidAPI
[+] Added the whois_info option which retrieves whois domain information including, registrar, registered_on, expires_on and updated_on
[+] Added the option page_title to grab the page title
[*] Upgraded Yara engine to 4.3.2
[+] Various code optimizations and minor improvements
- Check README "Miscellaneous Improvements in Version 2.0" section for other additions
[?] README and configuration file have all the information