|
Post by rogercabo on Jan 24, 2023 20:39:18 GMT 1
Hi everyone, today i done another short demo to get HTML code from a website. This simple demo connect to the a German radio station, receives the website code, filters the playlist and creates a small structure to save the data. Then it runs through the structure and tries to find each YouTube video by title and performer in BING.com. Sometime the website push up to 99 titles per call. Some times about 9. Note: I tried to find out the video in YT itself but that sucks. YT has some mechanisms while connection so much from the same ID and open a (I'm a Robot?) For me it works well in BING and I have not login into Bing.. But takes some little time to get response from Bing. GetURLFile.G32 (10.96 KB)
|
|
|
Post by rogercabo on Jan 26, 2023 2:31:09 GMT 1
Hi, what I found out is: Bing.com also has some lite mechanisms to prevent several calls from the same IP I guess. It doesn't return anything sometimes. I tried all search engines are available.. about 20 .. no chance..
The only search engine works so far is Bing with URLDownloadToFile(0, "https://www.bing.com/search?q=" & SearchString$, localFile, 0, 0) And the good news is, 99.99% of all "none-search-engines" websites return their content.
|
|
|
Post by (X) on Jan 29, 2023 15:41:29 GMT 1
|
|
|
Post by rogercabo on Jan 29, 2023 18:30:19 GMT 1
Here is another world time Link contains some basic time of all main citys. But I'm not sure if it works for a php file. www.weltzeit.de/zeitzonenkarte.php?lang=enIf you use Mozilla Firefox and the websites open then you can right click and select display Sourcecode. Or paste this link into firefox to check what to look for.
view-source:https://www.weltzeit.de/zeitzonenkarte.php?lang=en
|
|
|
Post by (X) on Jan 29, 2023 20:28:45 GMT 1
Here is a Demo that extracts the UTC and Unix Time from the URL file supplies by: worldtimeapi.org/api/timezone/Europe/London.txt
If anyone knows of a more direct way to get the UTC or Unix Time please chime in.
|
|
|
Post by rogercabo on Jan 30, 2023 12:38:07 GMT 1
Doesn't work for me because of simple reason I think. The code was made to run from a webserver. I never visited this website and passed directly worldtimeapi.org/api/timezone/Europe/London.txt into my browser and this happens! but im already online!

Error: Connection interrupted
The connection to the server was reset while the page was loading.
The website may be temporarily unavailable, please try again later. If you cannot access another website either, please check the network/internet connection. If your computer or network is protected by a firewall or proxy, please ensure that Firefox is allowed to access the Internet.
and GFA basic returns this:
I believe they use any mechanism to prevent access from unknown devices or IP address.
+ What you can try to delete cookies from this website. + Restart you PC, + Do not open the website with any browser! + Let renew your IP address, so it unknown to the website
+ Restart you PC again. + The call directly Gb32 with your demo
|
|
|
Post by (X) on Jan 30, 2023 14:44:32 GMT 1
|
|
|
Post by (X) on Jan 30, 2023 17:06:59 GMT 1
I tried another site: www.utctime.net/This code reads UTC and Unix Time and reports to the user via Message command...
I guess you'd call this action scraping information from a webpage which may eventually fail if the page is change and the search term is no longer applicable.
|
|
|
Post by rogercabo on Jan 30, 2023 21:19:48 GMT 1
Yes, it does work directly out of the browser. But not from GFA unfortunately.
|
|