Hello everyone! My name is Adrian and I am a data provider. What means that? In the last three years I've been working as an crawler programmer or an robot programmer. What means this kind of programing?
Crawler (also called web spyder) is a program, or a script that surfs on the internet automatically and grab data from the internet. Where is useful this kind of data? The answer is everywhere; you only should see where you need the information and I will grab that data for you.
Who is using the data? Everybody; the first big users of the crawled data are the search engine; google, yahoo, windows live and all others search engines that exist on the internet are based on an robot, an crawler; the robot walks on the internet and grabs a lot of informations: text content, pictures, diferent files formats (pdf, html, .....); since the data is collected, the search engine has some steps where the work on the data: the collect the keywords, they see how many URL are sended to an page; after the data is processed they have data that will go to the users; the user get a list of pages relevant to his search. All this is thanks to an crawler.
Who else is using the robots? A lot of companies and people. For example, my current company has an real estate site and the ads are coming from a lot of real estate agencies who has an webpage. I made for every real estate agency web site an robot that walks on the client page every week and collects his ads details (the address, phone, price, title, description, no. of rooms and other stuffs). My work is available on the internet, just contact me for this.
This is my first article for this blog, so here I don't explain to yo all the process; there will be articles that will explain in more details what I am doing. For more details or if you are interested by some data that is on the internet don't hesitate to contact me.
Crawler (also called web spyder) is a program, or a script that surfs on the internet automatically and grab data from the internet. Where is useful this kind of data? The answer is everywhere; you only should see where you need the information and I will grab that data for you.
Who is using the data? Everybody; the first big users of the crawled data are the search engine; google, yahoo, windows live and all others search engines that exist on the internet are based on an robot, an crawler; the robot walks on the internet and grabs a lot of informations: text content, pictures, diferent files formats (pdf, html, .....); since the data is collected, the search engine has some steps where the work on the data: the collect the keywords, they see how many URL are sended to an page; after the data is processed they have data that will go to the users; the user get a list of pages relevant to his search. All this is thanks to an crawler.
Who else is using the robots? A lot of companies and people. For example, my current company has an real estate site and the ads are coming from a lot of real estate agencies who has an webpage. I made for every real estate agency web site an robot that walks on the client page every week and collects his ads details (the address, phone, price, title, description, no. of rooms and other stuffs). My work is available on the internet, just contact me for this.
This is my first article for this blog, so here I don't explain to yo all the process; there will be articles that will explain in more details what I am doing. For more details or if you are interested by some data that is on the internet don't hesitate to contact me.
Posts
0 comments:
Post a Comment