In-house web crawling project started initially for crawling & fetching free stock photos around the web. After successful photo crawling, we improved it to crawl and fetch anything from any site that maintains a minimum coding standard.
We worked on lots of models & objects/data for training.
Unlike existing web crawlers, our’s isn’t PHP based. So no timeout or script execution issue.
Maintain high quality of coding standard, so issues with existing crawlers doesn’t occur here.
We have Integrated 3rd party captcha bypass system which is a common issue while crawling the web.
We also integrated multiple proxy methods, use any 3rd party service or your own proxy IP/server
Detailed reporting about what is crawled or fetched. And error reporting if there is any.
Beautiful high quality free images and photos you can download and use for any project.
View MoreWe worked on lots of models & objects/data for training.
Unique frontend design which can be customized as per your need/business model.
Full CMS with extensive functionalities with 3 level of user access. This can be modified as your need.
We use AWS S3 for photo storage, any any S3 compatible storage can be used from any provider or use your own setup.
Social login/signup along with all social platform share is already integrated.
Detailed analytics & reporting is available (user/contributor/stock images etc.)
We worked on lots of models & objects/data for training.
Currently we are working on to our crawling service to provide as a hosted service. Where you can use this as simple as a PAYG model.
We are working on Stock photo CMS bundle and use on theming to use it for all kinds of media.