Crawlomatic Multisite Scraper Post Generator Plugin for WordPress
What Can You Do With This Plugin?
Crawlomatic Multisite Scraper Post Generator Plugin for WordPress is a breaking edge website crawling and scraping, post generator autoblogging plugin that uses website crawling and scraping to turn your website into a autoblogging or even a money making machine! Get content from almost any webpage! You no longer need API’s which requires registration and provides limited access, also you can retrieve data from non API providing websites. Schedule it for once and let it autopilot your posts 7/24 for you like a master!
How does it work?
This plugin will crawl the seed URL you give it (crawling means that it will search all links that the webpage contains) and will visit and extract content from each crawled URL. The crawling process is customizable: you can set the crawling depth, crawling rate, maximum crawled article count, crawl only links with specific class or ID and many more customizations.
v1.4.4 update: Added the ability to set multiple proxies for crawling pages. The plugin will select one at random at each page access
v1.4.0 update: Added the ability to paginate crawling (crawling for articles will continue on the next page of the seed page).
v1.4.0 update: Added the ability to import product prices for crawled products (WooCommerce compatible) dropshipping price automatic modification – video tutorial
v1.4.0 update: Added the ability to increase imported product price by a fixed number or to multiply it with a predefined number (great value for dropshipping!)
v1.2.8 update: Added paginated post importing support (into a single crawled post) Check: VIDEO.
v1.2.4 update: Added the ability to set proxies for crawling pages
v1.2.3 update: Added an option to crawl the page from Google cache when direct crawling fails (blocked)
Google Translate support – select the language in which you want to post your articles
Text Spinner support – automatically modify generated text, changing words with their synonyms – built-in, The Best Spinner, SpinRewriter, WordAI, TurkceSpin and others – great SEO value!
customizable generated post status (published, draft, pending, private, trash)
shortcode to list all posts generated by this plugin: [crawlomatic-list-posts type => ‘any’, order => ‘ASC’, ‘orderby’ => ‘date’, ‘posts’ => 50, ‘category’ => ’’, ‘ruleid’ => ’’]
automatically generate post categories or tags from marketplace items
manually add post categories or tags to items
choose if you want to update post if it is already posted
send custom cookies with the request to the crawled webpage (authentification)
generate post or page or any custom post type
embeds videos from YouTube, Vimeo, Flickr, IGN, Ustream.tv and DailyMotion using website crawling and scraping
define publishing constrains: do not publish posts that do not have images, posts with short/long title/content
automatically generate a featured image for the post
enable/disable comments, pingbacks or trackbacks for the generated post
customize post title and content (with the included wide variety of relevant post shortcodes)
‘Keyword Replacer Tool’ – It’s purpose is to define keywords that are substituted automatically with your affiliate links, anywhere they appear in the content of your site. For example, you can define a keyword ‘codecanyon’ and have it substituted by a link to http://www.codecanyon.net/?ref=user_name anywhere it appears in your site’s content.
‘Random Sentence Generator Tool’ (relevant sentences – as you define them)
option to automatically delete generated posts after a period of time
detailed plugin activity logging
scheduled rule runs
custom field support for generated posts
custom taxonomies support for generated posts
unlimited crawled variable importing (unlimited imported parts of the crawled pages)
option to copy or not images locally
option to add canonical meta tag to generated posts
Maximum/minimum title length post limitation
Maximum/minimum content length post limitation
Add post only if predefined required keywords found in title/content
Add post only if predefined banned keywords are not found in the title/content
Save and restore plugin rule list from file
Testing this plugin
You can test the plugin’s functionality using the ‘Test Site Generator’. Here you can try the plugin’s full functionality. Note that the generated testing blog will be deleted automatically after 24 hours.