Web Data Parser adds ad-hoc data extraction and more automation!
December 26, 2008
I have to admit it. I'm completely jazzed about Web Data Parser. It's one of the most sophisticated tools I've developed to date, and I think it has a very broad range of use.
Thanks to the incredible feedback of the more than 180 comments I received on the first two blog posts about WDP, I've added an additional set of features that will blow you away:
- Ad-Hoc Data Extraction
Web Data Parser is no longer limited to extracting data from plain-old fixed-column tables. I've written a smart algorithm that figures out the "shape" of the data in a variety of kinds of tables and parses the data accordingly.
This means extracting product data from sites like ShopZilla and BizRate, or home data from Realtor.com, or search results from Google — just about anything!
You have got to watch the video to appreciate this new feature.
- Following "Next" Links
Web Data Parser now has the ability to look for "Next" links on the page and "click" those links to get to the next page of data, then extract the data from the next page, look for another "Next" link, etc. This saves you loads of time in the many instances where there is more than one page of results.
To see these features in action, watch the new video on the WDP homepage:
Click here to watch the new beta demo video.
Please leave your thoughts and suggestions for improvement in a comment below. Thanks!
Comments
140 Responses to “Web Data Parser adds ad-hoc data extraction and more automation!”
-
Jonathan Leger has been earning his living online full-time since the fall of 2004. He regularly posts advice about search engine optimization (his current passion), AdSense and Internet Marketing. 
-
Its just gets better and better.
I am ready to buy today jon as I have an automation job ready and waiting.
Great job!
Buddy
Great additions, immensely practical tool!
Not sure if it allows for this already but if not, here's one more feature request: customizable/editable column headers/titles.
This would be particularly handy when exporting the data as you could tag/title it according to your specific project requirements.
Good to know you're planning to launch it soon, too!
Amazing job on this Jonathan, but I think we're all getting used to that though by now…you my friend are a programming genius and this is another tool that demonstrates that clearly.
Wow, Jon. I write a lot of code, and I am impressed by this. I am running out of feature ideas.
Most of the features that I can think of involve post-processing the data — which is can be easily handled once you have a csv file.
So, things like search and replace, screen based on min and max values — etc.
Oh — maybe people would like "output as HTML" instead of csv (is that in there already).?
Regards,
Mark
Jon,
Looks like a great tool. Will it work with grabbing info off pages like yellowpages.com, etc. And do the "next" thing too. That would be really useful for us folk involved in B2B stuff and when we need to grab lots of businesses info.
Can you also maybe explain the ways people can use this type of data to create new content on their blogs and web properties…? I know you can, but I am not connecting the dots for some reason.
This tool looks great. The only added feature I would ask for is to be able to additionally pull the individual product page data for each product entry.
In your Shopzilla example it pulled from the summary page and went as many summary pages deep as existed. However, on the same line if it followed each product entry link to the individual product page and pulled the specifics from the product page like sales copy, shipping terms and any other data it would enhance the value of this tool.
Maybe following the link to the product page could be an option invoked by a check box.
Having spent decades in the software industry and decades dealing with usability issues I'd say your software is one of the few that looks to be high quality in both areas; something rare in the IM owrld.
The marketer/analyst in me sees great potential in a tool like this so I am eager for its release.
Thanks,
David
This tool is definitely something I can use. I am constantly cutting and pasting from my distributor's websites. I'm not sure I understand the keyword feature. Is it searching for suggestions for each keyword loaded?
Regardless, I am very interested in this product. As usual Jon you have outdone yourself. Thank you for all the wonderful products and features.
The only thing I'm missing there is the images, which we could use also.
You could parse the url of the images also.
BTW for how much time are you working on it and are you developing the tool only by yourself?
All the Best,
Marcos
For me the difference between a good product and a great product is what comes with it. what I am talking about is the training the best products in my opinion have excellent training videos that come with the product so the end user can learn how to use the product to its full potential
…………Jeff
Jonathan,
Could this pull listings out of yellow page directories, for example, or other phone/directory listing?
I'm sure there are other things that will come to mind as I think it through.
Looks really good.
Thanks,
Mike
Looks like I'm behind the cure, since I just saw your email, "you MUST see the latest (and last) WebDataParser preview video!"
WOW! Now that's impressive.
Since I guess that I'm one of those creations that's not using word tracker too much, I'd like to see your comments on how to implement these activities on two other tools that I do use:
1. Excel 2007, Add-in: "Ad Intelligence" I'm thinking that the combination of these two (maybe an addin to Excel?) would look good.
2. How about output to Xedant, Complete, and such as KeywordSpy?
Or, maybe the system will do this and I just don't realize it yet.
Anyway, really great tool.
Merry Christmas!!
Jim
This looks like a great product! I can't wait to test it out myself.
I second the request to follow links to the details pages and extract the data there.
It sounds fantastic. I don't know enough about it yet, but it appears to me that it would serve as an excellent tool to study a subject introduced into your Web Data Parser and end up being a training tool in itself. I went anxiously for it's debut. Please let me know when it is available so I can get it and play with it. It greatly intrigues me.
Thank you for allowing me to join your group to watch it become a great tool!
Jay
As cool as this tool is, I'm still wondering about extracting questions from web pages. Imagine adding this functionality to a tool that can already help you to make XML feeds from the data you extract.
Visiting a forum or two to extract all the questions your target market is asking about your niche topic without actually having to hang out for very long in the forum, would be the icing on the cake!
This sounds good, but how will it be used with affiliate links, etc.
I hope I can afford it!
Extremely useful.
Can this software extract images? I would love to see that!
Hey Jon,
The product does some amazing things and is definitely a time-saving machine, but I haven't got the full grasp of it's best usage so I hope you'll include some instructions on how to use it to the fullest potential. Thanks.
Tony-
an additional option that would be nice would be to not only extract the text but the link in SEPARATE columns
in your shopzilla example you have the content showing with hyperlinks under it, but sometimes what i need are the hyperlinks as well
an additional option that would be nice would be to not only extract the text but the link in SEPARATE columns
in your shopzilla example you have the content showing with hyperlinks under it, but sometimes what i need are the hyperlinks as well
also i am still concerned about getting banned if scraping large sites
will you be web based with an ip rotation or will it be pc based with an option to load random ip addresses for the search
thanks
I would definitely agree with the person that inquired about the yellowpages.com listing extraction. And not only that, allow it to extract the email addresses that are hidden behind links. I have a software called list grabber that I paid $250 for and that's all it does but I have to keep paying another $180 for an upgrade every year. If this software had that capability, I would definitely become your best affiliate. Your product would sell like hot cakes!!!
Could WDP be designed to take the extracted data and turn it into an RSS feed that would be self updating and maybe there could be a way to mash-together data sets/feeds for an affiliate sales site, so you could precisely target vendor products from major retailers like say Amazon.
Just a thought
i work with alot of mlm companies off of google, msn & yahoo
i am wondering if it is possible to extract phone number, email, name and url for mlm replicatable sites.
http://*.ibuzzpro.com
my site is tmccarthy.ibuzzpro.com
there would be a great market for this kind of program.
please feel free call me 800 954-0012
wold you be able to add say an affiliate id to thelinks that you exctract from say amazon or ebay etc..now that would be a handy feature
keepup the god work here and thanks
one more thing you can add to my previous comment, is there any way to automatically add your affiliate ID to the Rss feeds ? Wow. that would be great if you could. you could really build yourself a kick a– affilate site with tightly focused tangible products if I'm thinking right.
Now all I have to do is convince CJ I deserve to be an affiliate!
Steve
Hmmm — proxy support. You need to add proxy support for large jobs. Also, some code to beat Captcha would be nice too.
Looks Interesting. I look forward to trying it out.
Charles Akin
Software Reviewer
* Extract Google/Yahoo/MSN results (position, urls, desc)
* Parse/find email/phone numbers from these results (spider the site separately later)
* Export results to the template with tokens
jon,
you never cease to amaze! awesome research tool! the ad hoc feature did it for me!
what price range for this product and what platforms will this run on? will there be a web based or REST XML version available? other export formats would be nice: xml, rss, etc.
nick
Hi Jonathan,
Well, I've held off commenting so far, because I wanted to see where you were going with this. I'm impressed!
I do some affiliate and associate marketing for large sites, such as Amazon, and I can see how this would be useful, especially with the newest additions here.
Now, if you just don't price it out of my budget
Thanks for all your hard work,
Steve
Jonathan,
Um… wow!
This may be one of the most useful web utilities yet. The scope of its usefulness defies complete explanation. I think your demo video goes a long way toward showing its utility, but its true value will likely only be discovered by each user and that value will be as unique as the user themselves.
You might consider a showcase of uses submitted by users. I think this is a product that will provide endless self-testimonials.
MY SUGGESTION:
My suggestion, in case it isn't already doing this, would be to generate HTML output from the extracted data. I often work with web based tabular results and must reformat the tables for display on other pages. If WDP could allow me to reorder columns, select which I need, and let me write out an HTML table, that would be awesome. Bonus points for css formatted output.
Thanks for the sneak preview video. This looks to be a phenomenal product.
Wow.
This is way cool.
You should advertise this to colleges and school. Researching data on the net is a hevy chore that you have just solved.
Jonathan,
I swear you have been reading my mind over the past month. This is exactly the tool that my client has been asking about. If I didn't know any better, I'd have to believe he was talking to you about the exact function you have been developing. The "Next" links function is icing on the cake. Great job !!!
Will you have an affiliate program?
Thanks,
Bob
Love that this keeps improving! I liked Accu Mark Level's idea - it would be very helpful to be able to pull info from niche specific forums.
Hello Johnathan,
Themelis Cuiper here from
Amsterdam The Netherlands.
- I also vote for proxy support.
- a scheduler when automation task runs.
(run multiple instances ?)
- the link and anchor text in separate columns.
The recognition of ad-hoc data is genius !
Thank You,
Themelis
Hi, Jonathan,
This is a great product!
I would imagine that it could also be used to extract email addresses and names from my very large inbound email files and lists. Is that right ? Let me know at your earliest convenience.
Looking forward to having Web Data Parser ASAP
Thanks,
Norm Abbott
Hi Jonathan
This is another masterpiece from you…! I think this tool would be very beneficial for many players in the internet world from stock brokers, Realtor, college students until Internet marketer and…gamer like me.
Is there any way the the parser can be set automatic like every 8 hrs for specific purpose. I'm just thinking to get the data from stock market and update the archive.
Thanks and keep up the good work..
This is a great product! I can't wait to test it out myself
Thanks
Atli
Jon,…
Just keeps getting better and better!
I've got a project coming up in the next couple of weeks where I am putting a retail product site online. I need to collect all of my products and somehow "run them through the web to find what are the "cheapest competitors are charging? Sort of like having an automated NEXTAG where I could feed a "block" of product names/model numbers –> into your program and have it crawl the web (or a site like NEXTAG?) and gather/compile the results into a table?
(Pardon me if I'm starting to sound too Sci-Fi ???)
Thanks,
Skip…
Wow, it just keeps getting better and better. I think the icing on the cake would be to insert affiliate information so all those links can be affiliate links for niche product websites. Better yet, have those affiliate links be hidden through a php file or something so that google would not see it as strictly outbound affiliate links. I would love to be able to extract data from place like Tiger Direct or Commission Junction for affiliate websites and have all of the images and affiliate links already inserted. That would be an affiliates dream come true. Keep it up though, this is really good.
HEADLINE: "Jonathan Leger Saves the World Economy!" I had originally encouraged you to not "bloat" this tool with too many features. You didn't, but you did stuff it with an impressive amount of powerful utilities. If this tool saves me as much time as I think it will, multiply by the thousands using it and we'll all be much more productive, the world economy will flourish, and all will be well on Planet Earth.
HEADLINE: "Jonathan Leger Gets People to Love Their Jobs Again!" One of the key factors in job dissatisfaction is repetitive tasks, and in the Data Age, data extraction/cleaning, etc. is one of the worst offenders. This tool will really help.
But can we, the masses, be entrusted with such power? I say, "yes." Let us prove it to you, sir.
Seriously, Jonathan, you've really impressed this time. Tell me it's not just vaporware and special effects! I'm sold. Happy New Year!
great tool and well done with the new improvement. hope the price is affordable for me.
cheers keep up with the good work
OK Jon, quit teasing us and put it up for sale already! I think you are just waiting until January so you can push all the revenues into 2009! Good tax planning!
Seriously though, it looks great. One question I had is if it will work on webpages or sites we have to login too? There are sites I login to that I would like to extract data from, so if it does that also that would be great. Maybe it does, just looking for confirmation of yes or no.
Thanks.
Hi Jon,
I would like to be able to give the parser a list of URL's - including dynamic URLs - and let it run through them extracting the data into text files - one per URL.
Noel
Very interesting and clever piece of software but I wouldn't have a lot of use for it unless you can explain how to use the data it gathers without running foul of copyright issues. I can see it would be a useful research tool, and the spammers are obviously interested in it for harvesting addresses. How can you use this tabulated type of data in a whitehat blog or web-site? If I can visualize how the data can be used profitably then I might be interested, but my imagination is limited by my experience. I'm obviously missing a piece of the puzzle. Care to enlighten me?
Hey Jon,
Cool tool! I have one more suggestion that I think you really gotta put into the web data parser.
I would like to see that the web data parser can get updated data from any auto-updated data like Google Trends: http://www.google.com/trends/hottrends?sa=X . So, if I select the data from page and the google trends update every hour, the data parser would just get the new data as long as my computer is on and connect with the internet. That way, I don't need to update it every single hour.
Plus, it will be good if you can make the data parser to autosave the data from the google trends to a particular drive the we specified. I haven't seen such tool that can do so, if you can do so, I think it's a great PLUS.
I can see tonnes of uses for this tool! I am about to launch a search engine for a specific niche … this tool could save me hours, even days of data-base building. I don't have any suggestions for add-ons, but selling it with a few training videos would enhance the saleability of the product.
Thanks for asking for my opinion and Seasons Greetings
Petra
Jon,
You are genius! I always awaiting on a new e-mails from you!
One question:how about a copywrite ? Would the software become a legal instrument or I have to use it with care ?
Sincerely,Yelena
Hi Jonathan,
Having worked with programs like this in the past, you are really on to something. This probably isn't for immediate update but you might want to consider a capability to read blog entries and create tables based on keywords where you extract the blog entry as a complete text block in a table cell. This would allow for some external manipulation of the results once it was exported.
Also,you might want to consider allowing several different formats for export, particularly XML. (If you don't do this already).
Wow,
That's awesome. I just thought of 20 - 30 ways that I can use that and even some add on products for it. How about an SQL format renderer so that you can pull out the data, name the fields and import into your MySQL or MSSQL database (or even replace it at specified intervals. Great job - great tool. I AM a BUYER!!
Oh yeah - I'm also a seller - if this is a Clickbank product, I agree with David, that it will be incredibly helpful to the common non-IM'er as well and it would be a fantastic outright tool to have for anybody who mines data online!!
Great job Jon,
Terry & Lyn McNeese
Hi Jonathan, congratulations, you have created a great tool which could have endless potential as you can imagine from reading all the input from your readers above.
Obviously you have to careful not to overload it with all the extras mentioned above as it may become too pricey or get too complicated to the end user, but you could market this now as the basic tool and offer add-on options later at a cost per option rate.
Just like buying a new car, if the customer wants the extras, they are fitted at a cost.
Looking foward to the release of Web Data Parser, if I can afford it, I'll buy it.
Great program, will buy in future. Thanks
I think the most usefull way to use the tool would be to create new content for sites and blogs. This looks to me like it will be one of the best tools on the market for that purpose.
Not much to add now, but after a quick review of the video it looks like another awesome Jonathan Leger production.
I Love it and myself and several friends would buy it if it could extract the article content from :
http://ezinearticles.com/?How-to-Determine-When-Its-Time-to-Buy-a-Home&id=1481726
For example… grab the article content from all the rest.
They try to hide the content from extraction.
Thanks
Tom
Jon, This looks like a useful tool.
I'd like to be use it to feed 50 or 100 keywords to Google using the allintitle:"Keyword Phrase 1" operator, and (optionally) put quotes around the keyword phrase for exact match.
Hi,
It looks great but I would also like it to be able to extract articles and summarize them.
Brilliant gear Jonathan,
Having extracted the data… a simple search & replace function would be useful.
1) Run as a schedule jobs
2) Auto insert into mySQL database / export to EXCEL.
3) Allow user to "educate" if it pull the wrong data so it won't repeat again.
Just check the feature in offline browsing software such as
a) crawl how many level deep, if follow links.
b) restrict crawling in certain URL pattern
Normally data generated site quite consistent …
3 questions:
1) does the "follow next page feature" looks only for the anchor text next page or is it able to follow links called "more" or even next in another language ?
2) any suggestion or example of the use of all that exported data ?
3) how much will be the price ?
ciao
alex
Watched vid with interest: Liked the Ad hoc feature however would suggest on the "next" page feature to allow user to limit the number of pages, because some lists like google search may have 250,000 pages plus or say on shopping site where you have sorted on price and only the first 3 pages are of interest, I can think of many more. Also where you have a manual where you only want certain pages so to put a start page and an end page number feature would be useful. Further, why restrict to tables on websites what about tables on own computer hard drives, in PDFs on spreadsheets and text docs. Last but not least what about a feature to extract pictures from a picture file, websites etc - I don't want much - Thanks Paul
How about automated login to username and password protected websites? I also second automated insert into MQSQL database to cut out the middle steps.
…or to add to a WordPress page/article?
Hi Jon,
WOW great tool wanted to ask and I am sure someone has covered it here..
In the URL box can I enter any URL and the software go and do its stuff or am I limited to the ones you have in the drop down box!!!
Regards
Sam
Awesome Jonathan!
Can WDP drill into WordTracker (Full account) Results and grab those too?
Perhaps there's a way to write a macro or something to do that.
It would be a great time saver.
Looking forward to its release.
Cheers
Jonathan,
Every time saving tool that can replace time in front of my computer doing "drudge work" and replace it with more time with my wife and kids AND greater effectiveness I consider to be critical tools.
Congrats on yet another critical tool success.
Expect Success…
Don
Your new product looks excellent!
Great tool.
I agree that the images would be good to have as well. Would be nice if I had a choice of just capturing the link to the image or actually downloading each image.
Also just want to double check that it will work fine for a multi-column table.
Jonathan,
You have developed a great tool.
In web scraping, many times we have a requirement to get data from password protected sites. Also, we would like not to leave any footprints on the server from where we are scraping data. If you could provide these two features, that would be awesome.
I see great potential for Web Data Parser. Of course one addition beyond your great skill set is in the area of ethics, as several have mentioned. So, is it possible to add a conscience to such a tool?
Chaplain Paul Slater
HI
Guys you seems to have a good product what would be the price
for same.
thanks B rent.
Hi Jon,
I would be interested to see if this tool could capture data from a 'form card' used for uk horse racing? An example card can be found at Racingpost dot com.
The resultant csv form would then be used to determine selections from the live market.
Cheers
Great tool for data extraction. I would love to try it.
As long as I'm often on the road and move from PC to PC, I would like to be able to run this software directly from an USB stick, without the need to install it on the PC on which I'm using it.
ciao
alex
Fantastic new tool. ^-^
It's growing into a powerful data tool.
As others have mentioned, I would also like the abiliity to grab images.
Well done …
Nick
To aid automation, how about a command line interface (CLI) from DOS that accepts all configurable parameters. That way the windows GUI tool does not need to be opened.
Lots of tremendous usability in here Jonathan.
The one final step would be to include typical user macros, e.g. "extract all image URLs", "extract all OHLC values", "extract all emails" etc. One sneaky one, which search engines frequently pick up inadvertantly from site search fields, is "extract all terms searched".
looks great, i would like to see this application work with doba.com but what would be nice is when you get a list of results most of the detailed information in on the link page where one can pull availability, shipping prices, detailed product description, fees, product ID or sku, condition, UPC, brand, ect. there are millions of items available but all the good stuff like MSRP is on the links page deeper in the site. I would like to see this app be able to pull the entire list available and then pull the details or each product and insert it into the same row, this would be a powerful application with its weight in gold.
I would need it to work with websites other than the predefined sites you currently offer.
the ability to parse paypal would be handy - it is tax time and an entry like this
May 20, 2008 Payment To Sam's Club Completed Details -$36.00 USD
has a hyperlink to Details
which then shows what was bought date how much etc
if your software could integrate that info and combine it with the initial page of data that would be great
Hey Jonathan,
It looks great and I hope it is working with all thoughts you have when getting it into your fingers.
Does it also grab the IPs when you are going to the individual data?
If this is the case you can use it and grab the CPA empire by its roots.
You should be aware of the ethics also.
Peter
Excellent tool for anyone who wants to gather data the easy way.
My web developers will save a lot of time with this tool when a client asks us to re-design their existing web site.
Can't wait to purchase it.
Edison
Jon - you are da man! This tool looks GREAT! But what is it good for?
No seriously, in your video you explain its functions and its features. But what about the benefits? (to say it in marketing language).
I'm afraid I - like some of the previous commenters - am lacking some pieces of the puzzle. So for marketing purposes it definately needs some more ideas what to do with the mined data and how to turn these data into money.
Speaking of language… I have purchased many wonderful tools which are unfortunately unsuitable for non-english speaking markets which limits their use for me. So if you could keep foreign countries / languages in mind that would be awesome. For example data extraction from any URL and not only preselected (U.S.) sites.
I'd also love to see this auto-mining feature that works like a CRON job. I am just wondering if the software would pull the same data over and over again or if you could tell it to check for duplicates or only add new entries?
Now if the new found data would be automatically saved and emailed without having to personally run the software and manually do it - that certainly would be my icing on the cake…
Happy New Year - and I'm looking forward to get to know your new "baby"
Kiya
Totally amazing video - can't think of anything else to enhance as it has all the features that I am looking for and more. Happy Holidays
I'm also voting for having Web Data Parser offer proxy support. I've been using dapper.net for a while but your tool makes data extraction crazy easy. Thanks, great looking software.
Id love to know the same as Kerry above.
Can WDP drill into WordTracker (Full account) Results and grab those too?
Even go as deep as the competetors search , Set google results as default and grab all the data from there , it would be amazing and save so much time.
Looking forward to its release.
Cheers
Another vote for the ability to schedule jobs!
Andy
Jon, you mention extracting from google search results which i am very interested in, but cannot easily see a demo of it.
Can you provide one? I am very interested in this area in the field of AdWords management and optimisation.
Thanks. Your tool looks very interesting and useful.
I'd like to see also if you could split the resulting fields of text up into smaller pieces, by selectable delimiters, like in excel. Then choose which piece you want to keep, and maybe add something extra to it.
I have to use excel a lot when working with data for AdWords campaigns, and this tool may be able to help.
I also echo Nadiya's comments - you tell us a lot of features and then we have to figure out some benefits ourselves.
Why did you develop this, what was your need, and what will you be using it for?
David, UK
Another thought - could you link the tool to google keyword suggestions, so that for a given product you could see what search terms and volumes were associated?
thanks again.
I'm very impressed. I can see that this software could very useful for private and business purposes.
I have two questions.
1. Will WDP be able to handle div based data as well as table data?
2. Is there a possibility of extending it to extract data from a table in an embedded pdf file?
Looking forward to the release.
Nora
What I would like to see is the ability to select some information on a site, parse it, and produce the code to parse that information. Then I could put tthe code into a new web page. This would allow me to get updated selective information when the new page is refreshed.
It's an idea…
Thanks,
Warren
really it’s useful interesting and informative. thanks
Sorry, this might sound stupid. Just bare with me I am a newbie to this stuff. Can I use this script to automatically go onto Realtor.com and extract all the listing details and pictures then incorparate that information into a free source platform like Joomla. If not what prevents me from doing this and how can I get around it?
Jonathan,
I have never seen anything comparable to your Web Data Parsa.
You are light years ahead of everything else.
Thank you for the honor of choosing me to evaluate your product.
Hi Jon
Clearly the tool works for the purpose that you intended but I'd be interested to see more of the 'why' behind it.
Cheers
Adrian
Jonathan, you are blessed with intelligence, great tool, can't wait to see it working. Did I misunderstand that there's is a way to try the tool before launch? I couldn't find a link to it. Hope to hear from you. Thanks.
It would be great to have an applications video that would show some potential uses for the software. I see how powerful it is, but don't necessarily see how to use it in my everyday work. Thanks.
Looks brilliant - I'm ready to buy.
Possibly this is can all ready be done, but if not it should be easy to add.
Say I have a single column that actually contains two pieces of data: "From placename to placename". EG "From Mexico to Hawaii". I may want to split the column in two, putting "Mexico" in one column and "Hawaii" in another.
Search-And-Replace Feature: Useful for removing the "From " part, and much more.
Split Feature: Split column X at the word "to" creating columns Y and Z. (does that make sense?).
Al
Can it be automated to select certain tables.For example I want to select health section of google news and save output to csv file
And how about extracting video embed code from youtube listings? Can it be done
Can't wait to pu my hands on this powerful piece of software.
Will it be a one time fee or a monthly fee ?
Al
Nice tool for sure - congratulations
I do share Mark Mason's thoughts though on maybe allowing html outputs (and csv's?). Great Job!
Do you plan on creating an affiliate offer for internet marketer's? I'd love to sell it.
wow. im very impressed. this is very useful!
Absolutely fabulous! Wow — I want it NOW!
Hi Jonathan,
Can it extract data from only part of the page? eg only One table from page with 5 tables ?
Where will be the data stored ?
I think it has lots of potential.
Let me know.
Regards
Vipin
I think you have received a variety of suggestion to address before your kickoff… need I add more except to emphasize the inclusion of examples of use to insure high level of sales.
With Sincere regards and awe of your programming insight,
Sunita
This looks great! Only 1 annoying request - please let me run this on a mac. I'm scared that pretty soon all these one-off tools are going to push me back to windows.
Will the parser work with Google Analytics? Ajax technologies?
I would love to take it for a ride.
I don't quite understand what I need that information for but for some reason I am probably thinking small. I am going to your sales site to see if that clicks my light bulb on.
Rick
Any news ?
You said you wanted release it in the first january week…
.
.
.
WHEN?
.
.
.
A very powerful tool! Anyone wanting to produce an affiliate website could use this tool to speed up the process and have your site up in no time!
Call me stupid but I have no idea what I could use this for. So here you are with all this information and then what? I'm lost.
Develop a tool that takes up where mine leaves off and I'd be interested immediately. My FREE tool will scan eBay Pulse for hot new niches. Now normally we're told that eBay Pulse isn't a good tool for this because it only uncovers popular searches. But my tool takes it a step further by drilling down into eBay Pulse's categories to root out the number of bids items are getting. OK, now folks can see which items are the CURRENT hot items within those popular searches. Now we need an easier way to locate those items to sell on eBay then the current one of buming around the country looking for deals.
I am a newbie at marketing and can understand the need for links which you offer in other programs- but tghe web parser has me mystified
i am scratching my head and asking "how is all this data information useful?" where do I use it - how do I use it
I know this will be the dumbest question on the page here but I would value a brief comment about how this works in with my website
Regards Lennie G
Great Product Jon. However, only the advanced features like ad hoc search and multi-page extraction are of use else plain vanilla extraction is possible by copy and paste.
I guess keeping the price low will make it a roaring success
All the best
Manoj
Hi Jonathon,
Happy New Year to you. The product is definitely gonna help a lot of us especially the newbies as we start to build our online business.
We will need to tweak our websites and any help we can get is appreciated.
Waiting patiently for your release!
WDP is getting better with every revision.
Hopefully the price will make it a no-brainer.
Wonder what's the early-bird discount.
HI Jon
What a great tool! I agree with an earlier comment about allowing it to follow a product ling and pull in related detailed product information. Apart from that I am struggling to think of anything else.
Keep up the good work.
Regards
Charles
Hi Jon
I received your email in which you explain the delay of the release: I can't wait to see the extra feautures !
Jim
I have a tai chi web site and I want to use this on amazon listings - there are so many tai chi books that are not differentiated it is difficult to find the gems.
I'd like to use this inside the password protected affiliate area - so there needs to be some way to either pass the login in information in.
This way any information I capture will already have all the affiliate code embedded.
would this also work on you tube listing? I have the same problem with "poor" vids.
Isn't this tool grabbing all this information at the expense of the web sites it scrapes?
While not exactly espionage, because the information itself is being made public as it stands, this approach does serve to undermine the intentions of the sites owners. It is using resources created by others without fair compensation. Such an approach could be viewed as an attack and not a welcomed visit by a buying customer.
Just something to think about. Remember, such tactics could be used against anyone posting here as well.
I'd like to extract keyword data from the "wanted" section of *Craigs*list*. I can pull up all the cities I want at one time, it's just a pain to look at each add. Great Potential and Great Tool!
If you could put a 'wait' feature in the script engine - in order to let a page load before extraction, or to wait between pages so as not overload the target web site- I'm specifically thinking about using it with another tool like to SEO For Firefox extension, where it takes awhile to load the data…
I'm buying as soon as it is released!
Carl
From the video it looks like this program will do many things with data collection. but I did not see if you could do data parsing with Google search results. I sure it will but if it does not yet please add this feature to the soft. thanks
Rodney
Your program looks easier to use than {snip: a competitor}.
Looks great, Just one question.
Will there be an autoscript that will work with Nichebot?
Cheers,
John.
Looks very interesting - need hands on demo to really see what it can and can't do and what my wish list might be. Do you have any idea on when the "first week in January" might come and what the pricing model or actual (low?) cost might be?
Hi John,
Great tool, but i noticed in the video that there was no option to export data to a .txt file (notepad file). Can this be added as it would be an absolute must for my business?
Thanks
Paul
Jon,
Any way to get a Macintosh-compatible version?
Thanks,
Dave
Hey Jonathan,
I'm looking to extract all the articles from my own blog to make an ebook from it.
Would your technology be able to do this at all?
Sincerely Glen F
Can i test this ? I m not sure whether it would meet my requirements.
My requirement is to aggregated jobs from different jobsites like
www.monsterindia.com , www.naukri.com , www.timesjobs.com ?
This is an ongoing requirement and i have used some solutions in the past.. which could not meet my requirements,.
This appears flexible.. the next link seems great..
Can i try for a day and then decide to buy ?
Regards
Dinesh
I have bought this as it looks like what I have been looking for. It has the potential to be an amazing tool to collect business data but with out detailed instructions, not just a demonstration video, I can't get it to extract any usable data.
Hopefully we can get some instructions or a user manual to unlock the potential of the product.
Regards,
Graham.
Any ideas on its potential application?
Great application you developed but would i would like to see in the next version is a next link range field. i have some information that posts 15000 results and well when the dataparser pulls that much it kind of locks up for a bit at 10000 results and is just a bit slow. i would like to say pull just 5 next links at a time or 10 next links at a time where i can specify what next link number to start at and the amount to pull.
besides this, a lot of data i pull has a details page with detailed information about each product, i would like to see the dataparser capable of extracting data from the submit each link and pull the tables i select then put in table format in reference to each link.
this would make my life amazingly easy
thanks
can it extract emails?more powerful than macros?
Good idea. However it is easy if the data is retrieved which ever format it may be in. So that we can make use of it more effectively.