| |
|
|
| |
|
|
oh yeah then you wrap it all in tor and proxies of course |
|
|
|
| |
|
|
|
| cauz |
July 19, 2018, 3:51 p.m. |
| |
|
|
|
| Art Garfunkel |
Paul's the writer. Yeah, I wrote a little of that stuff, but that's just technically true. In spirit, and in essence of the truth, it doesn't matter. So I don't know, maybe I'm being foolish for not being technical. Yeah, I wrote a certain portion of the things. |
| G. W. Bailey |
Do I enjoy features? Yeah, I really do. Would I like to do some more features before I head to the barn? Yeah, probably. But I also love television. I love doing television because it's fast, and that I like a lot. |
| Terrence J |
Oh yeah people recognize me, but the craziest thing? I mean I've had the normal autographs... but I had to sign a baby's carriage once. I thought that was weird, so yeah, I guess that's the craziest thing. |
| Eddie Campbell |
It's not the last one. Five's out, six is coming out in November, that's a single chapter, and then seven is the big horrifying one. And I think a couple after that to wrap the thing up. |
| Chris Adami |
Can life be defined? Well, how would you go about it? Well, of course, you'd go to Encyclopedia Britannica and open at L. No, of course you don't do that; you put it somewhere in Google. And then you might get something. |
| Jonathan Ive |
True simplicity is, well, you just keep on going and going until you get to the point where you go, 'Yeah, well, of course.' Where there's no rational alternative. |
| Anthony Edwards |
People relate to things that feel real to them. All the good, happy, over-sexed and moneyed endings on TV are not the way most of us feel in our lives. The success of 'E.R.,' I think, is not relying on overly sentimental stories that are solved where people's lives wrap up nicely with happy endings. |
| William Butler Yeats |
Take, if you must, this little bag of dreams, Unloose the cord, and they will wrap you round. |
| Earl Campbell |
I think one game we played the Oakland Raiders and Jack Tatum and I had an accident on the one-yard line. The only thing that Jack Tatum didn't do was wrap me up so I backed into the endzone backwards. |
| Niall Ferguson |
Ask me not, 'Are you rightwing,' but ask me 'Are you a committed believer in individual freedom, the values of the enlightenment?' Then, yeah, if being rightwing means believing Adam Smith was right, both in the 'Wealth of Nations' and the 'Theory of Moral Sentiments,' then I'm rightwing. |
|
|
|
|
i bet i could scrape the images using scrapebox with free proxies to save on costs. the only reason i used paid proxies for the data is because i want to be sure that it's US data to get US results for each product id. and theyre more reliable
This post is a comment.
|
| |
|
|
|
have more than a half million product urls (which is really the hard part with amazon, they make it extremely difficult for scrapers to crawl their entire site). after cleaning up this list and potentially trying to get even more products, i will continue to modify my php scraper, this time with use for amazon. it rotates through proxies and user agents so it has worked well in google maps, yelp,. and your university's student directories, so it should bypass amazons no problem. my scraper nowadays saves all the data into xml so i can import through certain plugins, but also have a super easy way to convert to any form i need. originally my scraper rotated through tor proxies and saved all data directly into mysql, over time i created sql files for importing and now that wordpress is used so extensively and doesnt recieve penalties in the search engine like it used to, i can just throw all the data in there and make as many copies and variations of the sites as i want. and make it loo...
This post is a comment.
|
| |
|
|
|
|
So I scraped 450k amazon product urls, and now i finally finished writing my scraper and finally kicked it off with some fresh proxies. downloading massive amounts of data and images from the big A hole
|
| |
|
|
|
Veggie Fajitas:
1. Cut some sweet potatoes into wedges and season them with a little bit of cumin, mostly paprika, some chili flakes, and salt and pepper and then put them in the oven at 425F for 28ish minutes
2. Cut up some red onion and bell pepper and fry them in a pan with salt and pepper for a bit
3. Cut up some roma tomatoes and cilantro and zest some lime to mix up in a bowl and salt and pepper it
4. Put some hot chili or jalapeno peppers in a bowl with a little sugar and a big pinch of salt and then squeeze some lime juice in there and let it sit for a bit
...
|
| |
|
|
|
|
This list of 400k product ids include lots of copies of the same product with a different tracking number. im only getting maybe 30k off that list total. was gonna scrape more after so my next run of my id gathering, ill find better ways to remove redundancy and save some money. ive used almost 30g of bandwidth through those proxies the past few days. but i also download huge high rez images too
|
| |
|
|
|
|
now that my list of product ids is in the millions and ive used about 40gb of proxy bandwidth scraping maybe 50k pages from that data, i have to carefully weigh out how much i want to spend on proxies (spent about $30) on this experiment that could result in just a simple takedown notice to stop the method. granted i can always reuse and modify this data. but i guarantee if you had a million page site based directly around real ecommerce products you would make good money if it stays up
|
| |
|
|
|
yeah man
This post is a comment.
|
| |
|
|
|
yeah like 200 almost
This post is a comment.
|
| |
|
|
|
yeah
This post is a comment.
|
| |
|
|
|
Yeah, for sure. That's awesome!
This post is a comment.
|
| |