Amazon scraping - ecommerce - price comparison

Technique Used By Popular Price Comparison Websites To Grab Data


Price comparison sites redefined the way people buy online. A price comparison sites compares prices from different e-commerce sites and recommends you the best deal. This encouraged a lot of startups to come into the market and many of them made it big. Even though a bit crowded, e-commerce still is a market growing at a reasonably high rate.

For operations, price comparison engines need product data. How do they get it?

There are primarily three ways of getting Data for a price comparison engine.

Feeds from merchants: Price comparison sites establish business relationship with the companies or sites they send traffic to. Once an agreement is there, they can get data directly from merchant feeds. Merchants set up either an API or use ftp to directly deliver data. One of the common ways of monetising a price comparison sites is by getting a referral commission.

Product feeds from third party API: There are some services who provide e-commerce data via an API. In this case, third-party services charge for the volume of data derived.

Web scraping: Web scraping is one of the reliable and efficient ways of getting product data from target sites. In most cases, options one and two might not be available. If you are using an open source technology, you can cut down costs and save yourself from proprietary technology deadlock.

Thanks for reading this blog post. Datahut offers affordable data extraction services (DaaS) . If you need help with your web scraping projects let us know and we will be glad to help.

Tony Paul
I'm the Co-founder of Datahut. I've been helping companies solving their data extraction problems for the last six years. I'm a chess lover and an ardent fan of the lean startup. I write about Web Scraping, Online retail, Sales, Marketing Tips etc
You may also like
How Dynamic Pricing Can Boost Your Online Retail Profits
How Dynamic Pricing Can Boost Your Online Retail Profits
Amazon Data Scraper
Amazon scraping
Tutorial: How To Scrape Amazon Using Python Scrapy