1. Install
  2. Sign in
  3. Scrape!

Join 70,000 users now!

  • Works on most popular sites
  • See results in seconds
  • Automate your data extraction
  • Live customer support

Getting Started with Data Miner

Scraping Web Pages and Basic Tables:

In 10 minutes you'll understand Data Miner basics, like how to scrape simple data using public recipes and right clicking. As well as downloading and saving the data.

Watch The 3 Minute Tutorial

Or Read Through The Lessons

Lessons Approximate
1) Using Public Recipes 3 Minutes
2) Automated Page Navigation 5 Minutes
3) Right Click and Basic Tables 2 Minutes

Multi Page Scraping and Automation:

In 30 minutes you will be able to extract large collections of data and do multi-layer scraping by creating a Data Miner Job

Watch The 8 Minute Tutorial

Or Read Through The Lessons

Lessons Approximate
4) Finding The Right Recipe 5 Minutes
5) Multi Layered Scrapes with Jobs 15 Minutes
6) Advanced Job Settings 10 Minutes

Writing Custom Recipes:

Learn how to write custom recipes and use Javascript to modify the data that you scrape. With these tools you will be able to filter data, split names, click buttons and scrape any site.

Watch The 20 Minute Tutorial

Lessons Approximate
7) Containers and Xpath 10 Minutes
8) Creating your own Recipes 20 Minutes
9) Javascript Snippets 60 Minutes

Lesson 1: Using Public Recipes

Public Recipe Picture
Updated: 11/24/2016 by David
Contact Me
Key Points

  • Public Recipes are data extraction rules used to scrape website data.
  • Data Miner has over 40,000 Public Recipes.
  • Recipes are filtered for the site you are on.
  • Recipes are built by the Data Miner community.
  • Save recipes for quick access later.
Data Miner Example

To use a Public Recipe, you must first find the data you want to scrape. Data Mine can only extract data when it's visible on your browser.

Next, open up the data miner extension and find the recipe that best describes your data. Then click on it.

Once the recipe runs, click Download and save it to excel.

Practice Now

  • Navigate to: Data Miner Sandbox
  • Open: Data Miner
  • Click: $ Sandbox - Search
  • Celebrate! And Download
Or try on LinkedIn.com and use $LinkedIn - People Search!

How to find the right recipe

Some recipes are also filtered by website account type. For example, Linkedin.com has Basic, Premium, Recruiter and Sales Navigator. Each account has dedicated recipes indicated by the account name at the beginning of the recipe name.

Below are some of the suggested recipes for the different LinkedIn accounts.

Basic: Premium:
$ LinkedIn - People Search $ LinkedIn Premium - People Search
$ LinkedIn - Profile Header (email) $ LinkedIn Premium - Profile Header (email)
$ LinkedIn - Profile Education $ LinkedIn Premium - Profile Education
$ LinkedIn - Profile Experiences $ LinkedIn Premium - Profile Experiences
Recruiter: Sales Navigator:
$ LinkedIn Recruiter - Search People $ Sales Navigator - People Search
$ LinkedIn Recruiter - Profile Header (email) $ Sales Navigator - Profile Header (email)
$ LinkedIn Recruiter - Profile Education $ Sales Navigator - Profile Education
$ LinkedIn Recruiter- Profile Experiences $ Sales Navigator - Profile Experiences

Lesson 2: Automated Page Navigation

Public Recipe Picture
Updated: 11/20/2016 by Ben
Contact Me
Key Points

  • Pagination is navigating between multiple pages.
  • Data Minder can automate pagination for you.
  • The pagination button is in the data miner window in the left panel.
  • You can change the speed for slower internet connections.
pagination example

Multiple page results is very common for search pages. Data Miner can automatically click and scrape multiple pages by finding the next page button and clicking it.

pagination example

To start auto pagination, select a search recipe for a site that has multiple pages. Then in the left hand panel, click Start Pagination and watch the rows accumulate.

pagination example

Once you've accumulated enough rows, simply press Stop Pagination.

Practice Now

  • Repeat Lesson 1: Data Miner Sandbox
  • Click: Start Pagination
  • Accumulate Rows!
  • Click: Stop Pagination
Or try LinkedIn.com again!

Lesson 3: Right Click and Basic Tables

Public Recipe Picture
Updated: 11/24/2016 by David
Contact Me
Key Points

  • Works on simple tables.
  • Quickly scrapes by highlighting and right clicking.
  • First step to writing your own recipe

For basic tables, you won't even need to select a recipe. Data Miner is capable of analysing basic tables and extracting data automatically with right clicking.

Once the table has been analyzed and scraped, download the data and click save to use later.

Practice Now

    On the table below:

  • Using your mouse: highlight a row.
  • Right-click: the row.
  • Select: Data Miner - Get Similar.
  • Click: download to save the file.
Fruits Qty Price
Banana 12 $4.60
Apples 3 $1.10
Orange 8 $7.00
Kiwi 3 $4.50