Skip to content

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Notifications You must be signed in to change notification settings

masmaleki/Linkedin-Client

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Linkedin scraper

This service allows to fetch data about individuals or companies on Linkedin.

app screenshot

Demo

You can try out the tool on my personal server here. Remember this is only a showcase website.

Context

  • Folder src/v1 : At the very beginning, the project was a freelance mission for a client needing some leads. I used Linkedin API v1.
  • Folder src/v2 : After that I decided to design a web interface to showcase the tool, which might be useful for other people. I was limited by the Linkedin API, so I somehow completed it by scraping data with Puppeteer, a driver for an headless Google Chrome browser.
  • The Linkedin API v1 is now deprecated and the v2 is not really usable so, in this third version, there is no more use of the API and I completely skipped the use of web browser, it is a simple HTTP request and Cheerio does the job.

Installation

Want to try running it on you own ? You will need your Linkedin cookie called "li_at". This way, requests will be sent on your behalf.

git clone https://github.com/Cooya/Linkedin.git linkedin cd linkedin npm install npm run build touch config.js npm start

Complete the configuration file "config.js" as follows :

module.exports = { cookie: 'YOUR_LINKEDIN_COOKIE' };

CLI usage

If you want to scrap people details :

node src/cli.js https://www.linkedin.com/in/williamhgates/

Or if you want to scrap company information :

node src/cli.js https://www.linkedin.com/company/microsoft/

Tests

npm test

About

Web scraper for grabing data from Linkedin profiles or company pages (personal project)

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 96.5%
  • SCSS 2.7%
  • HTML 0.8%