Hi, Myself Rocktim Saikia. And today I want to showcase a simple project that I have been working on for couple of days now.
meta-fetcher 🔎
meta-fecther is simple and tiny url meta-data fetcher for Nodejs. Under the hood this module uses node-fetch to fetch the meta tags of given website url and returns the parsed meta-data as a JSON object.
rocktimsaikia / meta-fetcher
Simple metadata scrapper for node.js
meta-fetcher
Simple metadata scrapper.
Installation
yarn add meta-fetcher Usage
import metaFetcher from 'meta-fetcher'; const result = await metaFetcher('https://hoppscotch.io/'); console.log(result); Output:
{ "title": "Hoppscotch - Open source API development ecosystem", "description": "Helps you create requests faster, saving precious time on development.", "image": "https://hoppscotch.io/og.png", "url": "https://hoppscotch.io/", "siteName": "Hoppscotch", "type": "website" } API
metaFetcher(input)
Takes one url string as a parameter and returns an object containing the meta-information.
input
type: string
default: 'none'
The url string to be scrapped.
Related
page-scrapper: Node.js scrapper that pulls out all links and images of a given site.
License
2024 MIT © Rocktim Saikia
Install
npm install meta-fetcher Basic Usage
const {fetchMetaData} = require('meta-fetcher'); (async () => { const result = await fetchMetaData('https://hoppscotch.io/'); console.log(result); /* { basic_metadata: { website: 'https://hoppscotch.io/', title: 'Hoppscotch • A free, fast and beautiful API request builder', description: 'A free, fast and beautiful API request builder' }, opengraph: { 'og:image': 'https://hoppscotch.io/banner.jpg', 'og:type': 'website', 'og:title': 'Hoppscotch', 'og:site_name': 'Hoppscotch', 'og:description': 'A free, fast and beautiful API request builder', 'og:url': 'https://hoppscotch.io/' }, opengraph_social: { 'twitter:card': 'summary_large_image', 'twitter:site': '@liyasthomas', 'twitter:creator': '@liyasthomas' }, favicons: [ 'https://hoppscotch.io/icon.png', 'https://hoppscotch.io/icon.png', 'https://hoppscotch.io/_nuxt/icons/icon_64x64.9834b3.png' ] } */ })(); It can also fetch meta-data from shortened-url.
For example:
const {fetchMetaData} = require('meta-fetcher'); (async () => { const result = await fetchMetaData('https://bit.ly/2Fj9sNF'); console.log(result); })(); There a few advanced options that you can use before fetching. You can check them in the readme.md section.
If you like the project. Do leave a star at repo 🌟
Top comments (4)
Best metadata fetching tools i came across: bit.ly/3sQHiwg
I really like the idea of your website. I have noticed that you used netlify function. Would you mind sharing us what did you use to fetch metadata on your website?
Thanks for sharing. Starred. I may need it later.
Sure 😊 . Glad you liked it