Skip to content

Tabular Data Viewer πŸ€„ VSCode extension for viewing very large local and remote CSV and TSV data files with Tabulator Table, Perspective Datagrid and D3FC Chart Views πŸ“ŠπŸ“ˆ

License

Notifications You must be signed in to change notification settings

RandomFractals/tabular-data-viewer

Repository files navigation

tabular-data-viewer

Apache-2.0 License Version Installs Downloads https://ko-fi.com/dataPixy


Tabular Data Viewer δΈ­ for Visual Studio Code

See Data Preview 🈸 vscode extension for advanced Data Grid Viewer with support of many common data formats and Save options for smaller datasets.

Tabular Data Viewer δΈ­

Tabular Data Viewer provides fast DSV data loading and custom Table Views πŸ€„ for very large (1-8 GB) local and remote .csv, .tsv and .tab data files with table, View, D3FC Chart Views πŸ“ŠπŸ“ˆ, Papa Parse CSV parser, NodeJS File Streams and Worker threads:

Tabular Data View δΈ­

Features

  • View large CSV and TSV data files in a custom Tabulator Table or Perspective Data View πŸ€„
  • Open local or remote Data File Table View πŸ€„ via quick Data File URL input prompt
  • Load large datasets with millions of rows and over 1GB of tabular data using Papa Parse CSV parser in a worker thread with data streaming and incremental loading into Table View πŸ€„
  • View data loading progress, local data file size, colulmns, rows and load time stats display in vscode status bar
  • Sort displayed table data by multiple columns
  • Resize and rearrange table columns
  • Auto-save table columns layout, sort order, and Perspective View configs
  • Restore customized Table View πŸ€„ configuration on vscode reload
  • Copy displayed table data to Clipboard in tab delimited format from Tabulator Table View or in CSV format from Perspective View
  • Save displayed table data in CSV (, or ; delimited), TSV, HTML table, or JSON data array format from Tabulator Table View
  • Save displayed data in Apache Arrow β‹™ data format from Perspective View
  • Generate and view Frictionless Table *.schema.json configration file created with tableschema-js.infer()
  • Load saved table configuration options from auto-generated *.table.json config file when reopening previously customized Table View πŸ€„
  • Set default Data Page Size to 1K, 10K, or 100K (default) rows per page to speed up large datasets parsing and loading into Table View πŸ€„

Data Perspective View δΈ­

Limitations

Large CSV data files streaming and display is very alpha and has the following limitations for now:

  • Large datasets are paged and loaded into view for display with default page size set to 100K rows per page
  • Columns sort only works for the paged data loaded and displayed in Table View πŸ€„ and doesn't sort data for the whole dataset
  • Save data is also limited to max 100k rows for the currently displayed tabular data in Table View πŸ€„

Tabular Data View δΈ­ Large Dataset

Contributions

Tabular Data Viewer δΈ­ Settings, Commands, Languages, Custom Editors and Activation Events contributed to VSCode IDE:

Tabular Data Viewer δΈ­ Feature Contributions

Settings

Create User or Workspace Settings in vscode to change Tabular Data Viewer δΈ­ extension Settings:

Setting Type Default Value Description
tabular.data.createTableSchemaConfig boolean true Create table *.schema.json configuration file alongside data file when parsing CSV data.
tabular.data.createTableViewConfig boolean true Create *.table.json configuration file alongside data file for saving and restoring customized Table View πŸ€„ columns, sort settings, Perspective View and D3FC Charts πŸ“ŠπŸ“ˆ config options.
tabular.data.pageSize integer 100000 Default Data Page Size to use for incremental loading and display of large datasets.
tabular.data.parser.dynamicTyping boolean true Enable type conversions for numeric and boolean data fields when parsing CSV data. Set this option to false to speed up large datasets parsing and loading.
tabular.data.ui.theme string light Default data view UI theme to use for tabular data display. Current options include light and dark UI themes for Tabulator and Perspective data views.
tabular.data.view string Tabulator Default Tabular Data View type to use for displaying data. Current options include Tabulator and Perspective.

You can view Tabular Data Viewer δΈ­ Configuration Settings via standard vscode Preferences -> Settings -> Extensions -> Tabular Data Viewer Settings view or use custom Tabular Data: View Settings command from View -> Command Palette... menu prompt by typing Tabular in it. Hit Reload β†Ί button in open Table View πŸ€„ after you toggle Tabular Data Settings to activate your configuration changes for an open table view.

Note: tabular.data.view type default and tabular.data.ui.theme setting changes might require you to close and reopen currently open Tabular Data Views for those settings to take effect.

Tabular Data Viewer δΈ­ Configuration Settings

Observable JS Notebook

You can try Tabular Data Viewer πŸ€„ Observable Notebook πŸ““ with public datasets and supported data formats in a browser:

Tabular Data Viewer δΈ­ Observable Notebook πŸ““

Recommended Extensions

Recommended custom dataViz extensions produced by Random Fractals Inc. and other 3rd party vscode extension authors for working with data 🈸 charts πŸ“ˆ geo πŸ—ΊοΈ data formats and Interactive Notebooks πŸ“š in VSCode:

Extension Description
Rainbow CSV 🌈 Highlight CSV and TSV files, Run SQL-like queries
Data Preview 🈸 Data Preview 🈸 extension for importing πŸ“€ viewing πŸ”Ž slicing πŸ”ͺ dicing 🎲 charting πŸ“Š & exporting πŸ“₯ large JSON array/config, YAML, Apache Arrow, Avro & Excel data files
Geo Data Viewer πŸ—ΊοΈ kepler.gl Geo Data Analytics tool to gen. some snazzy πŸ—ΊοΈs w/0 Py 🐍 pyWidgets βš™οΈ pandas 🐼 or react βš›οΈ
Vega Viewer πŸ“ˆ Provides Interactive Preview of Vega & Vega-Lite maps πŸ—ΊοΈ & graphs πŸ“ˆ
Observable JS Observable JS compiler with Observable js and md code outline and previews.
JS Notebook πŸ““ Inspector πŸ•΅οΈ Provides Interactive Preview of Observable JS Notebooks πŸ“š, Notebook πŸ““ nodes βŽ‡ & cells βŒ— source code
Data Table 🈸 Data Table 🈸 renderer for Notebook πŸ““ cell βŒ— data outputs
Leaflet Map 🌿 πŸ—ΊοΈ Leaflet Map πŸ—ΊοΈ for Notebook πŸ““ cell βŒ— data outputs

Dev Log

See #TabularDataViewer πŸ€„ tag on Twitter for the latest and greatest updates on this vscode extension and what's in store next.

Dev Build

$ git clone https://github.com/RandomFractals/tabular-data-viewer $ cd tabular-data-viewer $ npm install $ npm run compile $ code .

Press F5 to launch Tabular Data Viewer πŸ€„ extension debug session, or run the following command to generate tabular-data-viewer-x.x.x.vsix package with vsce from our latest for local dev install from .vsix in vscode.

tabular-data-viewer>vsce package

Contributing

Any and all test, code or feedback contributions are welcome. Open an issue or submit a pull request to make this Tabular Data Viewer πŸ€„ extension work better for all.

Backers

support me on ko-fi.com

About

Tabular Data Viewer πŸ€„ VSCode extension for viewing very large local and remote CSV and TSV data files with Tabulator Table, Perspective Datagrid and D3FC Chart Views πŸ“ŠπŸ“ˆ

Topics

Resources

License

Stars

Watchers

Forks

Sponsor this project

  •  

Packages

No packages published