Skip to Main Content
Chat With Us

Economics

:

Tools & Techniques

2023

Tools & Techniques

The lists below represent a very small portion of resources available to those interested in text and data mining and analysis. Although they are categorized under specific headings, many are not limited to one type of task.

The BC Library Digital Scholarship Team has more recommendations here

Analysis & Visualization

  • Data Visualizaiton Catalogue: Catalogue of resources for different types of visualizations
  • Gephi: Visualization toolkit for exploring graphs and networks (available in Digital Studio, O'Neill second floor)
  • Voyant: Suite of web-based tools for text reading, analysis, and visualization
  • In Python
  • In R

Cleaning & Processing

  • Lexos: Integrated workflow of pre-processing, analysis, and visualization tools for finding and exploring patterns in texts
  • OpenRefine: Tool for working with messy data; clean, transform, reconcile, normalize, extend data; compatible with expression languages (i.e. GREL, Jython)

Extracting & Scraping

  • Beautiful SoupPython library used for web-scraping
  • R: A language and environment for statistical computing and graphics that enables data manipulation, calculation, and graphical display (available via BC Citrix server)
  • RegEx: Usually used for "find" or "find and replace" operations

Tutorials

  • Basic Text Mining in R: Tutorial on text mining with R
  • Codecademy: Learn to code in Python for data extraction and manipulation
  • Programming Historian: Learn how to extract, clean, manipulate, and transform data; also includes lessons on topic modeling and text analysis