Collaborate
← Back to projects

Jun 1, 2020

Automatic Reddit Web Scraping and Sentiment Analysis

Pipeline for collecting Reddit content in real time and applying NLP-based sentiment modeling for domain-specific insights.

Built an automated scrape-to-database-to-model pipeline for continuous sentiment analysis.

PythonSeleniumBeautifulSoupSQLNLP

Overview

Developed an automated pipeline to ingest posts/comments and analyze sentiment around data science job discussions.

Focus

  • Real-time data capture and cleaning pipeline
  • SQL-backed storage for reusable downstream analysis
  • NLP model development for sentiment classification

GitHub: https://github.com/shamiulshifat/leisure-time-projects/tree/master/reddit%20webscrapping%20and%20NLP%20Project