Skip to content
Nat Lee

Keyboard shortcuts

Turn these off if they get in the way of a screen reader or voice control. The setting is saved in this browser.

1
Home
2
Projects
3
About
4
Experience
/
Search projects
?
Show this panel

Data Collection

MyAnimeList Review Crawler

From anime reviews to a resumable dataset

Collect anime details and reviews through a Jikan-style API or permitted MAL pages, save progress in SQLite and export the dataset as CSV.

Source44 stars on GitHub(opens in a new tab)
Role
Creator & Maintainer
Period
2018 – 2026.11
Status
Completed
Theme
AI, vision & medical imaging
MyAnimeList Review Crawler, screenshot 1

Overview

A Scrapy-based crawler with interchangeable JSON-API and HTML inputs, using the same SQLite tables and CSV output. Sequential requests, retry delays and resume support make long-running collection traceable. The HTML mode follows robots.txt restrictions.

Features

  • JSON API and HTML inputs
  • SQLite progress storage and resumable runs
  • CSV output matching the MyAnimeList comment dataset
  • Sequential requests, backoff and robots.txt handling
  • AI, vision & medical imaging33 stars on GitHub

    QWOP with PPO

    A PyTorch PPO agent plays the real QWOP browser game through Playwright. Six evaluation races, six 100 m finishes. Grace was not part of the reward function.

    2019Completed
  • AI, vision & medical imaging4040 stars on GitHub

    Brain MRI Pipeline

    An end-to-end Nipype pipeline with FSL FAST, K-means and ANTs Atropos segmentation, tissue volumes, bias-correction metrics and an interactive 3D brain.

    2018Completed
  • AI, vision & medical imaging11 stars on GitHub

    Street Scene OCR

    Compare EasyOCR, RapidOCR and PaddleOCR on Traditional Chinese street signs, with text boxes, timings and a small public-domain benchmark.

    2026Completed