Movies and TV

The Internet Movie Database (IMDb) provides these data sets:

developer.imdb.com/non-commercial-datasets/

datasets.imdbws.com/

These data sets are refreshed on a daily basis.

There are 7 data files provided by IMDb:

The "Rotten Tomatoes movies and critic reviews dataset" is likely from here:

www.kaggle.com/datasets/stefanoleone992/rotten-tomatoes-movies-and-critic-reviews-dataset

The Office dialogue likely is from here:

bradlindblad.github.io/schrute/reference/theoffice.html

github.com/bradlindblad/schrute

Kevin performed several transformation of the data.

He created comma-separated versions of the data from the IMDb tsv files:

akas.csv, crew.csv, episodes.csv, people.csv, ratings.csv, titles.csv

He also created a database file:

imdb.db

These two files are from the Rotten Tomatoes dataset:

rotten_tomatoes_movies.csv, rotten_tomatoes_reviews.csv

The dialogues from The Office are stored in:

the_office_dialogue.csv

Note that the source website mentions "55130 observations of 12 variables" but there seems to be 1 line in the csv file that stretches onto 3 lines (i.e., it has 2 extra lines). There is also the header line. Thus, the file the_office_dialogue.csv has a total of 55133 lines.

We can download the IMDb data using:

wget datasets.imdbws.com/name.basics.tsv.gz

wget datasets.imdbws.com/title.akas.tsv.gz

wget datasets.imdbws.com/title.basics.tsv.gz

wget datasets.imdbws.com/title.crew.tsv.gz

wget datasets.imdbws.com/title.episode.tsv.gz

wget datasets.imdbws.com/title.principals.tsv.gz

wget datasets.imdbws.com/title.ratings.tsv.gz