Authors: Sheng ZhaoXia, Yinan Zhang, Yu-Ting Huang, Zhantao Deng

Report: How to Invest in Movies

This project is based on Python and we use Spyder as our python programming environment. We also provide .ipynb files for Jupyter notebook. These softwares can be installed together with Anaconda. In addition, We install all packages through the Anaconda Prompt. These packages have been tested in Window 10 Home and macOS Mojave, but it should be easy to implement in other platforms.

This project is based on anaconda and jupiter notebook. Download and install instructions can be found at: https://www.anaconda.com/download/. After installing Anaconda, pip and conda can be used to install Python packages. Spyder will also be installed together with

We use the scientific computing and visualization functionalities of scipy, especially the numpy, pandas and matplotlib package. These packages can be installed by typing the following command in your Anaconda Prompt.

python -m pip install --user numpy scipy matplotlib ipython jupyter pandas sympy nose

We use networkx to visualize signals and graph structure. The package can be installed by typing the following command in your Anaconda Prompt.

pip install networkx

We use NLTK to analyze the keywords of each movie. The package can be installed by typing the following command in your Anaconda Prompt.

pip install -U nltk

In this project we have figured out:

• What factors are important for the ROI (Return on Investment) of a specific genre?
• How to predict the ROI of a new movie with some prior features, e.g. budget and production companies ?

We use the dataset on Kaggle. It contains two csv files:

• tmdb_5000_credits.csv (~ 38.1MB):

The dataset contains the cast and crew data of 4803 movies. The cast feature mainly depicts what actors appear in the movie and what characters they star. So as the crew data, which descibles the names and jobs of specific crews.

• tmdb_5000_movies.csv (~ 5.43MB):

The dataset contains 4803 movies data with 20 distinct features. The important features that we are interested: budget, genres ,keywords, title, popularity, production_companies, revenue, vote_average.

• Lib_gradientdecent.py: contains gradient decent algorithms of ridge regression and lasso regression.
• Lib_graph.py: contains functions of constructing all subgraphs.
• Lib_keywords.py: contains fuctions grouping keywords by word roots and synonym and training a word2vec model.
• Lib_prediction.py: contains functions to predict return of investment according movie network.
• Lib_vis.py: contains all kinds of visualization functions.

• Lib_actor_network.ipynb: explores actor data. Construct actor social network and visualized it via networkx package.
• Project_IMDb.py: a Python interface. A pipeline to run whole codes of our project from data exploration, feature preprocessing to subgraphs construction, ML model training and prediction.
• Project_IMDb.jpynb: a Jupyter notebook interface to run our project. It shares almost the same codes with Project_IMDb.py.
• Testing.py: a Python interface for those who want to predict ROI of a new moive using pre-trained model.

Sheng ZhaoXia:

• Actor/ress social network analysis
• Genre and keyword subgraphs
• Reports

Yinan Zhang:

• NLTK based keywords analysis and processing
• Actor/ress and director subgraphs
• Reports

Yuting Huang:

• Budget and popularity subgraphs
• ROI (Return on Investment) signal
• Gradient decent and report

Zhantao Deng:

• Ridge regression, LASSO and their gradient decent
• Average vote and production companies subgraphs
• Report