Home

Awesome

MMSoc: Multimodal Social Media Analysis

Project Overview

MMSoc is a large-scale benchmark for analyzing the performances of multimodal LLMs (MLLMs) in social media analysis.

@inproceedings{jin2024mm,
  title={MM-Soc: Benchmarking Multimodal Large Language Models in Social Media Platforms},
  author={Jin, Yiqiao and Choi, Minje and Verma, Gaurav and Wang, Jindong and Kumar, Srijan},
  booktitle={ACL},
  year={2024}
}

The 🤗 MMSoc benchmark contains the following datasets

Memotion [🤗Link]

Hateful Memes [🤗 Link]

YouTube2M [🤗 Link]

FakeNewsNet

The datasets were originally curated by Shu et al (GitHub).

Project Structure

Installation

To get started with MMSoc, follow these steps:

  1. Clone the repository:

    git clone <repository-url>
    cd MMSoc
    
  2. Create a virtual environment (optional but recommended):

    conda create -n mmsoc python=3.11
    conda activate mmsoc
    
  3. Install the required packages:

    pip install -r requirements.txt
    

License

This repository is licensed under the Apache-2.0 License.