HuMob Challenge 2026

A benchmark challenge for predicting how human mobility recovered after the 2024 Noto Peninsula Earthquake using origin-destination matrix prediction.

The Challenge Dataset Download Data Important Dates

Welcome to the Human Mobility Prediction Challenge 2026

The Human Mobility Prediction Challenge, also known as the HuMob Challenge, is a competition aimed at testing state-of-the-art computational models for predicting human mobility patterns. It follows the success of HuMob Challenge 2023 (Hamburg), HuMob Challenge 2024 (Atlanta), and GISCUP 2025 (Minnesota).

Understanding, modeling, and predicting human mobility in urban and regional areas is an essential task for many domains and applications, including transportation modeling, disaster risk management, emergency response, urban planning, and regional recovery analysis.

Recent advances in large-scale mobility data and computational modeling have enabled researchers to develop increasingly complex human mobility models. However, mobility prediction methods are often trained and tested on different datasets, making it difficult to compare model performance fairly. The HuMob Challenge provides a shared benchmark task and dataset to support reproducible evaluation of human mobility models.

Data now available: The HuMob Challenge 2026 dataset is available on Zenodo.

The Challenge: Recovery-period OD Matrix Prediction

The 2026 challenge focuses on human mobility recovery after the 2024 Noto Peninsula Earthquake in Ishikawa Prefecture, Japan. Participants will estimate how and to what extent human mobility recovered during the post-disaster recovery period.

The task is to predict origin-destination matrices during the test period using the provided training-period OD matrices and publicly accessible contextual information, such as news articles, public reports, and official recovery-related information.

Prediction target

Daily origin-destination matrices representing mobility flows between spatial grid cells in the Noto / Ishikawa study area.

Study area

The study area covers the Noto region in Ishikawa Prefecture, Japan, defined by the challenge bounding box.

Spatial resolution

The region is approximately divided into 2,000-meter grid cells.

Temporal resolution

The main challenge dataset is aggregated at the daily level.

2024 Noto Peninsula Earthquake

The challenge is motivated by the severe disruption and long recovery process following the 2024 Noto Peninsula Earthquake. The images below provide visual context for the disaster-affected region and the recovery challenges that shaped post-disaster mobility patterns.

Damage after the 2024 Noto Peninsula Earthquake
Earthquake damage in the Noto Peninsula
Damage after the 2024 Noto Peninsula Earthquake
Damage after the 2024 Noto Peninsula Earthquake
Damage after the 2024 Noto Peninsula Earthquake
Damage after the 2024 Noto Peninsula Earthquake

Photos by Kazuto Ataka.

Dataset

The HuMob Challenge 2026 dataset contains aggregated origin-destination mobility flows for the Noto / Ishikawa study area. The dataset is available on Zenodo.

Download: HuMob Challenge 2026 dataset on Zenodo

Dataset File

Item Description
Filename humob2026-dataset.tsv
Format TSV with two columns: date in YYYYMMDD format and a Python dictionary storing the OD matrix.
Rows One row per day. The file contains 306 days from November 1, 2023 to January 31, 2024 and from April 1, 2024 to October 31, 2024.
OD matrix structure {origin_grid: {dest_grid: count, ...}, ...}

Spatial Grid

Item Value
Grid ID format "y_x", where each grid unit is approximately 2 km.
x range 1 to 100
y range 1 to 70
Longitude range 136.029 to 138.042, where x=1 corresponds to 136.029 and x=100 corresponds to 138.042.
Latitude range 36.203 to 37.646, where y=1 corresponds to 36.203 and y=70 corresponds to 37.646.
Out of bound grid IDs "-1_-1"

Training and Test Periods

Split Period
Training period November 1, 2023 to January 31, 2024, and April 1, 2024 to October 31, 2024
Test period February 1, 2024 to March 31, 2024
Excluded test dates Due to data quality reasons, participants do not need to predict values for 20240202 and 20240305.

Missing / NA Days

Due to data quality reasons, the following 16 dates were removed and replaced with NA:

20231126, 20231130, 20231201, 20231203, 20231204, 20231205, 20231214, 20240118, 20240123, 20240124, 20240202, 20240305, 20240408, 20240426, 20240529, 20240708.

Privacy and Normalization

The dataset is anonymized using k-anonymity to protect privacy. The k value cannot be disclosed for privacy reasons. The data is also normalized by a constant number for business reasons.

Rules

Participants may use the provided training data and publicly accessible external information to predict mobility flows during the test period.

Allowed external information

Publicly accessible information, such as news articles, public archives, government reports, and open web resources, may be used.

Not allowed

Other mobility datasets may not be used. Private, internal, proprietary, or non-public datasets are also not allowed.

Transparency

Participants should document the public information sources used in their approach.

Reference Information

The organizing team will provide a list of suggested public references. Participants may also use other publicly available sources, as long as they comply with the challenge rules.

Evaluation

Submissions will be evaluated by comparing predicted and observed origin-destination matrices during the test period. The evaluation will be conducted within the evaluation boundary, defined by grid longitude range x=30 to x=70 and grid latitude range y=35 to y=70.

Primary evaluation metric: Combined NRMSE

The primary evaluation metric is the Combined Normalized Root Mean Squared Error (Combined NRMSE). The mobility data consist of daily origin-destination (OD) flows on a 2 km grid. OD pairs are evaluated separately as:

Because diagonal flows are approximately ten times larger than off-diagonal flows on average, their raw errors are not directly comparable. The metric therefore normalizes the two components before combining them.

Computation

  1. Daily RMSE: For each day in the evaluation period, the root mean squared error is calculated separately across all diagonal and off-diagonal OD pairs:
    RMSE_diag(d) = sqrt(mean((prediction - observation)²) over diagonal pairs)
    
    RMSE_offdiag(d) = sqrt(mean((prediction - observation)²) over off-diagonal pairs)
  2. Mean RMSE: The daily RMSE values for each component are averaged across all valid evaluation days:
    RMSE_diag = mean(RMSE_diag(d) over days)
    
    RMSE_offdiag = mean(RMSE_offdiag(d) over days)
  3. Normalization: Each mean RMSE is divided by the mean of all positive observed values for that component across the full evaluation period:
    NRMSE_diag = RMSE_diag / mean_actual_diag
    
    NRMSE_offdiag = RMSE_offdiag / mean_actual_offdiag

    Here, we set mean_actual_diag = 207.6 and mean_actual_offdiag = 19.7.

  4. Combined NRMSE: The final score is the simple average of the two normalized components:
    Combined NRMSE = (NRMSE_diag + NRMSE_offdiag) / 2

Rationale

Normalization ensures that errors in diagonal and off-diagonal flows contribute equally to the final score despite their substantial difference in magnitude. Without normalization, the larger diagonal flows would dominate the evaluation. The mean observed value, rather than the median, is used as the normalization factor because the diagonal-flow distribution is strongly right-skewed; median-based normalization would disproportionately inflate the diagonal NRMSE. Lower Combined NRMSE values indicate better predictive performance.

Baseline Models

Baseline results will be provided for comparison. Planned baselines include:

Workshop @ ACM SIGSPATIAL

Top performers will be invited to present their work at the HuMob Challenge Workshop @ SIGSPATIAL 2026 held in Riverside, CA, on November 3rd, 2026, and their contributions will be accepted in the Workshop Proceedings.

Important Dates

Milestone Date
Website launch June 2026
Dataset release June 15, 2026
Submission deadline September 20, 2026
Notification of top teams September 30, 2026
Workshop / presentation @ SIGSPATIAL 2026 November 3, 2026

Submission

Participants should submit predicted OD matrices for all grid cell pairs during the test period, February 1, 2024 to March 31, 2024, excluding 20240202 and 20240305.

Predictions should be submitted in the same format as the dataset: one row per day, with a date in YYYYMMDD format and a nested Python dictionary of OD flows, {origin_grid: {dest_grid: count, ...}, ...}.

Organizers

Takahiro Yabe, New York University
Kota Tsubouchi, LY Corporation
Toru Shimizu, LY Corporation

New York University logo LY Corporation logo

Contact

Please contact Taka at takahiroyabe@nyu.edu for any questions.