Menu

Kelly Schroeder

IARPA Functional Map of the World (fMoW)

The IARPA Functional Map of the World (fMoW) Challenge

The IARPA Functional Map of the World (fMoW) Challenge

Intelligence analysts, policy makers, and first responders around the world rely on geospatial land use data to inform crucial decisions about global defense and humanitarian activities. Historically, analysts have manually identified and classified geospatial information by comparing and analyzing satellite images, but that process is time consuming and insufficient to support disaster response. The fMoW Challenge sought to foster breakthroughs in the automated analysis of overhead imagery by harnessing the collective power of the global data science and machine learning communities; empowering stakeholders to bolster their capabilities through computer vision automation. The challenge published one of the largest publicly available satellite-image datasets to date, with more than one million points of interest from around the world. The dataset also contains other elements such as temporal views, multispectral imagery, and satellite-specific metadata that researchers can exploit to build novel algorithms capable of classifying facility, building, and land use.

SpaceNet is hosting the fMoW dataset in the spacenet repository to ensure easy access to the data.

Related Websites

For more information about the IARPA competition, please visit the fMoW Challenge website.

Additional information about obtaining the data, baseline algorithm, or visualization tools can be found on the fMoW GitHub website.

Reference Requirement

Please reference the following when publishing results using this data:

  1. G. Christie, N. Fendley, J. Wilson, and R. Mukherjee. Functional Map of the World. In CVPR, 2018.

BibTeX:

@inproceedings{fmow2018,
  title={Functional Map of the World},
  author={Christie, Gordon and Fendley, Neil and Wilson, James and Mukherjee, Ryan},
  booktitle={CVPR},
  year={2018}
}

Alternatively, this dataset may be referenced as, “IARPA’s Functional Map of the World Dataset.”

Please also cite SpaceNet as follows:

SpaceNet on Amazon Web Services (AWS). “Datasets.” The SpaceNet Catalog.  Last modified January 4, 2018.
Accessed on [Insert Date]. https://spacenetchallenge.github.io/datasets/datasetHomePage.html.

Catalog

aws s3 ls s3://spacenet-dataset/Hosted-Datasets/fmow/fmow-full
aws s3 ls s3://spacenet-dataset/Hosted-Datasets/fmow/fmow-rgb

Software Code with regard to this dataset:

Available solutions from contest winners:

Published Papers

Published results:

  1. R. Minetto, M.P. Segundo, and S. Sarkar. Hydra: an Ensemble of Convolutional Neural Networks for Geospatial Land Classification. In arXiv preprint arXiv:1802.03518, 2018.
  2. G. Christie, N. Fendley, J. Wilson, and R. Mukherjee. Functional Map of the World. In CVPR, 2018. In arXiv preprint arXiv: 1711.07846 2017
  3. M. Pritt, G. Chern. Satellite Image Classification with Deep Learning, 46th Annual IEEE Applied Imagery Pattern Recognition Workshop, Washington, D.C.

Dependencies

The AWS Command Line Interface (CLI) must be installed with an active AWS account. Configure the AWS CLI using ‘aws configure’

License

fMoW License

IARPA Multi-View Stereo 3D Mapping

The IARPA Multi-View Stereo 3D

IARPA Multi-View Stereo 3D Mapping Challenge

The availability of public multiple view stereo (MVS) benchmark datasets has been instrumental in enabling research to advance the state of the art in the field and to apply and customize methods to real-world problems. In this work, we provide a public benchmark data set for multiple view stereo applied to 3D outdoor scene mapping using commercial satellite imagery.

This data set includes DigitalGlobe WorldView-3 panchromatic and multispectral images of a 100 square kilometer area near San Fernando, Argentina. We also provide 20cm airborne lidar ground truth data for a 20 square kilometer subset of this area and performance analysis software to assess accuracy and completeness metrics. Commercial satellite imagery is provided courtesy of DigitalGlobe, and ground truth lidar is provided courtesy of IARPA.

This data supported the IARPA Multi-View Stereo 3D Mapping Challenge and is now made publicly available with no restrictions to support continued research. JHU/APL does not plan to maintain an online benchmark leaderboard, but we welcome your feedback and would love to hear about what you’re doing with the data and include your published results on this page.

SpaceNet is hosting the Multi-View Stereo 3D Mapping dataset in the spacenet repository to ensure easy access to the data.

Competition Websites

For more information about the IARPA Competition, Please visit the Multi-View Stereo 3D Mapping Challenge Website

For more information about the MVS benchmark please visit the JHUAPL competition webpage

Catalog

aws s3 ls s3://spacenet-dataset/Hosted-Datasets/mvs_dataset 

The catalog contains the following packages:

  • Updated metric analysis software with examples from contest winners
  • Challenge data package with instructions, cropped TIFF images, ground truth, image cropping software, and metric scoring software (1.2 GB)
  • JHU/APL example MVS solution (451 MB)
  • NITF panchromatic, multispectral, and short-wave infrared DigitalGlobe WorldView-3 satellite images (72.1 GB)
  • LAZ lidar point clouds with SBET (2.2 GB)
  • Spectral image calibration software (84 MB)

Software Code with regard to this dataset:

Available solutions from contest winners:

Published Papers

Published results:

  1. G. Facciolo, C. de Franchis, E. Meinhardt-Llopis, “Automatic 3D Reconstruction from Multi-Date Satellite Images,” IEEE International Conference on Computer Vision and Pattern Recognition, EARTHVISION Workshop, 2017.
  2. R. Qin, “Automated 3D recovery from very high resolution multi-view images,” ASPRS 2017 Annual Conference, 2017.

Dependencies

The AWS Command Line Interface (CLI) must be installed with an active AWS account. Configure the AWS CLI using ‘aws configure’

Khartoum

Datasets // Khartoum

SpaceNet AOI 5 – Khartoum

Catalog ID: 104001000A6A1E00
Image Time: 2015-04-13T08:18:08Z

Download Instructions

To view the contents of the dataset

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_5_Khartoum_geojson_roads_speed.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_5_Khartoum.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_5_Khartoum .

SpaceNet Simple Storage Service (S3) Directory Structure (AOI 5)

AOIs
└── AOI_5_Khartoum
    ├── MS             # Raw source geotiffs of 8-Band Multi-Spectral raster data from WorldView-3
    ├── PS-MS          # Raw source geotiffs and COGs of 8-Band Multi-Spectral raster data pansharpened to 0.3m
    ├── PAN            # Raw source geotiffs of Panchromatic raster data from Worldview-3
    ├── PS-RGB         # Raw source geotiffs of RGB raster data from Worldview-3 pansharpened to 0.3m
    ├── metadata       # Collect metadata in .XML format
    └── misc	       # SpaceNet 2 challenge tarballs

 

Khartoum // Roads Dataset Resources

AOI 5 – Khartoum – Road Network Extraction Training

To download processed 400mx400m tiles of AOI 5 (25 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_5_Khartoum.tar.gz . 

AOI 5 – Khartoum – Road Network Extraction Testing

To download processed 400mx400m tiles of AOI 5 (8.1 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_test_public_AOI_5_Khartoum.tar.gz . 

Khartoum // Buildings Dataset Resources

AOI 5 – Khartoum – Building Extraction Training

To download processed 200mx200m tiles of AOI 5 (4.7 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_5_Khartoum.tar.gz . 

AOI 5 – Khartoum – Building Extraction Testing

To download processed 200mx200m tiles of AOI 5 (1.6 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/AOI_5_Khartoum_test_public.tar.gz . 

Shanghai

Datasets // Shanghai

SpaceNet AOI 4 – Shanghai

Catalog ID: 104001000C924900
Image Time: 2015-06-06T02:35:27Z

Download Instructions

To download the contents of the challenge dataset

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_4_Shanghai_geojson_roads_speed.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_4_Shanghai.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_4_Shanghai.tar.gz .

SpaceNet Simple Storage Service (S3) Directory Structure (AOI 4)

AOIs
└── AOI_4_Shanghai
    ├── MS             # Raw source geotiffs of 8-Band Multi-Spectral raster data from WorldView-3
    ├── PS-MS          # Raw source geotiffs and COGs of 8-Band Multi-Spectral raster data pansharpened to 0.3m
    ├── PAN            # Raw source geotiffs of Panchromatic raster data from Worldview-3
    ├── PS-RGB         # Raw source geotiffs of RGB raster data from Worldview-3 pansharpened to 0.3m
    ├── metadata       # Collect metadata in .XML format
    └── misc	       # SpaceNet 2 challenge tarballs

 

Shanghai // Roads Dataset Resources

AOI 4 – Shanghai – Road Network Extraction Training

To download processed 400mx400m tiles of AOI 4 (25 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_4_Shanghai.tar.gz . 

AOI 4 – Shanghai – Road Network Extraction Testing

To download processed 400mx400m tiles of AOI 4 (8.1 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_test_public_AOI_4_Shanghai.tar.gz . 

Shanghai // Buildings Dataset Resources

AOI 4 – Shanghai –  Building Extraction Training

To download processed 200mx200m tiles of AOI 4 (23.4 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_4_Shanghai.tar.gz . 

AOI 4 – Shanghai – Building Extraction Testing

To download processed 200mx200m tiles of AOI 4 (7.7 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/AOI_4_Shanghai_test_public.tar.gz . 

Paris

Datasets // Paris

SpaceNet AOI 3 – Paris

Catalog ID: 1040010018805C00
Image Time: 2016-02-29T11:19:13Z

Download Instructions

To view the contents of the dataset

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_3_Paris_geojson_roads_speed.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_3_Paris.tar.gz . aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_3_Paris.tar.gz .

SpaceNet Simple Storage Service (S3) Directory Structure (AOI 3)

AOIs
└── AOI_3_Paris
    ├── MS/             # Raw source geotiffs of 8-Band Multi-Spectral raster data from WorldView-3
    ├── PS-MS/          # Raw source geotiffs and COGs of 8-Band Multi-Spectral raster data pansharpened to 0.3m
    ├── PAN/            # Raw source geotiffs of Panchromatic raster data from Worldview-3
    ├── PS-RGB/         # Raw source geotiffs of RGB raster data from Worldview-3 pansharpened to 0.3m
    ├── metadata/       # Collect metadata in .XML format
    └── misc/		# SpaceNet 2 challenge tarballs

 

Paris // Roads Dataset Resources

AOI 3 – Paris – Road Network Extraction Training

To download processed 400mx400m tiles of AOI 3 (5.6 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_train_AOI_3_Paris.tar.gz . 

AOI 3 – Paris – Road Network Extraction Testing

To download processed 400mx400m tiles of AOI 3 (1.9 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN3_roads/tarballs/SN3_roads_test_public_AOI_3_Paris.tar.gz . 

Paris // Buildings Dataset Resources

AOI 3 – Paris – Building Extraction Training

To download processed 200mx200m tiles of AOI 3 (5.3 GB) with associated building footprints for training do the following:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/SN2_buildings_train_AOI_3_Paris.tar.gz . 

AOI 3 – Paris – Building Extraction Testing

To download processed 200mx200m tiles of AOI 3 (1.8 GB) for testing do:

aws s3 cp s3://spacenet-dataset/spacenet/SN2_buildings/tarballs/AOI_3_Paris_test_public.tar.gz .