The core of the Mapflow are the Mapping Models. Mapflow enables to detect and extract features in satellite and aerial images powered by semantic segmentation and other deep learning techniques. See requirements page to better understand what data to use with each model, and price list for breakdown of the processings billing.

Note

For the data requirements – see Model requirements. For the breakdown of the Mapflow processings billing – see Mapflow pricing.

AI-Mapping Models

🏠 Buildings

Extracting of rooftops of buildings from imagery of high resolution. High performance deep learning model is trained to detect the buildings roofs.

Note: The building predictions with area less than 20 sq.m. are removed to avoid clutter

The model does not extract the footprints directly, because they are not clearly visible in the images, but it can obtain them, just like human cartographers, by moving the roof to the bottom of the wall (see Additional options).

Additional options:

  • Classification by types of buildings – typology of buildings is represented by the main classes (see reference).

  • Regularization - the algorithm corrects the irregularities of the contours of our model. The irregular geometries are replaced with rectangles, circles or arbitary polygons with 90 degree angles, which fits better to the original shape. This option produces much more map-friendly shapes which look better, but some original mask accuracy can be lost.

  • Simplification - simplifies the building shape, staying close to the original mask, adjusted for curve and complex shapes. More approximated shapes, but less right angles.

  • Merge with OSM - some of the areas have great coverage of OpenStreetMap data, and if you prefer human-annotated data, you can select this option.In this case, we check for each building whether it has a good corresponding object in OSM (Jaccard index) and if there is one, we replace our result with OSM polygon. This makes the result not based on the image, so the buildings can be shifted from actual positions. Also the corrected buildings are rotated to align with the nearest roads downloaded from OSM.

  • Height Estimation (beta) – feature leverages a dedicated regression-based model that infers height using visual indicators such as shadow length and visible wall segments. The result is what is termed 3D building footprints where the building’s countour is projected to ground level instead of the roof outline. This is especially useful for oblique imagery, where roofs often appear shifted.

A sample of processing result with different options for Prague, Czech Republic.

Processing result of buildings model

Result without postprocessing: irregular building shapes, but best fit to the actual rooftop contour seen in the image.

Processing result of buildings model

Result with simplification: most of the buildings become rectangular.

Processing result of buildings model

Result merged with OSM: some of the buildings imported from OSM have more accurate shape, but may be shifted from the image position.

Processing result of buildings model with height estimation in Mapflow Web

Processing result of buildings model with height estimation in Mapflow Web

Benchmarks - segmentation

Houston, U.S. (-95.2920, 29.7718)

– View on the Map

Model version

Model type

Zoom level

F1 (AOI)

Urban-pattern

🏠 Buildings v.8a

Instance segmentation

zoom 18

objectwise 0.72

low-rise – urban mixed

Processing result of construction model

Kolomna, Russia (38.7657, 55.0928)

– View on the Map

Model version

Model type

Zoom level

F1 (AOI)

Urban-pattern

🏠 Buildings v.8a

Instance segmentation

zoom 18

objectwise 0.75

urban mixed - regular

Processing result of construction model

🌲 Forest and trees

The model is trained on high-resolution data (0.6-0.3m) for different areas and climate zones.

The result includes all areas covered with tree and shrub vegetation, including sparse forest and shrublands.

Model resolution allows to detect small group of trees and narrow tree lines.

The model is robust to region change, and performs well in most environments, including urban. The image should be taken in active vegetation period, because leafless trees or vegetation covered with snow are not the target class.

Processing result of forest model

Sample of processing results for solid Forest mask

Additional options:

  • Height estimation – forest mask classification by height classes

  • Tree crown polygons - extracts tree crowns from forest vegetation as well as free-standing trees, provides them as polygons

  • Tree crown points - extracts tree crowns from forest vegetation as well as free-standing trees, provides them as points

Important

We recommend using the Tree crown options with 0.3m resolution imagery (~ 19 zoom) for the best results in case you need to detect individual trees.

Note

Forest Height classification follows the following classes:

  • Shrubs lower than 4 meters;

  • Forest from 4 to 10 meters high;

  • Forest more than 10 meters high;

This classification is used as a decision support for the vegetation management in powerline zones, etc. See the professional solutions by Geoalert. The tresholds can be customized depending on the requirements.

Processing results samples

Processing result of forest model (Tree crowns, points)

Sample of results for Tree crowns, points

Processing result of forest model (Heights)

Sample of results for Forest with heights mask (raster output)

πŸš— Roads

Model for road segmentation in high resolution imagery (0.3 - 0.5 m)

The model is trained primarily for rural and suburban areas. Multi-task learning is applied in order to improve the road mask connectivity, especially in the spots obscured by trees or buildings. Best suited for areas with low urbanization, and can fail in cities where wide roads with sidewalks and complex crossroads are present. We extract the road central line in order to decrease the clutter and optimize the extracted road network, and then the road lines are inflated back to polygonal object.

In version 1.1 we added the road graph postprocessing:

  • geometry simplification;

  • merging of the gaps;

  • removal of double edges;

  • removal of detached and too short segments;

Processing results samples

Processing result of roads model

Optimal conditions for the model: rural/suburban territory, Russia

Processing result of roads model

More complex environment - urban territory in Prague, Czech Republic

πŸ—οΈ Constructions

This model outlines the areas in the satellite image that contain construction sites and buildings under construction. The current model dataset is limited to some countries and the work of extending it is in progress.

Processing result of construction model

Processing result sample for a rapidly developing area with construction sites

[multi] Buildings + Roads + Forest + Water

This pipeline combines Buildings, Forest and Roads in a single workflow and returns the topology-corrected GeoJSON output.

Processing result of construction model

Processing result sample for a combined scenario featuring Buidlings, Roads and Forest models.

🏘 High-density housing (CUSTOM)

Note

This model has been deprecated as default one and moved to custom. it’s available only by request.

The β€œhigh-density housing” AI model is designed for areas with terraced or otherwise densely built buildings, common in the Middle East, parts of Africa, etc. This model, just like the regular building model, detects the building roofs. Firstly, the building blocks are segmented as a whole, and then each block is attempted to be devided into individual houses based on the detection of individual roof markers with rectangular grid or Voronoi diagram.

Processing result sample for dense urban development area (Tunisia, Africa):

Processing result of high-density housing model

High-density buildings model, instance segmentation and post-processing with grid options

🚜 Agriculture fields (CUSTOM)

Warning

This model has been deprecated as default one and moved to custom. it’s available by request.

Model for fields segmentation allows to detect the agricultural fields and delineate the nearby fields from each other, if there is a visual boundary (forest line, road, different crop stage). The model is trained on the high resolution data (1-1.2 m), primarily for Europe, Russia. It performs better with larger fields with active vegetation. Smaller and terrace fields (typical for Asia) are delineated not so good. Fields without vegetation, especially in winter period, are not target class.

Processing result of agriculture fields model

Processing result sample for Europe (Belgium)

Processing result of agriculture fields model

Processing result sample for Asia (Northern India)

✨ Segment anything (CUSTOM)

Note

This model has been deprecated as default one and moved to custom. it’s available only by request.

The β€œSegment Anything” (originaly introduced by Meta as universal segmentation model) is available as yet another experimental model in Mapflow. We adjusted it to Mapflow workflows to be used on a scale. There are the same steps required to launch this model:

  1. Select your data source

  2. Select your geographical area - either polygon, GeoJSON file, or your image extent

Yet there is one difference in the model workflow:

  • if you run this model using GTIFF fileβ€Šβ€”β€Šthe original resolution of the image will be used

  • if you run it via TMS (e.g. Imagery like Mapbox Satellite)β€Šβ€”β€Šyou need to select the Zoom level (image resolution) from the model options which will be used for the input

SAM options - zoom levels

Depending on the input resolution, the SAM model will interpret and generate different results. It can be empirically classified by mapping classes depending on the zoom levels as follows:

ZOOM LEVELS

SEMANTIC OBJECTS

14

Land use, large agri fields, forests, parks, fields, bodies of water

16

Small fields, large buildings, lawns, plots

18

Farms, buildings, groups of trees, etc.

19+

Houses, trees, vehicles, roof structures, etc.

SAM options - zoom levels

E.g. Result – SAM (zoom 14)

SAM options - zoom levels

E.g. Result – SAM (zoom 16)

SAM options - zoom levels

E.g. Result – SAM (zoom 18)

SAM options - zoom levels

E.g. Result – SAM on aerial imagery (zoom 20), single trees. Some polygons are not very accurate and some target objects are missing, but the overall result is relevant and can be used for more accurate mapping.

SAM options - zoom levels

E.g. Result – SAM on aerial imagery (zoom 20), containers. Applicable to small similar-pattern objects, requires some manual filtering of the model’s output.

Note

❗️ SAM is not provided in Mapfow for QGIS list of default models, as the zoom options are not enabled in the current plugin’s design. Yet if you work in QGIS and want to try SAM there β€” send us a request and we will connect corresponding workflow scenarios with all zoom options specified.

🐳 Swimming pools (CUSTOM)

Note

This model is available by request.

Swimming pools detection and classification. The model is trained on the high resolution aerial imagery (working zoom level 19). The testing benchmark score is F1 > 0.95.

Model name

Model type

Zoom level

F1 (testing)

Geo domain

Swimming pools

Detector + classification

zoom 19-20

> 0.95

Global

Processing result of construction model

Read more about the use cases and the model application

β˜€οΈ Solar panels (CUSTOM)

Note

This model is available by request.

Solar panels is a model trained for detecton of Photovoltaic elements using aerial imagery (working zoom levels 19-21). It’s capable of detection PV elements both on the rooftops and on the ground. The testing benchmark score is F1 > 0.87.

Model name

Model type

Zoom level

F1 (testing)

Geo domain

Solar panels

Detector + segmentator

zoom 19-21

pixelwise > 0.77

Global

Processing result of solars model