Geospatial analysis
editGeospatial analysis
editDid you know that Elasticsearch has geospatial capabilities? Elasticsearch and geo go way back, to 2010. A lot has happened since then and today Elasticsearch provides robust geospatial capabilities with speed, all with a stack that scales automatically.
Not sure where to get started with Elasticsearch and geo? Then, you have come to the right place.
Geospatial mapping
editElasticsearch supports two types of geo data: geo_point fields which support lat/lon pairs, and geo_shape fields, which support points, lines, circles, polygons, multi-polygons, and so on. Use explicit mapping to index geo data fields.
Have an index with lat/lon pairs but no geo_point mapping? Use runtime fields to make a geo_point field without reindexing.
Ingest
editData is often messy and incomplete. Ingest pipelines lets you clean, transform, and augment your data before indexing.
- Use CSV together with explicit mapping to index CSV files with geo data. Kibana’s Import CSV feature can help with this.
- Use GeoIP to add geographical location of an IPv4 or IPv6 address.
- Use geo-grid processor to convert grid tiles or hexagonal cell ids to bounding boxes or polygons which describe their shape.
- Use geo_match enrich policy for reverse geocoding. For example, use reverse geocoding to visualize metropolitan areas by web traffic.
Query
editGeo queries answer location-driven questions. Find documents that intersect with, are within, are contained by, or do not intersect your query geometry. Combine geospatial queries with full text search queries for unparalleled searching experience. For example, "Show me all subscribers that live within 5 miles of our new gym location, that joined in the last year and have running mentioned in their profile".
ES|QL
editES|QL has support for Geospatial Search functions, enabling efficient index searching for documents that intersect with, are within, are contained by, or are disjoint from a query geometry. In addition, the ST_DISTANCE
function calculates the distance between two points.
Aggregate
editAggregations summarizes your data as metrics, statistics, or other analytics. Use bucket aggregations to group documents into buckets, also called bins, based on field values, ranges, or other criteria. Then, use metric aggregations to calculate metrics, such as a sum or average, from field values in each bucket. Compare metrics across buckets to gain insights from your data.
Geospatial bucket aggregations:
- Geo-distance aggregation evaluates the distance of each geo_point location from an origin point and determines the buckets it belongs to based on the ranges (a document belongs to a bucket if the distance between the document and the origin falls within the distance range of the bucket).
- Geohash grid aggregation groups geo_point and geo_shape values into buckets that represent a grid.
- Geohex grid aggregation groups geo_point and geo_shape values into buckets that represent an H3 hexagonal cell.
- Geotile grid aggregation groups geo_point and geo_shape values into buckets that represent a grid. Each cell corresponds to a map tile as used by many online map sites.
Geospatial metric aggregations:
- Geo-bounds aggregation computes the geographic bounding box containing all values for a Geopoint or Geoshape field.
- Geo-centroid aggregation computes the weighted centroid from all coordinate values for geo fields.
- Geo-line aggregation aggregates all geo_point values within a bucket into a LineString ordered by the chosen sort field. Use geo_line aggregation to create vehicle tracks.
Combine aggregations to perform complex geospatial analysis. For example, to calculate the most recent GPS tracks per flight, use a terms aggregation to group documents into buckets per aircraft. Then use geo-line aggregation to compute a track for each aircraft. In another example, use geotile grid aggregation to group documents into a grid. Then use geo-centroid aggregation to find the weighted centroid of each grid cell.
Integrate
editUse vector tile search API to consume Elasticsearch geo data within existing GIS infrastructure.
Visualize
editVisualize geo data with Kibana. Add your map to a dashboard to view your data from all angles.
This dashboard shows the effects of the Cumbre Vieja eruption.
Machine learning
editPut machine learning to work for you and find the data that should stand out with anomaly detections. Find credit card transactions that occur in an unusual locations or a web request that has an unusual source location. Location-based anomaly detections make it easy to find and explore and compare anomalies with their typical locations.
Alerting
editLet your location data drive insights and action with geographic alerts. Commonly referred to as geo-fencing, track moving objects as they enter or exit a boundary to receive notifications through common business systems (email, Slack, Teams, PagerDuty, and more).
Interested in learning more? Follow step-by-step instructions for setting up tracking containment alerts to monitor moving vehicles.