Hard route requirements
Destinations are not coordinates. Agents must resolve relational, comparative, and nested references, then satisfy ordered must-pass and must-avoid regions.
Map2Route benchmarks whether an agent can resolve compositional references and generate complete routes that obey ordered requirements, scoped constraints, and graded preferences over semantic maps.
Benchmark
Each episode provides a pre-built semantic map, an initial pose, and an instruction. Models must resolve relational, comparative, and nested references, then generate a complete route that satisfies ordered must-pass and must-avoid requirements together with spatially or temporally scoped preferences.
Destinations are not coordinates. Agents must resolve relational, comparative, and nested references, then satisfy ordered must-pass and must-avoid regions.
Route quality depends on more than success. Preferences can apply globally, inside a spatial region, or during a particular route stage.
Path efficiency measures how directly the complete route fulfills all ordered requirements, rather than scoring only the final destination.
Demo examples
Black trajectories are human demonstrations; colored trajectories are A* paths. Expand this section, then choose a scene.
Next, you need to inspect three locations in order:
1. the area near the bed in a room that contains a desk with a laptop on it;
2. a surface—whether it is a dining table, dresser, desk, or countertop—that has a pan, a statue, and lettuce on it;
3. the small area between the dining table and its nearest window in the bedroom connected to the starting room.
On the way to the first destination, first make a counterclockwise patrol around the current room, and stop the patrol when you reach the doorway used to leave the room. While heading toward the unknown surface, keep away from the vase in the room containing the first destination. Finally, in the room containing the last destination, stay away from the dresser while remaining close to the TV.
Go to the sink in a room where the toilet has only a spray bottle and toilet paper on it. While still in the starting room, stay close to the bowl on the dining table. Then head to the small area between the countertop and the fridge. While in the kitchen, keep away from the egg inside the fridge. After that, proceed to a corner of a bathroom where the toilet has toilet paper, a soap bottle, a spray bottle, and a candle on it. The target corner is next to a plunger. While in this bathroom, stay close to the sink
There is a houseplant placed next to a dresser somewhere in the scene. Go to that houseplant. While in the room containing the houseplant, keep away from the TV in the adjacent room. Then, starting from the kitchen where you are after reaching the houseplant, pass through rooms in the order kitchen → living room → bedroom, and finally enter a bathroom. Once inside the bathroom, head to the toilet paper. In this room, try to stay closer to the plunger than to the sink basin. Finally, you should now be at one corner of the map. Travel to another corner of the map where there is a sink, and keep away from the plunger near that sink.
Head to the houseplant in the kitchen. When you are in the room immediately before entering the kitchen, stay closer to the dining table than to the desk.
Go to the garbage can in the bathroom that is farthest from your current position. When you enter the kitchen, keep away from the dining table in the kitchen.
Head to the garbage can in the smallest bathroom. In the room immediately before entering that bathroom, stay as close to the dresser as possible.
First, head to the desk that is closest to you in straight-line distance. Then proceed to the dining table in the living room. While you are in the room containing the desk, keep away from the dining table at all times.
Use the arrows, trackpad, or horizontal scrollbar to browse. Click a route to enlarge it.
Go to the TV stand next to the sofa. Then head to the basketball underneath the dresser. On the way to the second destination, do not pass between the vacuum cleaner and the basketball in the same room.
First, head to the houseplant on the countertop. While you are still in the starting room, keep away from the remote control. Then go to the bedroom that contains a dog bed and enter the small area that is almost enclosed by a baseball bat. When you enter this target room, try to stay close to the chair nearest to the bowl. This room is adjacent to three bathrooms; enter the bathroom whose doorway is farthest from your current position in terms of travel distance, and head to the garbage can inside it. Whenever you pass through the room containing the vacuum cleaner, do not go between the vacuum cleaner and the basketball, and do not pass between the baseball bat and the bed.
Go to the chair in a room that contains two stools. The target chair is very close to a cup and is also near a knife. After reaching the chair, proceed to a bathroom where a garbage can and a plunger are located between the sink and the toilet, and head to the toilet in that bathroom. At this point, first circle the dining table beside you once counterclockwise. Then go to another toilet, located in a room where only a plunger lies between the toilet and the sink. On the way to this third destination, when you enter a room containing a dog bed, stay close to the baseball bat in that room. After leaving this bedroom and entering the next bedroom, stay close to the vase on the dining table in that bedroom.
Go to the chair closest to the garbage bag. On the way there, do not pass between the vacuum cleaner and the dining table nearest to it. While in the room containing the vacuum cleaner, keep away from the houseplant.
Go to a box that is not underneath a dining table. While in the current room, keep away from the houseplant.
Head to the tissue box that is relatively far from your current position. Along the way, stay closer to the dog bed than to the desk beside it.
Go to the garbage can that is farthest from your current position. In the room immediately before the room containing the garbage can, do not pass between the chair and the dog bed. In the room immediately before the room containing the dog bed, stay close to the bowl.
Use the arrows, trackpad, or horizontal scrollbar to browse. Click a route to enlarge it.
First, make your way to the room that contains the greatest combined number of tennis rackets and pillows. In this room, there are three boxes: one with nothing around it, one underneath the TV, and one beside the window. Go to the box next to the window. As you leave your starting room, stay close to the remote control there.
Next, head to the small area near the countertop in the kitchen, where there is a window looking outside. On the way, keep your distance from the stool.
Finally, proceed to the toilet that is farthest from the garbage can in the same room. In the room you pass through immediately before entering the toilet's room, do not go between the side table and the dining table.
Next, you need to visit three locations in order:
1. Go to the area between a floor lamp and the bed closest to that floor lamp. Make sure that when you are facing the nearby dining table, the floor lamp is on one side of you and the bed is on the other.
2. Proceed to the doorway in the kitchen.
3. Head to the dresser in the bedroom containing the largest number of boxes.
There are no special requirements on your way to the first destination. While heading toward the second destination, stay close to the cart, and do not pass through the space between the dish sponge in the kitchen and the pen on the dining table. Finally, when you enter the bedroom containing the last destination, keep your distance from the box that is second closest to the dresser.
There is a room with a window positioned between a bed and a TV stand. Go to the window in this room that is closest to the dresser. Along the way, once you enter the first bedroom, never pass between the bed and the dining table in that bedroom. You should also stay close to the basketball you encounter in the room with a floor lamp.
Next, in the kitchen, find the chair that is closest to the center point of all the potatoes and make your way to it. On the way there, keep your distance from any side table that has either a key chain or a statue on it.
Finally, head to a corner of the largest bathroom. One corner contains a toilet, and another contains a garbage can. Of the two remaining corners, go to the one farthest from the doorway through which you enter the bathroom.
Head to the bed with a teddy bear on it. Along the way, keep away from the bed in the starting room.
Head to the nearest chair while keeping away from all side tables.
Go to the toilet in a bathroom that can only be reached by passing through a living room. Along the way, stay as far away from the sofa as possible.
Head to the window next to the fridge. Along the way, stay closer to the countertop than to the pot
Use the arrows, trackpad, or horizontal scrollbar to browse. Click a route to enlarge it.
There is a large connected area consisting of two living rooms and a kitchen. First, go to the dining table in the living room that does not contain any boxes. Along the way, if you come across a shelf inside a TV stand, keep your distance from it.
Next, head to the TV in the other of the two living rooms mentioned above. While making your way there, stay closer to paper towel roll.
Finally, proceed to a box in a bedroom that is adjacent only to two bathrooms and one other bedroom. Once you are in the target bedroom, keep your distance from the remote control.
Next, you need to visit three locations in order:
1. Go to the TV stand that has two remote controls and a plate on it.
2. Proceed to the sink closest to the washing machine.
3. Head to the chair that is not placed against a wall in a room containing both a sofa and a houseplant.
There are also several constraints to follow. While heading to the first destination, stay close to the garbage can. Then, on your way to the sink, when you reach the room that connects two bedrooms through doorways, circle counterclockwise once around the object located in the middle of that room.
Leave your current room and pass through three different bedrooms in sequence, then enter a bathroom and go to the plunger. Each room in this sequence must be a new room, so you are not allowed to backtrack.
Next, make your way to the center point of the candles in the living room. On the way there, when you enter the bedroom that leads to a living room, keep your distance from the houseplant on the dresser.
Finally, head to the box in the bedroom. While you are in your current living room, stay closer to the remote control on the sofa than to the remote control on the dining table. When you enter the living room with a dog bed, follow the wall around the room until you reach the doorway you will use to leave. Take the side along the wall that does not pass by the dresser.
Head to the armchair in the living room. While passing through the kitchen, stay close to the garbage can.
Go to the sofa that has only one remote control on it. While in the starting room, do not pass between the basketball and the doorway that leads to the bedroom with two windows. In the room containing the target sofa, stay close to the shelf.
Head to the bed in the room that has two windows. During the way to there, stay close to all the dressers.
Head to the dining table that is closest to being square-shaped. You are currently standing at a doorway that leads to both a bathroom and a bedroom. First, enter the nearby bathroom and make one clockwise patrol around it. Then go into the bedroom, move counterclockwise toward another doorway, and continue on to the destination.
Use the arrows, trackpad, or horizontal scrollbar to browse. Click a route to enlarge it.
Head to the sink in the bathroom that contains a clothes dryer. When you enter the next living room, stay close to the TV stand.
Head to the dresser in the bedroom that has two windows. Keep away from the TV stand that is farthest from your current position.
Visit all the baseball bats in order from nearest to farthest. While in the room that contains a dog bed, keep away from the garbage can.
Go to the dining table that has a baseball bat nearby. Stay close to the window near the fridge.
There are two windows positioned very close to each other. First, go to the houseplant near these two windows. Then head to the window beside the fridge. On your way to that window, do not pass between the fridge and the dining table.
Go to the sink in the room with the clothes dryer. On the way to the sink, stay close to the TV placed on the TV stand.
Next, in the room where a baseball bat is beside a desk, find the houseplant positioned next to two windows and head toward it. Along the way, you will also encounter another houseplant in a bedroom; keep your distance from that one.
Finally, make your way to the toilet in the bathroom adjacent to the kitchen. In the large open area formed by the kitchen and the living room, do not pass between the two dining tables. Also, do not go through the space between the TV stand and the dining table in the living room.
First, make your way to the window in the bedroom farthest from your starting position. This window should also be the one farthest from the bed in that bedroom. Along the way, when you enter the large open area formed by the living room and the kitchen, do not pass between the countertop and the sofa, and do not go through the space between the dining table and the TV stand in the living room.
Next, head to the houseplant in a bedroom that is second closest to your starting position. In the target room, enter the small area enclosed by the baseball bat, the desk, and the bed, and inspect that space. After leaving this area, keep your distance from the laptop.
Finally, proceed to the toilet closest to your first destination, the window.
Use the arrows, trackpad, or horizontal scrollbar to browse. Click a route to enlarge it.
Grounding2Route
Grounding2Route separates compositional semantic grounding from geometric planning. The LLM does not output a trajectory directly; it produces a verifiable Route Semantic Intermediate Representation (RouteIR) that a deterministic planner compiles into a complete route.
Compose read-only semantic-map APIs to resolve entities, relations, regions, and scopes.
Turn provisional grounding into a typed, grounded specification and repair invalid references.
Compile the verified RouteIR into a complete route with deterministic sequential search.
Results
Hard Constraint Score (HCS) measures how many must-pass regions are reached in the correct order while respecting must-avoid constraints. Grounding2Route improves hard satisfaction, every soft-preference metric, and path efficiency.
Grounding2Route improves Easy/Hard HCS by 0.299/0.251 over the strongest adapted baseline, showing substantially better compositional grounding.
Grounding2Route leads every baseline on Near, Far, Relative, Path-Shape, and Clearance, indicating stronger route-level preference satisfaction.
Despite these gains, Grounding2Route remains far from human performance on Hard episodes: it reaches 0.375 HCS and 0.08 Path-Shape, compared with 1.00 HCS and 0.99 for human demonstrations.
Controlled variants isolate the contribution of Grounding2Route’s grounding strategy, intermediate representation, verification-guided repair, and scope-aware preference modeling.
Code-as-Grounding reaches 0.579 HCS and 0.46 SPL, ahead of ToolCall, Direct ID, and schema-constrained prediction.
Replacing RouteIR with LTL reduces HCS/SPL from 0.579/0.46 to 0.439/0.36.
Increasing repair rounds from zero to three raises HCS from 0.395 to 0.579 and Relative from 0.56 to 1.11.
Globalizing temporal or spatial scopes leaves HCS nearly unchanged but weakens Far and Relative; removing soft costs degrades every soft metric.
Map2Route isolates three complementary pressure points: deeper compositional references, more candidate instances before disambiguation, and longer chains of hard constraints. Grounding2Route remains strongest, but both methods degrade steadily as each factor grows.
Real-world experiments
We evaluate Grounding2Route on physical robots across 48 episodes in eight indoor scenes, testing whether compositional instructions, hard constraints, and scoped preferences transfer beyond the benchmark.
Of the lost HCS, 73.75% comes from semantic-map construction errors, 22.5% from grounding or route planning, and 3.75% from SLAM issues.
Video gallery
The first video in every scene shows exploration and semantic-map construction, followed by task-execution episodes.
@article{2026Map2Route,
title = {Map2Route: Benchmarking Compositional Language-Grounded Route Planning over Semantic Maps},
author = {Anonymous Authors},
year = {2026}
}