Open Access
Table 5
Real world usability test results.
| Test dimension | Specific indicators | Test results | Compliance status | Remarks |
|---|---|---|---|---|
| Typical scenario testing | Optimization task of residential area layout | |||
| effectiveness | Task completion rate of 92% | ✓ Meet the standard | 7/10 User completed independently | |
| efficiency | The average operation time is 12.3 minutes | ✓ Exceeding expectations | 58% faster than manual design | |
| Satisfaction level | ASQ scale mean 4.2/5 | ✓ Meet the standard | User reviews are positive | |
| Typical scenario testing | Adjustment of plot ratio for commercial complexes | |||
| Compliance with specifications | 96% | ✓ Meet the standard | Highly consistent with planning standards | |
| BIM nesting accuracy | 89% | ✓ Meet the standard | A small amount of manual adjustment is required | |
| user feedback | Recognize the simulation function of fire escape routes | ✓ Meet the standard | Suggest enhancing the parking space algorithm | |
| Typical scenario testing | Historic district renovation | |||
| Traditional element retention rate | 91% | ✓ Meet the standard | Horse head walls/carved window frames, etc | |
| Facade material matching rate | 87% | ✓ Meet the standard | Accurate material selection | |
| Conflict resolution ability | 80% of users successfully mediated | ✓ Meet the standard | High user satisfaction | |
| System level performance | Overall availability | SUS Scale 83 points | ✓ Meet the standard | Good user experience |
| System level performance | Operational efficiency | Scheme generation speed 9.8 seconds/hectare | ✓ Exceeding expectations | Fast response speed |
| System level performance | Decision support | Key parameter modification times ≤ 3 times/task | ✓ Meet the standard | Convenient user decision-making |
| System level performance | Resource consumption | GPU memory occupies 8.2GB | Need to optimize | High usage of video memory |
| Core issues | Visual bottleneck | 3D model rendering frame rate 22FPS | Need to optimize | Suggest increasing the frame rate |
| Core issues | Limitations in semantic understanding | Abstract requirement output solution requires manual intervention | Need to optimize | 32% of the plan needs to be adjusted |
| Core issues | Mobile adaptation | Touch operation error rate 18.7% | Need to optimize | Time consumption for recognizing toolbar icons |
| User Value | Planner feedback | Shorten the design cycle to 4 hours | Highly recognized by users | |
| User Value | Feedback from Green Building Consultant | Reduce air conditioning load by 19.8% | Positive user feedback |
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.