You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-08 - 22:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Jun 08, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2695599260,26cyclictest0-21swapper/012:25:450
26964992523,1cyclictest32532-21ssh11:20:523
2696499250,24cyclictest21138-21diskmemload11:08:313
2696499250,24cyclictest19870-21ssh09:39:163
26958992523,1cyclictest21138-21diskmemload10:34:131
2695899250,24cyclictest21138-21diskmemload11:59:111
2695899250,24cyclictest0-21swapper/112:31:141
2695599250,24cyclictest3863-21processes10:54:200
26964992423,1cyclictest21138-21diskmemload10:47:073
2696499240,24cyclictest0-21swapper/309:50:503
2696499240,23cyclictest5622-21sh09:55:493
26963992422,1cyclictest8449-21df_inode09:29:112
26963992422,1cyclictest28580-21sh11:18:042
26963992422,1cyclictest0-21swapper/211:34:202
26963992419,4cyclictest1457-21ssh11:22:572
2696399240,23cyclictest21138-21diskmemload11:52:252
2696399240,1cyclictest10799-21sh10:00:292
26958992422,1cyclictest0-21swapper/110:55:521
26958992421,2cyclictest31872-21basename12:20:001
2695899240,24cyclictest0-21swapper/111:03:171
2695899240,24cyclictest0-21swapper/110:11:491
2695899240,23cyclictest857-21ssh09:21:361
2695899240,23cyclictest14477-21apt-get08:59:101
2695899240,23cyclictest0-21swapper/112:04:301
2695899240,23cyclictest0-21swapper/111:30:211
2695899240,23cyclictest0-21swapper/110:20:031
2695899240,23cyclictest0-21swapper/110:20:031
2695899240,1cyclictest0-21swapper/109:29:471
2695899240,0cyclictest0-21swapper/110:47:351
26955992423,1cyclictest21138-21diskmemload10:11:490
2695599242,21cyclictest21529-21sh11:40:510
2695599240,24cyclictest0-21swapper/011:45:140
2695599240,23cyclictest21138-21diskmemload09:55:130
2695599240,23cyclictest0-21swapper/010:02:150
2695599240,0cyclictest21138-21diskmemload10:25:070
2695599240,0cyclictest0-21swapper/010:22:170
2695599240,0cyclictest0-21swapper/010:22:170
26964992323,0cyclictest21138-21diskmemload09:19:373
26964992321,1cyclictest12500-21ssh12:02:563
26964992321,1cyclictest0-21swapper/312:19:133
26964992320,2cyclictest2354-21ssh10:23:383
26964992320,2cyclictest2354-21ssh10:23:383
26964992320,2cyclictest21387-21sh12:10:073
26964992320,2cyclictest15934-21rm12:05:013
2696499230,23cyclictest1956-21ssh09:23:143
2696499230,23cyclictest0-21swapper/311:13:213
2696499230,23cyclictest0-21swapper/310:43:593
2696499230,23cyclictest0-21swapper/310:10:023
2696499230,22cyclictest6853-21ssh09:27:303
2696499230,22cyclictest28659-21ssh11:48:293
2696499230,22cyclictest27083-21ssh09:45:343
2696499230,22cyclictest21468-21cat08:05:013
2696499230,22cyclictest21138-21diskmemload10:57:253
2696499230,22cyclictest21138-21diskmemload09:31:273
2696499230,22cyclictest21138-21diskmemload09:31:273
2696499230,22cyclictest19879-21mailstats11:39:243
2696499230,22cyclictest15426-21rm10:34:313
2696499230,22cyclictest1100-21sh10:52:033
2696499230,0cyclictest21840-21ssh09:10:383
2696499230,0cyclictest21138-21diskmemload11:04:093
26963992323,0cyclictest21138-21diskmemload12:21:042
26963992323,0cyclictest21138-21diskmemload11:35:252
26963992323,0cyclictest21138-21diskmemload10:57:582
26963992323,0cyclictest0-21swapper/211:01:522
26963992323,0cyclictest0-21swapper/210:07:092
26963992321,1cyclictest21138-21diskmemload11:28:402
26963992321,1cyclictest21138-21diskmemload09:18:492
26963992320,2cyclictest2729-21grep10:54:132
26963992320,2cyclictest11883-21ssh10:31:512
26963992320,0cyclictest0-21swapper/209:43:062
2696399230,2cyclictest28844-21ssh10:48:072
2696399230,23cyclictest0-21swapper/211:09:272
2696399230,23cyclictest0-21swapper/210:22:122
2696399230,23cyclictest0-21swapper/210:22:122
2696399230,22cyclictest622-21gdbus09:10:002
2696399230,22cyclictest16978-21ssh09:36:302
2696399230,22cyclictest0-21swapper/212:25:552
2696399230,0cyclictest0-21swapper/211:42:472
2696399230,0cyclictest0-21swapper/209:22:242
26958992323,0cyclictest0-21swapper/112:11:241
26958992323,0cyclictest0-21swapper/109:42:291
26958992323,0cyclictest0-21swapper/109:16:181
26958992321,1cyclictest23098-21rm09:12:341
26958992321,1cyclictest0-21swapper/111:45:591
26958992321,1cyclictest0-21swapper/111:21:261
26958992321,1cyclictest0-21swapper/110:05:241
26958992321,1cyclictest0-21swapper/109:49:171
2695899230,2cyclictest622-21gdbus07:20:011
2695899230,23cyclictest0-21swapper/110:51:011
2695899230,23cyclictest0-21swapper/110:39:471
2695899230,22cyclictest17133-21sh12:06:481
2695899230,22cyclictest1124-21sh11:52:091
2695899230,1cyclictest18562-21ssh09:38:571
2695899230,1cyclictest0-21swapper/111:10:011
2695899230,0cyclictest21138-21diskmemload11:15:471
2695899230,0cyclictest0-21swapper/109:54:071
26955992323,0cyclictest21138-21diskmemload09:18:350
26955992323,0cyclictest0-21swapper/011:56:330
26955992323,0cyclictest0-21swapper/011:15:470
26955992323,0cyclictest0-21swapper/010:41:260
26955992323,0cyclictest0-21swapper/010:31:040
26955992322,1cyclictest0-21swapper/011:30:210
26955992322,1cyclictest0-21swapper/010:09:110
2695599232,20cyclictest62550irq/127-eno109:28:160
2695599232,1cyclictest62550irq/127-eno111:25:370
26955992321,1cyclictest0-21swapper/009:51:500
26955992321,1cyclictest0-21swapper/009:22:050
26955992320,2cyclictest26503-21latency_hist09:45:010
26955992320,2cyclictest22493-21sh12:11:480
26955992319,3cyclictest18956-21ls11:09:110
2695599231,21cyclictest62550irq/127-eno111:00:550
2695599230,23cyclictest62550irq/127-eno111:37:020
2695599230,23cyclictest21138-21diskmemload10:59:150
2695599230,23cyclictest0-21swapper/012:32:230
2695599230,23cyclictest0-21swapper/010:15:240
2695599230,22cyclictest0-21swapper/012:23:020
2695599230,22cyclictest0-21swapper/012:04:200
2695599230,22cyclictest0-21swapper/010:45:190
2695599230,22cyclictest0-21swapper/009:32:340
2695599230,22cyclictest0-21swapper/009:32:340
26964992222,0cyclictest21138-21diskmemload10:39:403
26964992222,0cyclictest0-21swapper/312:25:513
26964992222,0cyclictest0-21swapper/312:22:583
26964992222,0cyclictest0-21swapper/309:42:063
26964992221,1cyclictest10400-21ssh12:30:113
2696499220,21cyclictest5883-21ssh11:26:313
2696499220,21cyclictest32300-21apt-get07:24:123
2696499220,21cyclictest21138-21diskmemload10:01:163
2696499220,21cyclictest0-21swapper/311:15:073
2696499220,21cyclictest0-21swapper/307:49:103
2696499220,1cyclictest21138-21diskmemload10:15:253
2696499220,1cyclictest0-21swapper/310:28:493
2696499220,1cyclictest0-21swapper/310:05:163
2696499220,0cyclictest21138-21diskmemload11:33:473
26963992222,0cyclictest0-21swapper/212:33:132
26963992222,0cyclictest0-21swapper/212:07:472
26963992222,0cyclictest0-21swapper/209:45:022
26963992221,1cyclictest567-21ssh09:51:222
26963992220,1cyclictest23131-21ssh10:12:132
26963992220,1cyclictest10509-21ssh12:00:012
2696399220,2cyclictest7647-21ssh11:58:452
2696399220,22cyclictest0-21swapper/208:39:362
2696399220,21cyclictest21771-21ssh09:10:312
2696399220,21cyclictest21325-21ssh12:10:022
2696399220,21cyclictest21138-21diskmemload12:15:082
2696399220,21cyclictest16518-21rm10:35:412
2696399220,21cyclictest16293-21ssh12:35:532
2696399220,21cyclictest0-21swapper/210:25:162
2696399220,1cyclictest28596-21ssh10:17:252
2696399220,1cyclictest11791-21ssh09:31:452
2696399220,1cyclictest11791-21ssh09:31:452
26958992222,0cyclictest0-21swapper/111:35:121
26958992222,0cyclictest0-21swapper/110:25:391
26958992220,1cyclictest24435-21apt-get08:14:111
26958992220,1cyclictest0-21swapper/110:15:011
2695899220,21cyclictest9057-21apt-get07:40:021
2695899220,21cyclictest27486-21apt-get07:14:101
2695899220,21cyclictest26833-21apt-get08:19:111
2695899220,21cyclictest11492-21awk08:50:011
2695899220,21cyclictest0-21swapper/111:40:011
2695899220,21cyclictest0-21swapper/111:25:201
2695899220,21cyclictest0-21swapper/110:43:081
2695899220,21cyclictest0-21swapper/109:30:391
2695899220,21cyclictest0-21swapper/109:30:391
2695899220,21cyclictest0-21swapper/107:54:121
2695899220,1cyclictest90452sleep109:59:161
2695899220,1cyclictest32451-21ssh12:20:371
2695899220,1cyclictest21246-21ssh11:10:041
26955992222,0cyclictest0-21swapper/012:15:020
26955992222,0cyclictest0-21swapper/010:39:470
26955992222,0cyclictest0-21swapper/008:59:100
26955992220,1cyclictest6547-21turbostat07:35:000
2695599220,22cyclictest0-21swapper/012:39:100
2695599220,21cyclictest31705-21awk07:20:010
2695599220,21cyclictest0-21swapper/012:05:310
2695599220,21cyclictest0-21swapper/011:50:090
2695599220,21cyclictest0-21swapper/011:21:350
2695599220,21cyclictest0-21swapper/009:10:160
2695599220,21cyclictest0-21swapper/007:30:000
2695599220,0cyclictest0-21swapper/009:37:290
26964992121,0cyclictest0-21swapper/311:40:233
26964992120,1cyclictest0-21swapper/308:59:103
26964992119,1cyclictest9057-21apt-get07:40:003
2696499210,20cyclictest15668-21ssh12:35:013
2696499210,20cyclictest0-21swapper/311:55:073
2696499210,20cyclictest0-21swapper/307:59:093
2696499210,0cyclictest0-21swapper/308:49:123
2696499210,0cyclictest0-21swapper/308:44:103
2696499210,0cyclictest0-21swapper/308:39:123
2696499210,0cyclictest0-21swapper/308:29:103
2696499210,0cyclictest0-21swapper/308:09:103
26963992121,0cyclictest0-21swapper/209:55:092
26963992119,1cyclictest21471-21dump-pmu-power08:05:012
2696399210,21cyclictest0-21swapper/211:46:162
2696399210,20cyclictest0-21swapper/208:59:102
26958992120,1cyclictest0-21swapper/109:04:111
26958992119,1cyclictest0-21swapper/107:30:001
2695899210,21cyclictest0-21swapper/112:35:021
2695899210,0cyclictest0-21swapper/107:59:091
26955992121,0cyclictest0-21swapper/007:59:090
2695599210,21cyclictest0-21swapper/007:24:120
2695599210,20cyclictest0-21swapper/009:45:430
2695599210,20cyclictest0-21swapper/008:49:120
2695599210,0cyclictest0-21swapper/008:24:110
26964992020,0cyclictest0-21swapper/307:54:123
26964992020,0cyclictest0-21swapper/307:19:113
26964992019,1cyclictest24435-21apt-get08:14:103
2696499200,0cyclictest2282-21apt-get07:29:113
2696499200,0cyclictest0-21swapper/307:34:113
2696499200,0cyclictest0-21swapper/307:15:013
26963992020,0cyclictest32044-21apt-get08:29:102
26963992020,0cyclictest22040-21apt-get08:09:102
26963992020,0cyclictest0-21swapper/208:34:112
26963992020,0cyclictest0-21swapper/207:24:122
26955992020,0cyclictest0-21swapper/008:19:110
26955992020,0cyclictest0-21swapper/007:54:120
26955992020,0cyclictest0-21swapper/007:14:100
26963991919,0cyclictest0-21swapper/208:44:102
26963991917,1cyclictest607-21in:imuxsock08:25:002
26958991919,0cyclictest0-21swapper/108:54:111
26958991919,0cyclictest0-21swapper/108:39:121
26958991919,0cyclictest0-21swapper/108:29:101
26958991919,0cyclictest0-21swapper/107:49:101
26955991918,1cyclictest0-21swapper/008:29:100
26955991918,0cyclictest10042-21apt-get07:44:100
26955991917,1cyclictest0-21swapper/008:54:110
2695599190,18cyclictest0-21swapper/008:04:120
26963991818,0cyclictest9691-21apt-get08:49:122
26963991818,0cyclictest0-21swapper/207:49:102
26963991818,0cyclictest0-21swapper/207:34:112
26963991818,0cyclictest0-21swapper/207:29:112
26963991817,1cyclictest17229-21apt-get07:59:092
26963991816,1cyclictest29311-21perf07:15:012
26958991817,1cyclictest0-21swapper/108:20:021
26958991817,0cyclictest0-21swapper/108:09:101
26955991818,0cyclictest0-21swapper/009:04:110
26955991818,0cyclictest0-21swapper/008:14:110
26964991717,0cyclictest0-21swapper/308:19:113
26963991717,0cyclictest0-21swapper/209:04:112
26963991717,0cyclictest0-21swapper/207:54:122
26958991717,0cyclictest7293-21apt-get08:44:111
26958991716,1cyclictest0-21swapper/107:24:121
26955991717,0cyclictest0-21swapper/008:39:120
26955991717,0cyclictest0-21swapper/007:49:100
2696499160,15cyclictest18774-21munin-run09:05:003
2696499160,0cyclictest0-21swapper/308:54:113
26963991615,1cyclictest0-21swapper/208:14:102
26963991614,1cyclictest9076-21perf07:40:002
2695899160,15cyclictest0-21swapper/108:04:121
2695599160,15cyclictest0-21swapper/009:09:120
26964991512,2cyclictest30206-21gltestperf08:24:133
26963991515,0cyclictest0-21swapper/207:19:112
26958991515,0cyclictest0-21swapper/107:34:491
26958991513,1cyclictest9140-21munin-run07:40:001
2695899150,1cyclictest20988-21grep09:09:211
26955991515,0cyclictest0-21swapper/008:44:110
26955991515,0cyclictest0-21swapper/008:09:100
2695599150,14cyclictest9039-21sh07:40:000
2696499140,14cyclictest0-21swapper/307:40:163
2696499140,0cyclictest0-21swapper/309:06:473
2696499140,0cyclictest0-21swapper/308:30:083
26963991414,0cyclictest0-21swapper/208:15:452
2696399140,0cyclictest0-21swapper/208:51:052
2696399140,0cyclictest0-21swapper/207:40:382
26955991414,0cyclictest0-21swapper/008:30:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional