You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 10:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Wed May 27, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
648299260,25cyclictest5882-21sh22:16:050
6495992523,1cyclictest0-21swapper/323:45:173
649599250,24cyclictest32533-21diskmemload22:23:063
649599250,24cyclictest0-21swapper/300:09:353
649099250,24cyclictest32533-21diskmemload22:27:542
649099250,24cyclictest0-21swapper/223:50:162
648599250,24cyclictest32533-21diskmemload23:32:201
648599250,24cyclictest32533-21diskmemload22:19:351
648599250,24cyclictest32533-21diskmemload21:28:261
648599250,24cyclictest0-21swapper/121:37:421
649599240,2cyclictest18378-21ssh22:28:093
649599240,23cyclictest19064-21ntpq00:28:153
649599240,23cyclictest0-21swapper/321:49:553
649599240,1cyclictest32533-21diskmemload00:12:593
649599240,0cyclictest0-21swapper/322:48:103
6490992423,1cyclictest32533-21diskmemload21:40:482
6490992423,1cyclictest32533-21diskmemload21:40:482
6490992423,0cyclictest0-21swapper/200:04:262
649099240,23cyclictest32533-21diskmemload23:56:502
649099240,23cyclictest0-21swapper/223:23:002
649099240,23cyclictest0-21swapper/223:09:442
649099240,23cyclictest0-21swapper/222:19:232
649099240,23cyclictest0-21swapper/221:10:312
649099240,0cyclictest32533-21diskmemload22:22:232
6485992424,0cyclictest0-21swapper/121:19:341
648599241,22cyclictest3794-21/usr/sbin/munin23:43:191
648599240,23cyclictest13626-21idleruntime-cro19:25:011
648599240,0cyclictest0-21swapper/123:05:371
648599240,0cyclictest0-21swapper/121:56:521
648599240,0cyclictest0-21swapper/121:46:191
6482992421,2cyclictest26404-21sh23:34:330
648299240,24cyclictest32533-21diskmemload23:38:040
648299240,24cyclictest0-21swapper/023:50:540
648299240,24cyclictest0-21swapper/023:49:540
648299240,24cyclictest0-21swapper/022:33:530
648299240,24cyclictest0-21swapper/021:23:300
648299240,23cyclictest0-21swapper/022:21:150
648299240,1cyclictest4362-21sh21:43:320
648299240,1cyclictest4362-21sh21:43:320
6495992323,0cyclictest0-21swapper/322:15:383
6495992323,0cyclictest0-21swapper/321:25:573
6495992321,1cyclictest22693-21ssh22:01:453
6495992321,1cyclictest0-21swapper/323:30:473
6495992321,1cyclictest0-21swapper/323:13:153
6495992321,1cyclictest0-21swapper/321:38:243
6495992321,1cyclictest0-21swapper/321:10:013
6495992321,1cyclictest0-21swapper/300:33:113
649599230,2cyclictest20877-21sendmail19:40:003
649599230,23cyclictest0-21swapper/322:59:173
649599230,23cyclictest0-21swapper/321:23:373
649599230,23cyclictest0-21swapper/321:18:173
649599230,22cyclictest615-21diskmemload21:40:393
649599230,22cyclictest615-21diskmemload21:40:393
649599230,22cyclictest32533-21diskmemload23:20:253
649599230,22cyclictest32533-21diskmemload22:05:493
649599230,22cyclictest27177-21ssh23:35:253
649599230,22cyclictest22680-21ssh23:01:553
649599230,0cyclictest0-21swapper/323:50:303
649599230,0cyclictest0-21swapper/323:26:073
649599230,0cyclictest0-21swapper/300:01:523
6490992323,0cyclictest28989-21apt-get19:58:092
6490992323,0cyclictest0-21swapper/221:57:042
6490992322,1cyclictest0-21swapper/200:10:142
6490992321,1cyclictest0-21swapper/222:43:122
6490992321,1cyclictest0-21swapper/200:19:522
6490992320,2cyclictest28659-21sh21:37:072
649099231,1cyclictest0-21swapper/219:55:002
649099230,2cyclictest25100-21/usr/sbin/munin23:33:182
649099230,23cyclictest0-21swapper/223:37:492
649099230,23cyclictest0-21swapper/221:49:142
649099230,22cyclictest27442-21ssh00:36:162
649099230,22cyclictest22925-21ssh21:31:342
649099230,22cyclictest15986-21idleruntime-cro21:55:012
649099230,22cyclictest13477-21ssh00:23:112
649099230,1cyclictest0-21swapper/221:26:092
649099230,0cyclictest0-21swapper/223:49:022
649099230,0cyclictest0-21swapper/200:31:242
649099230,0cyclictest0-21swapper/200:06:132
6485992323,0cyclictest32533-21diskmemload22:33:251
6485992323,0cyclictest0-21swapper/123:51:571
6485992323,0cyclictest0-21swapper/123:20:111
6485992323,0cyclictest0-21swapper/122:05:571
6485992323,0cyclictest0-21swapper/121:52:441
6485992323,0cyclictest0-21swapper/121:41:151
6485992323,0cyclictest0-21swapper/121:41:151
6485992323,0cyclictest0-21swapper/100:35:211
6485992321,1cyclictest75-21kswapd022:03:071
648599230,23cyclictest32533-21diskmemload23:00:111
648599230,23cyclictest0-21swapper/123:38:401
648599230,23cyclictest0-21swapper/123:10:341
648599230,23cyclictest0-21swapper/122:12:221
648599230,22cyclictest28456-21rm00:07:521
648599230,22cyclictest24450-21ssh00:33:151
648599230,22cyclictest24001-21cpu21:33:101
648599230,22cyclictest22699-21ssh00:02:091
648599230,1cyclictest16234-21ssh00:25:311
648599230,0cyclictest0-21swapper/122:55:361
648599230,0cyclictest0-21swapper/100:12:311
6482992323,0cyclictest32533-21diskmemload23:12:560
6482992323,0cyclictest0-21swapper/023:23:550
6482992323,0cyclictest0-21swapper/023:16:230
6482992323,0cyclictest0-21swapper/000:39:190
6482992322,1cyclictest32533-21diskmemload21:38:030
6482992322,1cyclictest0-21swapper/022:04:090
648299230,2cyclictest27677-21ssh22:36:430
648299230,23cyclictest32533-21diskmemload23:01:270
648299230,23cyclictest32533-21diskmemload22:40:140
648299230,23cyclictest32533-21diskmemload00:26:410
648299230,23cyclictest0-21swapper/022:28:550
648299230,23cyclictest0-21swapper/021:11:500
648299230,23cyclictest0-21swapper/000:02:110
648299230,22cyclictest27219-21ssh00:05:560
648299230,22cyclictest23367-21ssh00:33:050
648299230,22cyclictest17080-21ssh21:25:560
648299230,22cyclictest16915-21ssh22:56:510
648299230,22cyclictest16205-21ssh21:55:010
648299230,22cyclictest1196-21ssh22:12:010
648299230,0cyclictest32533-21diskmemload00:17:300
648299230,0cyclictest0-21swapper/000:10:570
6495992222,0cyclictest0-21swapper/322:37:143
6495992221,1cyclictest15086-21ssh00:24:073
6495992220,1cyclictest26771-21ssh23:05:043
6495992220,1cyclictest0-21swapper/322:52:403
6495992220,1cyclictest0-21swapper/320:45:003
6495992219,2cyclictest774-21runrttasks21:53:283
649599220,2cyclictest2196-21tune2fs22:43:113
649599220,2cyclictest20480-21ssh23:59:173
649599220,22cyclictest0-21swapper/322:33:333
649599220,21cyclictest516-21ssh21:10:163
649599220,21cyclictest28539-21ssh00:37:543
649599220,21cyclictest0-21swapper/320:08:093
649599220,1cyclictest32533-21diskmemload22:14:213
649599220,1cyclictest0-21swapper/300:16:353
649599220,0cyclictest0-21swapper/321:31:013
6490992222,0cyclictest0-21swapper/220:38:092
6490992220,1cyclictest6025-21sh21:15:272
6490992220,1cyclictest0-21swapper/223:10:462
6490992220,1cyclictest0-21swapper/222:45:502
6490992220,1cyclictest0-21swapper/222:35:502
6490992220,1cyclictest0-21swapper/222:32:192
6490992220,1cyclictest0-21swapper/222:00:102
6490992220,1cyclictest0-21swapper/221:20:182
649099220,21cyclictest622-21gdbus20:25:012
649099220,21cyclictest27204-21ssh22:05:322
649099220,21cyclictest0-21swapper/223:26:402
649099220,21cyclictest0-21swapper/222:55:002
649099220,21cyclictest0-21swapper/222:10:542
649099220,21cyclictest0-21swapper/219:18:092
649099220,1cyclictest26515-21perf23:05:002
649099220,1cyclictest23317-21munin-run19:45:002
649099220,1cyclictest17480-21ssh00:27:222
6485992222,0cyclictest0-21swapper/122:50:591
6485992222,0cyclictest0-21swapper/122:35:171
6485992222,0cyclictest0-21swapper/121:03:101
6485992220,2cyclictest1358-21ssh21:11:211
6485992220,1cyclictest0-21swapper/123:55:381
648599220,21cyclictest32548-21apt21:10:011
648599220,21cyclictest0-21swapper/123:16:071
648599220,21cyclictest0-21swapper/122:25:341
648599220,21cyclictest0-21swapper/100:15:321
648599220,1cyclictest5201-21ssh22:45:291
648599220,1cyclictest10747-21sh00:20:131
648599220,0cyclictest0-21swapper/123:46:221
648599220,0cyclictest0-21swapper/121:20:031
6482992222,0cyclictest32533-21diskmemload21:47:270
6482992222,0cyclictest0-21swapper/023:06:330
6482992222,0cyclictest0-21swapper/021:50:150
6482992221,1cyclictest5223-21ssh22:45:310
6482992221,1cyclictest18263-21apt-get20:43:090
6482992221,1cyclictest10606-21ssh21:19:390
6482992221,1cyclictest0-21swapper/022:05:520
6482992219,2cyclictest313-21systemd-journal20:20:010
648299220,21cyclictest10500-21dump-pmu-power20:25:010
648299220,21cyclictest0-21swapper/021:30:040
648299220,21cyclictest0-21swapper/020:50:000
648299220,1cyclictest16535-21ssh23:25:310
648299220,1cyclictest0-21swapper/019:40:000
648299220,0cyclictest0-21swapper/023:42:490
648299220,0cyclictest0-21swapper/000:20:300
649599210,21cyclictest0-21swapper/321:55:073
649599210,20cyclictest0-21swapper/319:48:093
649599210,0cyclictest0-21swapper/321:00:023
6490992120,1cyclictest0-21swapper/219:25:012
6490992120,0cyclictest0-21swapper/220:53:092
649099210,20cyclictest0-21swapper/219:48:092
6485992121,0cyclictest0-21swapper/120:58:101
6485992121,0cyclictest0-21swapper/119:13:081
648599210,21cyclictest0-21swapper/123:26:551
648599210,20cyclictest20660-21apt-get20:48:101
648599210,1cyclictest24945-21turbostat20:55:011
648599210,0cyclictest23804-21apt-get19:48:091
648599210,0cyclictest0-21swapper/122:40:341
648599210,0cyclictest0-21swapper/120:38:091
648599210,0cyclictest0-21swapper/120:23:091
648599210,0cyclictest0-21swapper/120:03:091
648599210,0cyclictest0-21swapper/119:50:021
648599210,0cyclictest0-21swapper/119:18:091
6482992120,1cyclictest26592-21apt-get19:53:070
648299210,21cyclictest32533-21diskmemload23:56:070
648299210,21cyclictest0-21swapper/021:08:100
648299210,20cyclictest0-21swapper/020:13:090
648299210,0cyclictest13398-21apt-get20:33:090
6495992020,0cyclictest0-21swapper/320:03:103
6495992019,1cyclictest27363-21apt-get21:00:013
6495992018,1cyclictest15793-21apt-get20:38:093
649599200,0cyclictest0-21swapper/320:18:103
6490992020,0cyclictest30657-21apt-get21:08:102
6490992020,0cyclictest0-21swapper/220:58:102
649099200,0cyclictest0-21swapper/220:28:102
649099200,0cyclictest0-21swapper/219:38:082
6485992020,0cyclictest0-21swapper/119:38:081
6485992020,0cyclictest0-21swapper/119:28:081
6482992020,0cyclictest0-21swapper/020:53:100
648299200,0cyclictest0-21swapper/020:08:090
6495991918,0cyclictest0-21swapper/319:28:083
6495991917,1cyclictest18509-21munin-run19:35:013
6495991917,1cyclictest11749-21apt-get19:23:083
6490991919,0cyclictest0-21swapper/220:33:102
6490991919,0cyclictest0-21swapper/220:10:012
6490991918,1cyclictest0-21swapper/220:18:102
6485991919,0cyclictest0-21swapper/119:58:091
6482991919,0cyclictest0-21swapper/019:48:090
6482991919,0cyclictest0-21swapper/019:28:080
6490991818,0cyclictest31408-21apt-get20:03:102
6490991817,1cyclictest0-21swapper/221:00:022
6485991818,0cyclictest0-21swapper/120:08:091
6485991816,1cyclictest16592-21apt-get19:33:081
6485991816,1cyclictest12881-21cron20:30:001
6482991818,0cyclictest6936-21apt-get19:13:080
6495991717,0cyclictest0-21swapper/320:48:103
6495991717,0cyclictest0-21swapper/319:50:023
6495991715,1cyclictest30859-21cron20:00:003
6490991717,0cyclictest0-21swapper/220:13:082
6490991716,1cyclictest14142-21apt-get19:28:082
6485991716,0cyclictest6183-21apt-get20:18:101
6485991716,0cyclictest3785-21apt-get20:13:091
6485991715,1cyclictest20135-21cron20:45:001
6482991716,1cyclictest0-21swapper/020:38:090
6495991616,0cyclictest0-21swapper/320:53:093
6495991614,1cyclictest0-21swapper/320:23:153
6490991616,0cyclictest0-21swapper/219:13:082
649099161,1cyclictest18313-21users19:33:182
649099160,1cyclictest0-21swapper/220:48:112
6482991616,0cyclictest0-21swapper/020:03:100
648299160,15cyclictest23314-21perf19:45:000
649599150,14cyclictest0-21swapper/320:28:133
6490991513,1cyclictest19872-21sed20:43:182
6485991515,0cyclictest21405-21apt-get19:43:071
648299153,6cyclictest30967-21munin-run20:00:010
6482991515,0cyclictest25451-21apt-get20:58:100
6482991513,1cyclictest29312-21ntp_states21:03:150
6495991414,0cyclictest0-21swapper/320:10:093
649599140,14cyclictest0-21swapper/320:30:233
649599140,14cyclictest0-21swapper/319:40:483
649599140,14cyclictest0-21swapper/319:10:153
649599140,0cyclictest0-21swapper/319:17:303
648599140,14cyclictest0-21swapper/120:31:131
6482991414,0cyclictest0-21swapper/019:30:220
6482991414,0cyclictest0-21swapper/019:15:130
648299140,14cyclictest0-21swapper/020:25:470
648299140,14cyclictest0-21swapper/019:20:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional