You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 05:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 12, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
952699260,25cyclictest15873-21sh22:24:550
9532992523,1cyclictest13922-21munin-run21:20:013
952799250,24cyclictest16536-21ssh23:29:231
9532992423,1cyclictest0-21swapper/322:04:413
9532992422,1cyclictest3164-21diskmemload00:20:003
953299240,23cyclictest0-21swapper/321:30:573
953299240,1cyclictest0-21swapper/322:41:143
952999240,23cyclictest30197-21sh21:35:312
952999240,1cyclictest8624-21ssh22:19:132
9527992424,0cyclictest0-21swapper/122:51:091
9527992422,1cyclictest15190-21apt-get00:30:021
952799240,24cyclictest0-21swapper/123:58:291
952799240,24cyclictest0-21swapper/123:46:531
952799240,24cyclictest0-21swapper/121:20:251
952699240,24cyclictest3164-21diskmemload21:25:550
952699240,24cyclictest0-21swapper/023:26:360
952699240,24cyclictest0-21swapper/022:25:160
952699240,24cyclictest0-21swapper/000:36:140
952699240,23cyclictest3164-21diskmemload23:58:420
952699240,23cyclictest3164-21diskmemload23:49:410
952699240,23cyclictest3164-21diskmemload00:16:200
952699240,23cyclictest0-21swapper/021:51:480
952699240,23cyclictest0-21swapper/000:04:480
952699240,0cyclictest0-21swapper/022:49:250
9532992323,0cyclictest3164-21diskmemload22:21:043
9532992323,0cyclictest3164-21diskmemload00:27:583
9532992323,0cyclictest0-21swapper/322:18:143
9532992323,0cyclictest0-21swapper/321:56:073
9532992323,0cyclictest0-21swapper/300:05:493
9532992321,1cyclictest0-21swapper/321:50:113
9532992320,2cyclictest8616-21rm21:46:303
953299230,23cyclictest3164-21diskmemload23:43:393
953299230,23cyclictest0-21swapper/322:31:153
953299230,22cyclictest6299-21apt-get23:19:243
953299230,22cyclictest0-21swapper/323:57:423
953299230,22cyclictest0-21swapper/300:00:473
953299230,0cyclictest3164-21diskmemload23:02:193
953299230,0cyclictest0-21swapper/322:35:383
953299230,0cyclictest0-21swapper/322:14:173
953299230,0cyclictest0-21swapper/321:36:343
9529992323,0cyclictest3164-21diskmemload00:16:342
9529992323,0cyclictest0-21swapper/222:24:552
9529992323,0cyclictest0-21swapper/200:23:552
9529992322,1cyclictest5606-21rm22:45:462
952999230,23cyclictest0-21swapper/223:45:102
952999230,23cyclictest0-21swapper/222:52:052
952999230,23cyclictest0-21swapper/222:30:572
952999230,23cyclictest0-21swapper/222:03:252
952999230,23cyclictest0-21swapper/221:51:102
952999230,23cyclictest0-21swapper/221:48:562
952999230,23cyclictest0-21swapper/221:32:322
952999230,23cyclictest0-21swapper/221:20:482
952999230,23cyclictest0-21swapper/200:00:512
952999230,22cyclictest22022-21diskmemload23:02:262
952999230,0cyclictest0-21swapper/200:14:172
9527992323,0cyclictest0-21swapper/123:35:581
9527992323,0cyclictest0-21swapper/121:53:401
9527992321,1cyclictest9992-21ssh21:16:331
9527992321,1cyclictest9093-21sh23:53:241
9527992321,1cyclictest18932-21apt-get21:25:021
9527992321,1cyclictest0-21swapper/122:25:141
9527992321,1cyclictest0-21swapper/122:22:451
9527992320,2cyclictest23772-21dpkg20:45:021
952799230,2cyclictest21063-21ssh21:59:261
952799230,23cyclictest0-21swapper/123:31:051
952799230,23cyclictest0-21swapper/121:40:071
952799230,23cyclictest0-21swapper/100:26:471
952799230,22cyclictest5306-21ssh00:20:111
952799230,22cyclictest29774-21sh00:13:501
952799230,22cyclictest1698-21rm22:42:391
952799230,22cyclictest16979-21ssh22:57:301
952799230,22cyclictest0-21swapper/123:11:311
952799230,0cyclictest8222-21ssh21:45:551
952799230,0cyclictest3164-21diskmemload23:05:591
952799230,0cyclictest0-21swapper/122:14:521
952799230,0cyclictest0-21swapper/122:09:041
952799230,0cyclictest0-21swapper/100:09:581
9526992323,0cyclictest0-21swapper/023:34:150
9526992323,0cyclictest0-21swapper/022:09:040
9526992322,1cyclictest62550irq/127-eno122:16:590
9526992322,1cyclictest3164-21diskmemload23:03:270
952699232,1cyclictest62550irq/127-eno100:21:280
9526992321,2cyclictest0-21swapper/022:54:470
9526992321,1cyclictest0-21swapper/022:01:230
9526992321,1cyclictest0-21swapper/021:35:350
9526992321,1cyclictest0-21swapper/021:25:010
9526992320,2cyclictest0-21swapper/022:58:290
952699230,23cyclictest0-21swapper/000:11:340
952699230,22cyclictest23055-21sh00:06:120
952699230,22cyclictest0-21swapper/023:17:070
952699230,22cyclictest0-21swapper/022:41:360
952699230,22cyclictest0-21swapper/022:36:460
952699230,22cyclictest0-21swapper/021:47:270
952699230,22cyclictest0-21swapper/021:31:310
952699230,22cyclictest0-21swapper/021:17:330
952699230,21cyclictest13279-21ssh23:24:370
952699230,0cyclictest0-21swapper/021:11:580
9532992222,0cyclictest0-21swapper/323:38:203
9532992222,0cyclictest0-21swapper/322:56:323
9532992222,0cyclictest0-21swapper/300:20:523
9532992221,1cyclictest7888-21apt-get22:49:233
953299220,21cyclictest3164-21diskmemload23:45:293
953299220,21cyclictest0-21swapper/323:20:343
953299220,21cyclictest0-21swapper/322:52:193
953299220,21cyclictest0-21swapper/322:26:033
953299220,1cyclictest6209-21ssh21:13:493
953299220,1cyclictest3164-21diskmemload00:14:233
953299220,1cyclictest29583-21sh22:07:223
953299220,1cyclictest0-21swapper/323:30:293
953299220,1cyclictest0-21swapper/323:25:153
953299220,0cyclictest0-21swapper/321:40:243
9529992222,0cyclictest3164-21diskmemload23:58:022
9529992222,0cyclictest3164-21diskmemload23:16:462
9529992222,0cyclictest3164-21diskmemload22:25:422
9529992222,0cyclictest3164-21diskmemload00:36:502
9529992222,0cyclictest0-21swapper/223:38:592
9529992222,0cyclictest0-21swapper/222:42:382
9529992222,0cyclictest0-21swapper/222:39:512
9529992222,0cyclictest0-21swapper/222:07:492
9529992221,1cyclictest3164-21diskmemload23:41:272
9529992220,2cyclictest22540-21sh00:05:262
9529992220,1cyclictest20099-21ssh21:25:482
952999220,22cyclictest10755-21sh23:23:212
952999220,22cyclictest0-21swapper/221:55:062
952999220,21cyclictest3977-21ssh21:10:142
952999220,21cyclictest32132-21apt-get19:59:232
952999220,21cyclictest26688-21dump-pmu-power19:45:012
952999220,21cyclictest10552-21ssh00:25:252
952999220,21cyclictest0-21swapper/221:40:432
952999220,1cyclictest20849-21ssh23:33:182
952999220,1cyclictest17815-21ssh00:33:122
952999220,1cyclictest0-21swapper/223:10:012
952999220,0cyclictest0-21swapper/223:53:092
952999220,0cyclictest0-21swapper/223:13:062
9527992222,0cyclictest0-21swapper/121:04:241
9527992221,1cyclictest3164-21diskmemload21:35:431
9527992220,1cyclictest8496-21sendmail23:20:001
9527992220,1cyclictest5267-21ssh22:45:061
9527992220,1cyclictest10075-21apt-get19:14:211
9527992220,1cyclictest0-21swapper/121:14:351
9527992220,1cyclictest0-21swapper/119:44:231
952799220,22cyclictest0-21swapper/100:18:411
952799220,21cyclictest22782-21rm22:31:371
952799220,21cyclictest20081-21apt-get19:34:221
952799220,21cyclictest0-21swapper/123:21:501
952799220,21cyclictest0-21swapper/100:35:011
952799220,1cyclictest3164-21diskmemload22:19:391
9526992222,0cyclictest0-21swapper/023:11:130
9526992222,0cyclictest0-21swapper/023:05:590
9526992222,0cyclictest0-21swapper/000:31:350
9526992220,1cyclictest30811-21sendmail-msp21:00:000
9526992220,1cyclictest14274-21awk19:20:000
9526992220,1cyclictest0-21swapper/023:50:210
9526992220,1cyclictest0-21swapper/000:25:390
9526992214,3cyclictest622-21gdbus20:45:010
952699220,21cyclictest24121-21ssh23:35:170
952699220,21cyclictest15948-21munin-run20:30:010
952699220,21cyclictest0-21swapper/023:40:530
952699220,21cyclictest0-21swapper/022:30:400
952699220,21cyclictest0-21swapper/021:55:160
952699220,1cyclictest2985-21sh22:13:250
952699220,0cyclictest0-21swapper/021:43:460
9532992119,1cyclictest18311-21cron20:35:013
9532992119,1cyclictest0-21swapper/319:15:013
953299210,21cyclictest3164-21diskmemload21:20:593
953299210,21cyclictest0-21swapper/323:51:123
953299210,21cyclictest0-21swapper/323:06:123
953299210,20cyclictest3164-21diskmemload21:25:063
953299210,20cyclictest27288-21apt-get19:49:243
953299210,0cyclictest0-21swapper/323:11:173
953299210,0cyclictest0-21swapper/319:59:233
953299210,0cyclictest0-21swapper/300:30:043
9529992121,0cyclictest0-21swapper/223:26:442
9529992121,0cyclictest0-21swapper/221:16:102
9529992120,1cyclictest5652-21ssh22:14:552
952999210,21cyclictest0-21swapper/222:55:022
952999210,0cyclictest0-21swapper/221:04:242
9527992120,1cyclictest4532-21apt-get20:09:231
9527992119,1cyclictest14262-21apt-get19:20:021
9527992118,2cyclictest23189-21rm22:00:151
9527992118,2cyclictest23153-21awk20:45:011
952799210,21cyclictest0-21swapper/121:30:481
952799210,0cyclictest0-21swapper/123:42:191
9526992120,1cyclictest31548-21munin-run19:55:010
9532992020,0cyclictest17680-21apt-get19:29:213
9532992020,0cyclictest0-21swapper/320:54:233
9532992020,0cyclictest0-21swapper/320:09:233
953299200,0cyclictest0-21swapper/320:59:233
953299200,0cyclictest0-21swapper/319:20:023
9529992020,0cyclictest14140-21apt-get20:29:232
9529992019,1cyclictest16539-21apt-get20:34:232
952999200,0cyclictest12475-21apt-get19:19:232
9527992020,0cyclictest0-21swapper/119:49:241
9527992020,0cyclictest0-21swapper/119:39:221
9527992017,2cyclictest14287-21awk19:20:001
952799200,19cyclictest28933-21apt-get20:59:231
952799200,0cyclictest31546-21perf19:55:011
952799200,0cyclictest0-21swapper/120:24:251
952799200,0cyclictest0-21swapper/120:04:231
9526992020,0cyclictest0-21swapper/021:04:240
9526992020,0cyclictest0-21swapper/020:24:250
9526992020,0cyclictest0-21swapper/019:34:220
9532991919,0cyclictest0-21swapper/320:04:233
9532991918,0cyclictest0-21swapper/321:09:243
9532991918,0cyclictest0-21swapper/320:29:243
9532991917,1cyclictest24281-21turbostat19:40:003
952999190,19cyclictest0-21swapper/219:34:332
952799190,18cyclictest0-21swapper/119:29:211
9526991919,0cyclictest0-21swapper/020:04:230
9526991919,0cyclictest0-21swapper/019:39:220
9526991919,0cyclictest0-21swapper/019:14:210
9526991918,1cyclictest0-21swapper/019:59:230
9526991918,1cyclictest0-21swapper/019:24:210
9526991918,0cyclictest0-21swapper/020:45:020
9532991817,1cyclictest24143-21apt-get20:49:233
9532991816,2cyclictest0-21swapper/320:19:243
952999189,4cyclictest606-21dbus-daemon20:45:012
9529991817,1cyclictest8731-21perf20:15:002
9529991816,1cyclictest3945-21munin-run20:05:002
9529991816,1cyclictest30819-21munin-run21:00:002
9529991816,1cyclictest0-21swapper/219:55:012
952999180,17cyclictest0-21swapper/219:49:242
9527991818,0cyclictest0-21swapper/119:59:231
9527991816,1cyclictest8729-21idleruntime-cro20:15:001
9526991818,0cyclictest0-21swapper/020:09:230
9526991818,0cyclictest0-21swapper/019:49:240
9526991818,0cyclictest0-21swapper/019:44:230
9532991716,1cyclictest24893-21apt-get19:44:233
9532991716,1cyclictest18936-21apt-get20:39:253
9532991715,1cyclictest21878-21turbostat19:35:003
9529991717,0cyclictest0-21swapper/221:09:242
9529991717,0cyclictest0-21swapper/220:39:252
9527991717,0cyclictest26539-21apt-get20:54:231
9527991717,0cyclictest0-21swapper/120:34:231
953299164,11cyclictest783-21snmpd19:53:323
9532991614,1cyclictest0-21swapper/320:44:253
9529991616,0cyclictest0-21swapper/220:54:232
9529991616,0cyclictest0-21swapper/220:24:252
9529991616,0cyclictest0-21swapper/220:09:232
9529991614,1cyclictest23158-21apt-get20:45:022
9526991614,1cyclictest8721-21apt20:15:000
9526991614,1cyclictest1375-21apt-get21:09:240
9526991614,1cyclictest0-21swapper/019:25:500
9532991513,1cyclictest8765-21date20:15:003
9529991515,0cyclictest0-21swapper/219:14:212
9529991514,1cyclictest0-21swapper/219:24:212
952799150,1cyclictest3203-21munin-run21:10:001
9526991515,0cyclictest0-21swapper/020:54:230
9526991515,0cyclictest0-21swapper/020:34:230
953299140,14cyclictest0-21swapper/321:00:123
953299140,14cyclictest0-21swapper/320:20:333
953299140,0cyclictest0-21swapper/319:15:433
952999140,14cyclictest0-21swapper/220:15:142
952999140,14cyclictest0-21swapper/219:36:242
952999140,14cyclictest0-21swapper/219:25:562
952799140,14cyclictest0-21swapper/120:15:271
952799140,0cyclictest0-21swapper/120:25:161
9526991414,0cyclictest0-21swapper/020:15:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional