You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 06:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 08, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8210992623,3cyclictest0-21swapper/221:33:532
8210992620,5cyclictest1024-21switchtime21:36:562
821099260,25cyclictest0-21swapper/221:10:122
821099260,25cyclictest0-21swapper/221:10:122
821099260,23cyclictest0-21swapper/223:38:302
8210992522,3cyclictest0-21swapper/221:49:072
8210992522,3cyclictest0-21swapper/200:01:382
8210992521,3cyclictest1428-21diskmemload22:39:572
821099250,24cyclictest26332-21sh00:23:182
821099250,24cyclictest22366-21ssh22:25:562
821099250,24cyclictest11906-21ssh23:12:512
821099250,24cyclictest0-21swapper/222:46:432
821099250,21cyclictest0-21swapper/223:09:492
820999250,24cyclictest1428-21diskmemload00:27:081
820999250,24cyclictest0-21swapper/121:10:591
820999250,24cyclictest0-21swapper/121:10:591
820999250,1cyclictest27274-21ssh00:24:371
820899250,24cyclictest1428-21diskmemload23:35:300
820899250,24cyclictest1428-21diskmemload22:44:440
820899250,1cyclictest1428-21diskmemload00:04:130
8211992422,1cyclictest0-21swapper/300:38:233
821199240,24cyclictest1428-21diskmemload22:19:053
821199240,24cyclictest0-21swapper/323:35:303
821199240,23cyclictest21399-21sh23:21:483
821199240,23cyclictest0-21swapper/321:21:373
821199240,1cyclictest0-21swapper/300:26:323
821199240,0cyclictest0-21swapper/300:18:183
8210992420,3cyclictest0-21swapper/223:51:092
8210992418,5cyclictest0-21swapper/222:41:542
821099240,23cyclictest0-21swapper/221:57:052
821099240,23cyclictest0-21swapper/221:57:052
821099240,23cyclictest0-21swapper/221:20:062
821099240,23cyclictest0-21swapper/200:12:452
821099240,21cyclictest1428-21diskmemload00:28:012
821099240,0cyclictest0-21swapper/222:58:552
821099240,0cyclictest0-21swapper/222:21:472
821099240,0cyclictest0-21swapper/200:32:082
8209992423,1cyclictest1428-21diskmemload23:49:351
8209992423,1cyclictest0-21swapper/123:04:231
820999240,24cyclictest1428-21diskmemload21:41:091
820999240,23cyclictest1428-21diskmemload22:12:451
820999240,23cyclictest10031-21sh21:46:001
820999240,23cyclictest0-21swapper/123:56:231
820999240,23cyclictest0-21swapper/100:00:131
820999240,0cyclictest0-21swapper/122:20:301
820999240,0cyclictest0-21swapper/121:37:251
8208992423,0cyclictest1428-21diskmemload22:48:470
8208992422,2cyclictest0-21swapper/022:29:180
8208992422,1cyclictest15856-21sh00:14:250
8208992422,1cyclictest0-21swapper/021:22:540
820899240,2cyclictest31814-21rm23:31:450
820899240,24cyclictest1428-21diskmemload23:05:360
820899240,23cyclictest1428-21diskmemload23:14:200
820899240,22cyclictest0-21swapper/021:14:580
820899240,22cyclictest0-21swapper/021:14:580
820899240,0cyclictest0-21swapper/022:19:050
8211992323,0cyclictest0-21swapper/323:46:293
8211992323,0cyclictest0-21swapper/323:17:513
8211992323,0cyclictest0-21swapper/323:11:133
8211992323,0cyclictest0-21swapper/322:49:093
8211992323,0cyclictest0-21swapper/321:50:533
8211992323,0cyclictest0-21swapper/300:05:563
8211992322,1cyclictest14998-21apt-get20:31:443
8211992321,1cyclictest1428-21diskmemload00:31:523
8211992321,1cyclictest0-21swapper/322:52:503
8211992321,1cyclictest0-21swapper/321:26:213
8211992321,1cyclictest0-21swapper/321:10:443
8211992321,1cyclictest0-21swapper/321:10:443
821199230,23cyclictest0-21swapper/323:55:153
821199230,22cyclictest8323-21diskmemload21:15:383
821199230,22cyclictest31810-21apt-get23:31:453
821199230,22cyclictest26634-21sh00:23:413
821199230,22cyclictest26322-21cron23:55:003
821199230,22cyclictest25412-21ssh23:25:463
821199230,22cyclictest22119-21ssh22:25:363
821199230,22cyclictest10786-21cstates21:46:453
821199230,22cyclictest0-21swapper/300:11:033
821199230,22cyclictest0-21swapper/300:01:443
821199230,0cyclictest0-21swapper/323:05:363
821199230,0cyclictest0-21swapper/322:40:243
821199230,0cyclictest0-21swapper/322:37:423
8210992323,0cyclictest0-21swapper/223:17:512
8210992323,0cyclictest0-21swapper/222:51:032
8210992322,1cyclictest9065-21ssh21:16:332
8210992322,1cyclictest1428-21diskmemload22:32:412
8210992320,2cyclictest0-21swapper/223:01:422
821099230,23cyclictest1428-21diskmemload23:59:502
821099230,23cyclictest0-21swapper/223:43:502
821099230,22cyclictest31913-21ssh22:05:142
821099230,22cyclictest24799-21ls21:30:002
821099230,22cyclictest22635-21munin-run19:40:012
821099230,22cyclictest1428-21diskmemload23:21:492
821099230,20cyclictest0-21swapper/223:26:272
821099230,0cyclictest26559-21ssh22:00:312
821099230,0cyclictest1428-21diskmemload23:46:162
821099230,0cyclictest0-21swapper/222:15:202
821099230,0cyclictest0-21swapper/222:12:262
8209992323,0cyclictest0-21swapper/123:39:031
8209992323,0cyclictest0-21swapper/100:30:451
8209992321,1cyclictest0-21swapper/122:45:031
820999231,22cyclictest152491phc2sys19:41:441
820999230,2cyclictest24453-21sh23:52:221
820999230,23cyclictest0-21swapper/123:11:011
820999230,23cyclictest0-21swapper/122:15:301
820999230,23cyclictest0-21swapper/121:15:431
820999230,23cyclictest0-21swapper/100:17:371
820999230,22cyclictest28836-21sh21:32:441
820999230,22cyclictest27419-21perf19:50:011
820999230,22cyclictest24683-21sh23:24:591
820999230,22cyclictest23290-21ssh22:55:021
820999230,22cyclictest1696-21apt-get22:36:451
820999230,22cyclictest0-21swapper/123:29:141
820999230,22cyclictest0-21swapper/123:05:011
820999230,22cyclictest0-21swapper/120:56:421
820999230,1cyclictest0-21swapper/123:32:231
820999230,0cyclictest0-21swapper/122:50:591
820999230,0cyclictest0-21swapper/122:26:441
820999230,0cyclictest0-21swapper/100:09:351
8208992323,0cyclictest0-21swapper/023:46:290
8208992323,0cyclictest0-21swapper/022:35:480
8208992323,0cyclictest0-21swapper/021:50:530
8208992323,0cyclictest0-21swapper/000:38:230
8208992323,0cyclictest0-21swapper/000:05:560
8208992322,1cyclictest62550irq/127-eno100:17:310
8208992322,1cyclictest1428-21diskmemload22:08:550
8208992321,1cyclictest0-21swapper/021:30:570
8208992320,2cyclictest10551-21apt19:15:000
820899230,2cyclictest21216-21ssh21:26:470
820899230,23cyclictest0-21swapper/023:55:150
820899230,23cyclictest0-21swapper/023:53:430
820899230,23cyclictest0-21swapper/021:36:550
820899230,22cyclictest29117-21apt-get00:26:450
820899230,22cyclictest21040-21rm22:24:320
820899230,22cyclictest10444-21ssh23:41:060
820899230,22cyclictest0-21swapper/023:01:320
820899230,22cyclictest0-21swapper/000:20:440
820899230,0cyclictest1428-21diskmemload22:31:310
820899230,0cyclictest1428-21diskmemload21:46:470
820899230,0cyclictest0-21swapper/022:55:250
8211992222,0cyclictest0-21swapper/322:06:203
8211992221,1cyclictest0-21swapper/321:33:203
8211992221,0cyclictest0-21swapper/320:41:453
8211992220,1cyclictest9156-21runrttasks22:13:173
821199220,22cyclictest0-21swapper/322:55:253
821199220,21cyclictest5389-21apt-get20:11:453
821199220,21cyclictest28268-21sh22:31:163
821199220,21cyclictest26297-21sh22:00:123
821199220,21cyclictest25035-21perf19:45:013
821199220,21cyclictest0-21swapper/323:41:493
821199220,21cyclictest0-21swapper/323:01:323
821199220,21cyclictest0-21swapper/320:01:443
821199220,1cyclictest2284-21ssh21:38:153
821199220,1cyclictest20154-21latency_hist19:35:013
821199220,1cyclictest1428-21diskmemload21:41:323
821199220,0cyclictest0-21swapper/322:24:443
8210992222,0cyclictest0-21swapper/221:40:022
8210992221,1cyclictest30687-21ssh23:30:122
8210992220,2cyclictest0-21swapper/200:35:412
8210992220,2cyclictest0-21swapper/200:15:322
8210992220,1cyclictest17015-21perf20:35:012
821099220,21cyclictest536-21awk20:01:442
821099220,21cyclictest22259-21apt-get20:46:442
821099220,21cyclictest15769-21rm21:51:082
821099220,1cyclictest5581-21ssh00:05:122
821099220,1cyclictest15745-21apt-get19:26:422
8209992222,0cyclictest1428-21diskmemload22:42:071
8209992222,0cyclictest1428-21diskmemload21:23:381
8209992222,0cyclictest0-21swapper/100:13:251
8209992220,1cyclictest21323-21ssh21:55:581
8209992220,1cyclictest21323-21ssh21:55:581
8209992220,1cyclictest0-21swapper/123:16:521
8209992220,1cyclictest0-21swapper/122:05:321
8209992220,1cyclictest0-21swapper/121:50:191
820999220,22cyclictest14773-21sh23:44:401
820999220,21cyclictest550-21apt-get20:01:441
820999220,21cyclictest0-21swapper/120:31:441
820999220,21cyclictest0-21swapper/120:06:431
820999220,21cyclictest0-21swapper/100:35:141
820999220,0cyclictest0-21swapper/122:30:281
8208992221,1cyclictest0-21swapper/021:18:290
8208992221,0cyclictest0-21swapper/021:57:320
8208992221,0cyclictest0-21swapper/021:57:320
8208992220,1cyclictest26656-21turbostat20:55:000
8208992220,1cyclictest0-21swapper/022:12:220
820899220,21cyclictest26428-21sh22:00:210
820899220,21cyclictest0-21swapper/023:16:150
820899220,21cyclictest0-21swapper/021:40:160
820899220,21cyclictest0-21swapper/020:21:450
820899220,21cyclictest0-21swapper/020:21:450
820899220,1cyclictest0-21swapper/023:20:170
820899220,0cyclictest0-21swapper/022:51:410
820899220,0cyclictest0-21swapper/019:41:440
8211992121,0cyclictest0-21swapper/321:57:323
8211992121,0cyclictest0-21swapper/321:57:323
8211992119,1cyclictest622-21gdbus20:55:003
8211992119,1cyclictest10552-21latency_hist19:15:003
8210992121,0cyclictest0-21swapper/221:06:462
821099210,20cyclictest29077-21perf21:00:002
821099210,20cyclictest0-21swapper/219:41:442
821099210,20cyclictest0-21swapper/219:31:432
821099210,0cyclictest24650-21apt-get20:51:432
8209992121,0cyclictest0-21swapper/120:55:001
8209992119,1cyclictest0-21swapper/120:00:001
820999210,20cyclictest0-21swapper/120:36:431
820999210,20cyclictest0-21swapper/119:31:441
820999210,0cyclictest20598-21apt-get19:36:451
820999210,0cyclictest0-21swapper/119:51:441
8208992121,0cyclictest0-21swapper/021:01:430
8208992121,0cyclictest0-21swapper/019:16:440
8208992120,0cyclictest0-21swapper/019:26:420
820899210,21cyclictest5012-21perf20:10:000
820899210,21cyclictest0-21swapper/023:25:110
820899210,21cyclictest0-21swapper/020:45:000
820899210,0cyclictest0-21swapper/020:11:450
820899210,0cyclictest0-21swapper/020:01:440
8211992020,0cyclictest30594-21apt-get19:56:453
8211992020,0cyclictest0-21swapper/321:01:433
8211992020,0cyclictest0-21swapper/319:36:453
8211992020,0cyclictest0-21swapper/319:16:443
8211992018,1cyclictest25402-21apt-get19:46:423
8210992020,0cyclictest0-21swapper/219:50:022
8210992019,1cyclictest21869-21perf20:45:002
821099200,0cyclictest0-21swapper/219:16:442
8209992020,0cyclictest0-21swapper/120:26:431
8208992020,0cyclictest0-21swapper/020:16:440
8208992020,0cyclictest0-21swapper/019:56:450
8208992019,1cyclictest27406-21apt-get19:50:020
8211991919,0cyclictest0-21swapper/320:16:443
8211991919,0cyclictest0-21swapper/319:26:423
8211991918,1cyclictest13355-21apt-get19:21:433
8211991918,0cyclictest12601-21apt-get20:26:433
8211991917,1cyclictest30206-21munin-run19:55:003
8210991918,1cyclictest32570-21cron20:00:002
8210991917,1cyclictest31490-21munin-run21:05:002
8209991917,1cyclictest0-21swapper/121:10:001
8209991917,1cyclictest0-21swapper/119:25:001
8208991919,0cyclictest0-21swapper/020:46:440
8208991919,0cyclictest0-21swapper/020:26:430
8211991818,0cyclictest0-21swapper/320:46:443
8210991817,1cyclictest0-21swapper/220:11:452
8210991817,0cyclictest0-21swapper/219:11:432
821099180,1cyclictest0-21swapper/220:26:432
8209991818,0cyclictest0-21swapper/119:26:421
8208991818,0cyclictest0-21swapper/020:36:440
8208991818,0cyclictest0-21swapper/019:46:420
8208991818,0cyclictest0-21swapper/019:21:430
8211991717,0cyclictest0-21swapper/320:36:443
8211991717,0cyclictest0-21swapper/320:21:453
8211991717,0cyclictest0-21swapper/320:21:453
8210991717,0cyclictest0-21swapper/219:46:422
821099170,1cyclictest0-21swapper/220:08:512
8209991717,0cyclictest0-21swapper/120:21:451
8209991717,0cyclictest0-21swapper/120:21:451
8209991715,1cyclictest29463-21apt-get21:01:431
8211991614,1cyclictest0-21swapper/320:56:453
8210991616,0cyclictest17393-21apt-get20:36:432
8210991614,1cyclictest12221-21perf20:25:012
8210991614,1cyclictest12221-21perf20:25:012
8209991616,0cyclictest0-21swapper/120:11:451
8209991616,0cyclictest0-21swapper/119:16:441
8209991615,1cyclictest19813-21apt-get20:41:451
8209991613,2cyclictest22444-21cpuspeed_turbos20:46:451
8208991615,0cyclictest0-21swapper/020:31:440
8208991614,1cyclictest31866-21apt-get21:06:460
8211991515,0cyclictest0-21swapper/320:06:433
8211991513,1cyclictest0-21swapper/321:10:013
8210991513,1cyclictest14400-21ntp_states19:21:492
8208991514,1cyclictest0-21swapper/020:56:450
820899150,7cyclictest0-21swapper/019:31:430
821099140,0cyclictest0-21swapper/220:15:552
8209991414,0cyclictest0-21swapper/120:15:381
820999140,0cyclictest0-21swapper/119:12:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional