You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 10:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 04, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28149992927,1cyclictest0-21swapper/223:21:092
2815099250,1cyclictest23376-21ssh21:42:433
2813899250,24cyclictest22951-21diskmemload22:09:000
2813899250,24cyclictest22951-21diskmemload21:56:180
2813899250,23cyclictest0-21swapper/021:31:140
28150992421,2cyclictest3278-21ssh22:58:083
2815099240,23cyclictest22951-21diskmemload22:33:443
28149992421,3cyclictest0-21swapper/223:15:402
2814999240,23cyclictest30414-21ssh22:52:482
2814999240,1cyclictest22951-21diskmemload21:41:142
2814599240,24cyclictest0-21swapper/122:32:241
2814599240,23cyclictest0-21swapper/122:42:131
2814599240,23cyclictest0-21swapper/121:50:181
2814599240,23cyclictest0-21swapper/100:30:021
2814599240,23cyclictest0-21swapper/100:01:101
28138992424,0cyclictest0-21swapper/000:21:590
28138992423,1cyclictest22951-21diskmemload21:18:330
28138992423,1cyclictest0-21swapper/023:04:130
28138992423,0cyclictest22951-21diskmemload22:18:210
2813899240,23cyclictest848-21tail22:23:450
2813899240,23cyclictest22951-21diskmemload22:30:560
2813899240,23cyclictest22951-21diskmemload22:14:350
2813899240,23cyclictest0-21swapper/023:07:100
2813899240,23cyclictest0-21swapper/022:02:420
2813899240,1cyclictest0-21swapper/022:45:410
28150992323,0cyclictest4836-21ssh23:28:593
28150992323,0cyclictest22951-21diskmemload22:26:593
28150992323,0cyclictest0-21swapper/321:20:543
28150992321,1cyclictest31711-21munin-run21:50:013
28150992321,1cyclictest23807-21sh21:10:533
28150992321,1cyclictest12200-21apt-get22:03:433
28150992320,2cyclictest28308-21sh23:53:193
2815099230,2cyclictest30585-21ssh00:25:203
2815099230,23cyclictest22951-21diskmemload23:05:423
2815099230,23cyclictest22951-21diskmemload22:08:563
2815099230,23cyclictest22951-21diskmemload21:56:503
2815099230,23cyclictest1649-21cron22:45:013
2815099230,23cyclictest0-21swapper/323:30:213
2815099230,23cyclictest0-21swapper/322:50:323
2815099230,23cyclictest0-21swapper/300:17:033
2815099230,23cyclictest0-21swapper/300:06:323
2815099230,22cyclictest6800-21ssh21:25:503
2815099230,22cyclictest28610-21ssh21:15:153
2815099230,22cyclictest0-21swapper/322:12:243
2815099230,0cyclictest0-21swapper/322:22:293
2815099230,0cyclictest0-21swapper/300:23:433
28149992323,0cyclictest22951-21diskmemload21:59:122
28149992323,0cyclictest0-21swapper/223:54:502
28149992323,0cyclictest0-21swapper/222:11:472
28149992323,0cyclictest0-21swapper/221:45:592
28149992323,0cyclictest0-21swapper/200:12:272
2814999230,2cyclictest10266-21ssh23:34:302
2814999230,23cyclictest0-21swapper/223:06:542
2814999230,23cyclictest0-21swapper/222:34:572
2814999230,23cyclictest0-21swapper/221:30:152
2814999230,23cyclictest0-21swapper/200:30:072
2814999230,23cyclictest0-21swapper/200:22:582
2814999230,22cyclictest875-21sh21:52:112
2814999230,22cyclictest453-21idleruntime-cro19:20:012
28145992323,0cyclictest0-21swapper/123:35:191
28145992323,0cyclictest0-21swapper/123:23:011
28145992323,0cyclictest0-21swapper/122:21:361
28145992323,0cyclictest0-21swapper/121:40:051
28145992323,0cyclictest0-21swapper/100:14:431
28145992321,1cyclictest5354-21ssh21:23:561
28145992321,1cyclictest16048-21ssh23:40:011
28145992321,1cyclictest0-21swapper/123:13:071
28145992321,1cyclictest0-21swapper/121:29:131
2814599230,23cyclictest0-21swapper/123:05:441
2814599230,23cyclictest0-21swapper/122:56:161
2814599230,23cyclictest0-21swapper/122:28:131
2814599230,22cyclictest22951-21diskmemload00:16:491
2814599230,1cyclictest0-21swapper/122:52:581
2814599230,1cyclictest0-21swapper/100:05:561
2814599230,0cyclictest0-21swapper/122:45:421
2814599230,0cyclictest0-21swapper/122:13:431
28138992323,0cyclictest0-21swapper/023:38:240
28138992323,0cyclictest0-21swapper/021:53:180
28138992323,0cyclictest0-21swapper/021:37:480
28138992323,0cyclictest0-21swapper/021:11:040
28138992322,1cyclictest0-21swapper/023:18:050
28138992321,1cyclictest6788-21sh21:25:490
28138992321,1cyclictest0-21swapper/023:32:000
28138992321,1cyclictest0-21swapper/022:53:440
2813899230,2cyclictest0-21swapper/000:11:450
2813899230,23cyclictest0-21swapper/023:25:450
2813899230,23cyclictest0-21swapper/022:35:470
2813899230,23cyclictest0-21swapper/019:38:410
2813899230,23cyclictest0-21swapper/000:25:070
2813899230,22cyclictest30402-21sh23:53:570
2813899230,22cyclictest22951-21diskmemload21:21:270
2813899230,22cyclictest22951-21diskmemload00:19:580
2813899230,22cyclictest18176-21awk21:00:010
2813899230,22cyclictest12978-21perf20:50:000
2813899230,22cyclictest0-21swapper/023:21:540
2813899230,22cyclictest0-21swapper/022:25:270
2813899230,22cyclictest0-21swapper/000:05:260
2813899230,1cyclictest0-21swapper/023:42:530
2813899230,0cyclictest0-21swapper/023:56:030
28150992222,0cyclictest22951-21diskmemload22:46:543
28150992222,0cyclictest0-21swapper/323:49:393
28150992222,0cyclictest0-21swapper/323:13:313
28150992222,0cyclictest0-21swapper/321:39:293
28150992221,1cyclictest23533-21ssh23:16:243
28150992220,2cyclictest14796-21ssh00:10:163
28150992220,1cyclictest9968-21ssh00:37:443
28150992220,1cyclictest0-21swapper/300:01:253
2815099220,22cyclictest32515-21ssh23:56:523
2815099220,22cyclictest22951-21diskmemload23:02:503
2815099220,22cyclictest0-21swapper/322:16:373
2815099220,21cyclictest8218-21apt-get19:38:413
2815099220,21cyclictest3421-21apt-get19:28:423
2815099220,21cyclictest27971-21ssh23:20:153
2815099220,21cyclictest22951-21diskmemload23:41:063
2815099220,21cyclictest22951-21diskmemload21:51:023
2815099220,21cyclictest0-21swapper/319:48:423
2815099220,1cyclictest11091-21ssh23:35:283
2815099220,1cyclictest0-21swapper/321:34:553
28149992222,0cyclictest22951-21diskmemload21:16:052
28149992222,0cyclictest0-21swapper/223:36:252
28149992222,0cyclictest0-21swapper/222:20:202
28149992222,0cyclictest0-21swapper/200:03:152
28149992221,1cyclictest22951-21diskmemload23:01:002
28149992221,1cyclictest0-21swapper/221:25:132
28149992220,2cyclictest30970-21ssh00:25:542
28149992220,1cyclictest9366-21sh00:05:192
28149992220,1cyclictest0-21swapper/221:35:332
2814999220,22cyclictest23446-21ssh21:10:222
2814999220,22cyclictest22951-21diskmemload23:57:592
2814999220,22cyclictest0-21swapper/222:55:542
2814999220,22cyclictest0-21swapper/222:41:532
2814999220,21cyclictest5817-21ssh21:24:372
2814999220,21cyclictest22951-21diskmemload22:35:332
2814999220,21cyclictest21882-21ssh00:18:222
2814999220,21cyclictest15013-21ssh22:05:022
2814999220,21cyclictest10579-21ssh22:01:162
2814999220,1cyclictest25298-21ssh22:15:142
28145992222,0cyclictest0-21swapper/123:56:351
28145992222,0cyclictest0-21swapper/122:06:251
28145992222,0cyclictest0-21swapper/121:56:181
28145992222,0cyclictest0-21swapper/121:31:141
28145992222,0cyclictest0-21swapper/100:26:451
28145992221,0cyclictest0-21swapper/121:35:091
28145992220,1cyclictest0-21swapper/121:10:151
28145992220,1cyclictest0-21swapper/121:00:011
28145992220,1cyclictest0-21swapper/120:50:001
2814599220,21cyclictest22951-21diskmemload22:00:441
2814599220,21cyclictest22292-21ssh23:46:541
2814599220,21cyclictest15371-21apt-get20:55:001
2814599220,21cyclictest0-21swapper/123:26:511
2814599220,21cyclictest0-21swapper/121:16:011
2814599220,21cyclictest0-21swapper/100:35:051
2814599220,21cyclictest0-21swapper/100:20:081
2814599220,1cyclictest607-21in:imuxsock19:50:001
2814599220,1cyclictest22690-21ssh23:15:021
2814599220,1cyclictest18189-21sendmail22:40:011
2814599220,1cyclictest0-21swapper/123:31:031
2814599220,1cyclictest0-21swapper/123:00:511
28138992220,2cyclictest0-21swapper/000:35:350
28138992220,1cyclictest0-21swapper/000:02:290
2813899220,22cyclictest0-21swapper/022:58:030
2813899220,21cyclictest22951-21diskmemload23:45:040
2813899220,21cyclictest22951-21diskmemload22:40:360
2813899220,21cyclictest18720-21apt-get21:03:420
2813899220,21cyclictest18720-21apt-get21:03:420
2813899220,21cyclictest0-21swapper/023:10:450
2813899220,1cyclictest22987-21sh21:42:090
2813899220,1cyclictest0-21swapper/021:45:120
28150992120,1cyclictest23865-21apt-get20:08:423
28150992120,1cyclictest15394-21ssh22:38:233
2815099210,20cyclictest0-21swapper/319:18:413
28149992121,0cyclictest11034-21apt-get19:43:432
28149992121,0cyclictest0-21swapper/223:11:492
28149992121,0cyclictest0-21swapper/219:50:002
28149992120,1cyclictest1349-21ssh23:26:182
28149992120,0cyclictest21115-21apt-get21:08:432
28149992120,0cyclictest0-21swapper/223:41:472
2814999210,21cyclictest22951-21diskmemload23:48:412
2814999210,21cyclictest0-21swapper/222:46:022
2814999210,20cyclictest0-21swapper/221:05:012
2814999210,20cyclictest0-21swapper/221:05:012
2814999210,20cyclictest0-21swapper/219:28:412
2814999210,1cyclictest7705-21apt-get20:40:022
2814999210,0cyclictest5859-21apt-get20:38:422
28145992121,0cyclictest0-21swapper/121:45:121
28145992121,0cyclictest0-21swapper/119:38:411
28145992121,0cyclictest0-21swapper/119:23:411
28145992118,2cyclictest23315-21awk20:05:001
2814599210,21cyclictest0-21swapper/122:15:131
2814599210,20cyclictest0-21swapper/120:15:011
2814599210,20cyclictest0-21swapper/119:18:411
2814599210,0cyclictest0-21swapper/120:23:421
28138992121,0cyclictest0-21swapper/020:23:420
2813899210,20cyclictest12918-21sh19:45:000
2813899210,20cyclictest0-21swapper/020:40:020
2813899210,20cyclictest0-21swapper/020:08:420
2813899210,20cyclictest0-21swapper/019:58:440
2813899210,1cyclictest28116-21perf20:15:010
28150992020,0cyclictest20512-21apt-get20:00:023
28150992020,0cyclictest0-21swapper/321:08:433
28150992019,1cyclictest16267-21apt-get19:53:423
28150992018,1cyclictest5306-21apt20:35:003
2815099200,0cyclictest0-21swapper/320:38:413
28149992020,0cyclictest0-21swapper/220:08:422
28149992020,0cyclictest0-21swapper/219:53:422
28149992019,1cyclictest5322-21perf20:35:002
2814999200,0cyclictest0-21swapper/220:23:422
28145992020,0cyclictest0-21swapper/119:43:431
28138992020,0cyclictest0-21swapper/019:18:410
28138992019,1cyclictest0-21swapper/019:33:420
28138992018,1cyclictest15382-21latency_hist20:55:000
28150991919,0cyclictest0-21swapper/319:43:433
28150991917,1cyclictest15357-21sh20:55:003
28150991917,1cyclictest0-21swapper/320:45:003
28149991919,0cyclictest0-21swapper/221:00:012
28149991917,2cyclictest2886-21sh19:25:012
2814999190,19cyclictest0-21swapper/220:13:432
28145991919,0cyclictest0-21swapper/121:03:421
28145991919,0cyclictest0-21swapper/121:03:421
28145991918,0cyclictest0-21swapper/120:40:021
28138991919,0cyclictest21115-21apt-get21:08:430
28138991917,1cyclictest0-21swapper/019:28:410
2813899190,18cyclictest0-21swapper/020:33:410
2815099180,0cyclictest0-21swapper/321:03:423
2815099180,0cyclictest0-21swapper/321:03:423
28149991818,0cyclictest0-21swapper/219:58:442
28145991818,0cyclictest0-21swapper/119:28:421
28145991817,0cyclictest0-21swapper/120:08:421
28138991818,0cyclictest0-21swapper/020:18:420
28150991717,0cyclictest31082-21apt-get20:23:423
28150991717,0cyclictest18660-21apt-get19:58:443
28150991717,0cyclictest11062-21apt-get20:48:413
28149991717,0cyclictest0-21swapper/220:18:422
28145991715,1cyclictest21850irq/141-nvme0q220:35:001
28138991717,0cyclictest0-21swapper/019:13:430
28138991716,0cyclictest0-21swapper/020:03:410
2813899170,0cyclictest0-21swapper/020:38:410
28150991616,0cyclictest0-21swapper/319:23:413
2815099160,0cyclictest0-21swapper/320:58:423
28149991616,0cyclictest0-21swapper/219:38:412
28149991615,1cyclictest15386-21perf20:55:002
28145991616,0cyclictest0-21swapper/121:08:431
28145991616,0cyclictest0-21swapper/120:38:411
28138991616,0cyclictest0-21swapper/019:48:420
2815099157,7cyclictest2911-21cron20:30:013
28150991515,0cyclictest0-21swapper/319:15:013
2814999150,1cyclictest23337-21munin-run20:05:002
2814999150,11cyclictest0-21swapper/220:48:412
28145991515,0cyclictest0-21swapper/119:33:421
28138991515,0cyclictest0-21swapper/019:53:420
2813899150,0cyclictest1015-21apt-get19:23:410
2815099140,0cyclictest0-21swapper/320:15:513
2815099140,0cyclictest0-21swapper/320:10:163
2815099140,0cyclictest0-21swapper/319:30:153
2814999140,14cyclictest0-21swapper/220:25:022
2814999140,14cyclictest0-21swapper/219:30:322
2814999140,14cyclictest0-21swapper/219:11:082
2814599140,0cyclictest0-21swapper/120:25:161
2814599140,0cyclictest0-21swapper/119:51:121
2813899140,0cyclictest0-21swapper/020:25:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional