You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 13:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed May 20, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1413799280,0cyclictest0-21swapper/323:34:473
14136992722,4cyclictest0-21swapper/200:14:502
14134992623,2cyclictest0-21swapper/022:54:420
14137992523,1cyclictest7796-21diskmemload23:09:163
1413799250,24cyclictest0-21swapper/322:21:443
14136992522,1cyclictest0-21swapper/221:38:522
14136992520,2cyclictest0-21swapper/221:34:132
1413699250,24cyclictest7796-21diskmemload22:12:082
1413699250,24cyclictest7796-21diskmemload00:04:252
1413699250,24cyclictest2240-21ssh22:28:442
1413599250,24cyclictest7796-21diskmemload22:36:091
1413599250,24cyclictest595-21ssh23:24:071
14134992524,1cyclictest62550irq/127-eno121:51:000
1413499251,24cyclictest62550irq/127-eno123:40:300
1413499250,24cyclictest7796-21diskmemload22:59:320
1413499250,0cyclictest0-21swapper/022:23:390
14137992423,1cyclictest7796-21diskmemload23:27:383
14137992423,1cyclictest7796-21diskmemload00:05:153
14137992423,1cyclictest331rcuc/321:47:113
14137992422,1cyclictest17727-21sh21:17:513
14137992422,1cyclictest0-21swapper/300:29:453
1413799240,23cyclictest7796-21diskmemload21:27:293
1413799240,23cyclictest22010-21sh23:14:303
1413799240,23cyclictest0-21swapper/322:43:293
1413799240,23cyclictest0-21swapper/322:27:453
1413799240,23cyclictest0-21swapper/322:15:383
1413799240,23cyclictest0-21swapper/321:39:353
1413799240,23cyclictest0-21swapper/321:21:003
14136992422,1cyclictest6974-21apt-get00:27:362
1413699240,23cyclictest0-21swapper/223:02:342
1413699240,1cyclictest3380-21ssh23:27:332
1413699240,0cyclictest7796-21diskmemload21:57:092
14135992422,1cyclictest0-21swapper/123:40:571
1413599240,24cyclictest0-21swapper/122:32:061
1413599240,23cyclictest7796-21diskmemload23:39:221
1413599240,23cyclictest7796-21diskmemload21:22:541
1413599240,23cyclictest2508-21rm22:29:051
1413599240,23cyclictest0-21swapper/123:49:001
1413599240,1cyclictest28995-21ssh21:55:421
1413599240,0cyclictest0-21swapper/121:36:301
1413599240,0cyclictest0-21swapper/121:18:131
1413499240,24cyclictest0-21swapper/023:12:250
1413499240,23cyclictest28536-21cron19:40:000
1413499240,22cyclictest0-21swapper/022:49:160
1413499240,1cyclictest62550irq/127-eno122:39:570
1413499240,1cyclictest0-21swapper/021:26:550
1413499240,0cyclictest0-21swapper/023:01:000
1413499240,0cyclictest0-21swapper/000:35:380
14137992323,0cyclictest0-21swapper/323:56:133
14137992323,0cyclictest0-21swapper/322:51:113
14137992323,0cyclictest0-21swapper/321:42:153
14137992323,0cyclictest0-21swapper/300:00:243
14137992321,1cyclictest11390-21apt-get22:37:353
14137992320,2cyclictest2673-21sh22:01:153
14137992320,2cyclictest23186-21ssh21:50:343
1413799230,2cyclictest724-21ssh00:21:543
1413799230,23cyclictest0-21swapper/323:43:183
1413799230,23cyclictest0-21swapper/322:31:023
1413799230,23cyclictest0-21swapper/321:31:343
1413799230,22cyclictest19753-21ptp4l-jitter00:37:423
1413799230,22cyclictest0-21swapper/321:12:363
1413799230,1cyclictest0-21swapper/323:53:383
1413799230,0cyclictest7796-21diskmemload22:56:033
14136992323,0cyclictest29041-21apt-get19:42:342
14136992323,0cyclictest0-21swapper/222:17:352
14136992323,0cyclictest0-21swapper/221:22:222
14136992321,2cyclictest11121-21ssh00:30:292
14136992321,1cyclictest25389-21ssh22:21:172
14136992321,1cyclictest17287-21ssh23:10:342
14136992321,1cyclictest14818-21sh00:05:072
14136992321,1cyclictest12351-21missed_timers22:37:392
14136992320,3cyclictest0-21swapper/221:15:142
14136992320,2cyclictest27423-21ssh00:16:492
1413699230,2cyclictest18736-21ssh23:40:092
1413699230,23cyclictest7796-21diskmemload21:12:322
1413699230,22cyclictest9036-21ssh22:07:162
1413699230,22cyclictest4160-21ssh23:56:152
1413699230,22cyclictest31274-21ssh23:51:422
1413699230,22cyclictest2813-21rm22:01:262
1413699230,22cyclictest26313-21ssh21:26:302
1413699230,22cyclictest17136-21ssh22:42:312
1413699230,22cyclictest14533-21ssh21:43:042
1413699230,22cyclictest0-21swapper/223:06:392
1413699230,22cyclictest0-21swapper/222:50:312
1413699230,22cyclictest0-21swapper/222:47:012
14135992323,0cyclictest7796-21diskmemload23:50:371
14135992323,0cyclictest0-21swapper/123:34:251
14135992323,0cyclictest0-21swapper/123:13:321
14135992323,0cyclictest0-21swapper/123:06:531
14135992323,0cyclictest0-21swapper/122:12:111
14135992323,0cyclictest0-21swapper/100:25:441
14135992323,0cyclictest0-21swapper/100:22:241
14135992323,0cyclictest0-21swapper/100:07:551
14135992322,1cyclictest24686-21apt-get21:52:331
14135992321,1cyclictest8889-21munin-run00:00:011
14135992320,2cyclictest21367-21idleruntime-cro19:25:011
1413599230,2cyclictest1931-21rm23:25:331
1413599230,23cyclictest0-21swapper/122:22:111
1413599230,22cyclictest7661-21ssh22:05:171
1413599230,22cyclictest32166-21sh22:55:001
1413599230,22cyclictest11386-21diskmemload00:30:491
1413599230,0cyclictest0-21swapper/123:00:391
1413599230,0cyclictest0-21swapper/100:00:371
14134992323,0cyclictest7796-21diskmemload23:26:190
14134992323,0cyclictest0-21swapper/023:35:510
14134992323,0cyclictest0-21swapper/022:14:370
14134992323,0cyclictest0-21swapper/021:34:350
14134992323,0cyclictest0-21swapper/021:16:060
14134992323,0cyclictest0-21swapper/021:11:160
14134992322,1cyclictest62550irq/127-eno100:31:100
1413499232,1cyclictest62550irq/127-eno123:51:170
14134992321,1cyclictest7796-21diskmemload00:18:080
14134992321,1cyclictest32048-21users23:22:440
14134992321,1cyclictest0-21swapper/000:20:400
14134992320,2cyclictest411-21/usr/sbin/munin22:27:370
1413499230,23cyclictest0-21swapper/000:10:080
1413499230,22cyclictest7238-21ssh22:32:500
1413499230,22cyclictest5742-21ssh00:25:580
1413499230,22cyclictest29657-21sh21:56:320
1413499230,22cyclictest21392-21perf19:25:010
1413499230,0cyclictest7796-21diskmemload21:37:150
1413499230,0cyclictest0-21swapper/023:05:150
1413499230,0cyclictest0-21swapper/021:23:130
14137992222,0cyclictest0-21swapper/322:45:503
14137992222,0cyclictest0-21swapper/322:12:053
14137992222,0cyclictest0-21swapper/321:55:023
14137992222,0cyclictest0-21swapper/300:10:453
14137992220,1cyclictest0-21swapper/319:35:013
14137992219,2cyclictest16199-21idleruntime-cro20:20:013
1413799220,22cyclictest0-21swapper/300:18:143
1413799220,21cyclictest24767-21ssh23:45:413
1413799220,21cyclictest0-21swapper/300:30:133
1413799220,1cyclictest0-21swapper/323:16:513
1413799220,0cyclictest7796-21diskmemload23:00:313
14136992222,0cyclictest7796-21diskmemload22:56:322
14136992221,1cyclictest14218-21apt-get20:17:342
14136992221,1cyclictest0-21swapper/222:32:362
14136992220,1cyclictest7796-21diskmemload23:35:112
14136992220,1cyclictest18958-21tr19:20:012
14136992220,1cyclictest0-21swapper/223:21:492
1413699220,22cyclictest4042-21sh00:23:582
1413699220,22cyclictest0-21swapper/200:35:362
1413699220,21cyclictest7571-21ssh23:30:252
1413699220,21cyclictest18123-21ssh21:46:572
1413699220,21cyclictest0-21swapper/223:15:112
1413699220,21cyclictest0-21swapper/220:52:342
1413699220,21cyclictest0-21swapper/220:42:342
1413699220,1cyclictest0-21swapper/223:47:382
1413699220,1cyclictest0-21swapper/221:53:312
1413699220,0cyclictest0-21swapper/219:52:342
14135992222,0cyclictest14574-21apt-get19:12:341
14135992222,0cyclictest0-21swapper/122:02:151
14135992221,1cyclictest22268-21sh22:46:441
14135992220,1cyclictest18978-21turbostat.cron19:20:011
14135992220,1cyclictest16906-21ssh21:45:221
1413599220,21cyclictest6156-21idleruntime-cro20:00:001
1413599220,21cyclictest265902sleep119:37:331
1413599220,1cyclictest8599-21ssh21:10:421
1413599220,1cyclictest7797-21sh21:10:011
1413599220,1cyclictest7796-21diskmemload22:41:421
1413599220,0cyclictest7796-21diskmemload22:15:471
1413599220,0cyclictest0-21swapper/121:41:211
1413599220,0cyclictest0-21swapper/121:25:501
14134992222,0cyclictest0-21swapper/023:45:090
14134992222,0cyclictest0-21swapper/000:05:040
14134992221,1cyclictest9074-21ssh22:07:180
14134992221,1cyclictest0-21swapper/023:17:350
14134992220,1cyclictest0-21swapper/021:42:240
1413499220,22cyclictest13416-21diskmemload00:03:320
1413499220,22cyclictest0-21swapper/022:01:040
1413499220,21cyclictest7785-21diskmemload23:30:500
1413499220,21cyclictest0-21swapper/019:45:020
1413499220,0cyclictest0-21swapper/021:45:040
14137992121,0cyclictest0-21swapper/323:20:153
14137992120,1cyclictest0-21swapper/322:06:063
14137992119,1cyclictest18993-21munin-run19:20:013
1413799210,0cyclictest0-21swapper/320:10:013
14136992120,1cyclictest11418-21apt-get20:12:342
14136992119,1cyclictest0-21swapper/220:30:002
14136992119,1cyclictest0-21swapper/219:30:012
14136992119,1cyclictest0-21swapper/219:15:002
1413699210,20cyclictest0-21swapper/219:37:332
14135992121,0cyclictest0-21swapper/120:42:341
14135992121,0cyclictest0-21swapper/100:10:431
14135992120,1cyclictest13356-21apt-get20:15:031
1413599210,21cyclictest0-21swapper/100:35:181
1413599210,20cyclictest0-21swapper/120:37:341
1413599210,20cyclictest0-21swapper/120:27:351
1413599210,0cyclictest0-21swapper/122:55:021
14134992120,0cyclictest26291-21apt-get20:42:340
14134992120,0cyclictest0-21swapper/020:25:010
14134992120,0cyclictest0-21swapper/019:17:330
14134992119,1cyclictest31077-21apt-get20:52:330
14134992119,1cyclictest0-21swapper/021:10:010
1413499210,20cyclictest0-21swapper/019:12:340
14137992020,0cyclictest26623-21apt-get19:37:333
14137992020,0cyclictest0-21swapper/319:22:333
14137992019,0cyclictest0-21swapper/319:27:333
14136992020,0cyclictest0-21swapper/221:10:012
14136992020,0cyclictest0-21swapper/221:02:342
1413699200,19cyclictest0-21swapper/220:47:342
14135992020,0cyclictest0-21swapper/120:52:331
14135992020,0cyclictest0-21swapper/119:27:331
1413599200,0cyclictest0-21swapper/120:47:341
14134992020,0cyclictest21832-21apt-get19:27:330
14134992020,0cyclictest0-21swapper/020:27:350
14134992020,0cyclictest0-21swapper/020:17:340
14137991919,0cyclictest0-21swapper/321:07:353
14137991919,0cyclictest0-21swapper/320:42:343
14137991919,0cyclictest0-21swapper/319:42:343
14137991919,0cyclictest0-21swapper/319:15:003
14137991918,1cyclictest0-21swapper/319:52:343
14137991917,1cyclictest13342-21cron20:15:013
14136991919,0cyclictest0-21swapper/220:57:342
14136991919,0cyclictest0-21swapper/219:22:332
14135991919,0cyclictest0-21swapper/120:02:351
14135991919,0cyclictest0-21swapper/119:32:351
14135991918,1cyclictest1813-21apt-get19:52:341
1413599190,0cyclictest0-21swapper/119:45:021
14134991919,0cyclictest0-21swapper/019:42:330
14134991917,1cyclictest30635-21perf20:50:000
14137991818,0cyclictest4210-21apt-get19:57:343
14137991818,0cyclictest0-21swapper/320:57:343
14137991817,1cyclictest21480-21apt-get20:32:343
14137991817,1cyclictest0-21swapper/320:22:343
14137991816,1cyclictest0-21swapper/319:50:003
14136991818,0cyclictest23874-21apt-get20:37:342
14135991818,0cyclictest16637-21apt-get20:22:341
14134991817,1cyclictest0-21swapper/019:52:340
14137991716,0cyclictest0-21swapper/320:02:353
14136991717,0cyclictest0-21swapper/220:07:362
14136991717,0cyclictest0-21swapper/219:47:352
14137991616,0cyclictest0-21swapper/320:50:003
14137991613,2cyclictest5413-21basename21:05:013
14136991616,0cyclictest0-21swapper/220:02:352
14134991616,0cyclictest0-21swapper/019:32:340
14134991615,1cyclictest0-21swapper/020:37:340
14134991614,1cyclictest8564-21latency_hist20:05:000
1413499160,15cyclictest0-21swapper/019:57:390
14136991514,1cyclictest24231-21apt-get19:32:342
1413699150,0cyclictest0-21swapper/220:32:342
1413799140,0cyclictest0-21swapper/320:50:273
1413799140,0cyclictest0-21swapper/320:35:183
1413799140,0cyclictest0-21swapper/320:25:123
1413699140,14cyclictest0-21swapper/220:20:182
1413699140,14cyclictest0-21swapper/219:55:092
14135991414,0cyclictest0-21swapper/120:55:171
14135991414,0cyclictest0-21swapper/120:30:051
1413599140,14cyclictest0-21swapper/121:01:051
1413599140,14cyclictest0-21swapper/120:11:181
1413599140,0cyclictest0-21swapper/120:05:231
1413499140,14cyclictest0-21swapper/021:00:490
1413499140,14cyclictest0-21swapper/020:55:100
1413499140,14cyclictest0-21swapper/020:30:210
1413499140,0cyclictest0-21swapper/020:10:490
1413499140,0cyclictest0-21swapper/020:05:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional