You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 15:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Mon Jan 12, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15303992623,2cyclictest606-21dbus-daemon20:55:001
15303992523,1cyclictest19323-21latency_hist20:25:011
1531199240,23cyclictest19016-21latency_hist22:35:013
1531199240,23cyclictest0-21swapper/322:11:473
1530399240,0cyclictest0-21swapper/121:21:471
1531199230,2cyclictest23915-21apt-get23:51:463
1531199230,2cyclictest0-21swapper/322:56:453
1531199230,22cyclictest21706-21apt-get20:30:013
1531199230,22cyclictest0-21swapper/321:41:453
15303992321,1cyclictest3827-21munin-run23:10:001
15303992320,2cyclictest606-21dbus-daemon19:45:011
1530399230,2cyclictest28336-21sh00:00:001
1529899230,22cyclictest21773-21sh21:35:000
1529899230,22cyclictest0-21swapper/021:16:460
15311992220,1cyclictest4163-21apt-get22:05:023
15311992220,1cyclictest2116-21munin-plugin-st20:55:003
15311992220,1cyclictest0-21swapper/321:01:473
1531199220,21cyclictest25657-21apt-get19:31:453
1531199220,21cyclictest2494-21apt-get20:56:453
1531199220,21cyclictest12147-21latency_hist21:15:013
1531199220,21cyclictest1184-21apt-get00:11:473
1531199220,21cyclictest0-21swapper/323:21:473
1531199220,21cyclictest0-21swapper/321:06:473
15306992222,0cyclictest0-21swapper/221:36:442
15306992220,1cyclictest13195-21apt-get00:36:432
1530699220,21cyclictest313-21systemd-journal20:50:002
1530699220,21cyclictest25906-21apt23:55:002
1530699220,21cyclictest19407-21apt-get22:36:472
1530699220,21cyclictest13491-21cron23:30:012
1530699220,21cyclictest0-21swapper/200:00:002
1530699220,1cyclictest7322-21munin-run21:05:012
1530699220,1cyclictest2088-21awk20:55:002
1530699220,1cyclictest20471-21apt-get19:21:462
15303992220,1cyclictest19373-21perf21:30:001
15303992220,1cyclictest0-21swapper/121:50:011
15303992219,2cyclictest14496-21dump-pmu-power20:15:011
1530399220,21cyclictest26965-21awk21:45:011
1530399220,21cyclictest25657-21apt-get19:31:451
1530399220,21cyclictest21521-21apt-get23:46:481
1530399220,21cyclictest0-21swapper/121:36:441
1530399220,21cyclictest0-21swapper/120:06:451
1530399220,1cyclictest14608-21apt-get22:26:461
1530399220,0cyclictest0-21swapper/119:16:461
15298992220,1cyclictest8716-21perf23:20:000
1529899220,21cyclictest9420-21awk22:15:000
1529899220,21cyclictest1808-21apt-get23:06:470
1529899220,21cyclictest0-21swapper/021:06:470
15311992121,0cyclictest0-21swapper/319:46:463
15311992119,1cyclictest17634-21cron19:15:003
15311992119,1cyclictest0-21swapper/319:25:013
1531199210,21cyclictest0-21swapper/321:16:463
1531199210,21cyclictest0-21swapper/319:36:463
1531199210,20cyclictest0-21swapper/323:46:473
1531199210,20cyclictest0-21swapper/321:51:463
1531199210,20cyclictest0-21swapper/319:16:463
1531199210,20cyclictest0-21swapper/300:16:483
1531199210,0cyclictest0-21swapper/323:01:473
15306992121,0cyclictest0-21swapper/223:31:472
15306992120,1cyclictest12217-21apt-get22:21:492
15306992120,0cyclictest14897-21apt-get20:16:462
1530699210,21cyclictest0-21swapper/223:46:482
1530699210,20cyclictest0-21swapper/222:26:462
1530699210,0cyclictest0-21swapper/221:16:462
1530699210,0cyclictest0-21swapper/220:31:462
15303992121,0cyclictest31212-21apt-get00:06:471
15303992121,0cyclictest0-21swapper/122:31:481
15303992120,1cyclictest7661-21apt-get20:01:451
15303992120,1cyclictest30058-21latency_hist19:40:011
15303992120,1cyclictest10151-21apt-get21:11:461
15303992120,1cyclictest0-21swapper/120:36:461
15303992120,0cyclictest13911-21apt-get23:31:471
1530399210,20cyclictest12544-21apt-get21:16:461
1530399210,20cyclictest0-21swapper/119:56:481
1530399210,0cyclictest9797-21apt-get22:16:481
1530399210,0cyclictest0-21swapper/123:16:471
1530399210,0cyclictest0-21swapper/120:56:451
1530399210,0cyclictest0-21swapper/119:51:471
1530399210,0cyclictest0-21swapper/119:21:461
15298992121,0cyclictest0-21swapper/023:36:460
15298992121,0cyclictest0-21swapper/023:11:480
15298992121,0cyclictest0-21swapper/022:51:470
15298992121,0cyclictest0-21swapper/000:11:470
15298992119,1cyclictest21438-21munin-run22:40:010
1529899210,21cyclictest0-21swapper/023:31:470
1529899210,21cyclictest0-21swapper/022:16:480
1529899210,20cyclictest0-21swapper/023:26:470
1529899210,1cyclictest0-21swapper/023:41:470
1529899210,0cyclictest0-21swapper/022:06:460
1529899210,0cyclictest0-21swapper/019:41:460
1529899210,0cyclictest0-21swapper/019:36:460
15311992020,0cyclictest0-21swapper/321:56:473
15311992020,0cyclictest0-21swapper/321:21:473
15311992020,0cyclictest0-21swapper/319:26:443
15311992020,0cyclictest0-21swapper/319:26:443
15311992020,0cyclictest0-21swapper/300:06:473
15311992018,1cyclictest19318-21awk20:25:013
15311992018,1cyclictest0-21swapper/323:45:013
1531199200,20cyclictest0-21swapper/320:30:023
1531199200,0cyclictest8414-21apt-get00:26:483
1531199200,0cyclictest0-21swapper/322:51:473
15306992020,0cyclictest30472-21apt-get19:41:462
15306992020,0cyclictest0-21swapper/223:41:472
15306992020,0cyclictest0-21swapper/222:11:482
15306992020,0cyclictest0-21swapper/221:56:462
15306992020,0cyclictest0-21swapper/221:11:462
15306992019,1cyclictest0-21swapper/222:41:452
15306992019,0cyclictest29240-21apt-get22:55:022
15306992018,1cyclictest15929-21apt-get23:35:022
1530699200,20cyclictest0-21swapper/221:41:452
1530699200,0cyclictest27365-21apt-get21:46:472
1530699200,0cyclictest2166-21apt-get22:01:482
1530699200,0cyclictest14965-21apt-get21:21:472
1530699200,0cyclictest0-21swapper/220:06:452
1530699200,0cyclictest0-21swapper/200:26:482
15303992020,0cyclictest29760-21apt-get21:51:451
15303992020,0cyclictest0-21swapper/122:51:471
15303992020,0cyclictest0-21swapper/122:01:481
15303992020,0cyclictest0-21swapper/120:31:461
15303992019,1cyclictest16538-21apt-get23:35:021
15303992018,1cyclictest1402-21dump-pmu-power23:05:001
1530399200,20cyclictest0-21swapper/120:16:461
1530399200,19cyclictest28617-21apt-get22:55:021
1530399200,0cyclictest0-21swapper/121:06:471
15298992020,0cyclictest21824-21apt-get22:41:450
15298992020,0cyclictest0-21swapper/023:21:460
15298992020,0cyclictest0-21swapper/022:21:490
15298992020,0cyclictest0-21swapper/021:51:450
15298992020,0cyclictest0-21swapper/021:46:470
15298992020,0cyclictest0-21swapper/020:46:450
15298992020,0cyclictest0-21swapper/020:06:450
15298992020,0cyclictest0-21swapper/019:11:450
15298992020,0cyclictest0-21swapper/000:01:460
15298992018,1cyclictest4507-21apt-get21:00:020
1529899200,20cyclictest0-21swapper/023:56:460
1529899200,20cyclictest0-21swapper/021:11:460
1529899200,20cyclictest0-21swapper/019:31:450
1529899200,0cyclictest0-21swapper/022:56:450
1529899200,0cyclictest0-21swapper/021:26:470
1529899200,0cyclictest0-21swapper/020:21:480
1529899200,0cyclictest0-21swapper/020:01:460
15311991919,0cyclictest0-21swapper/321:31:473
15311991919,0cyclictest0-21swapper/320:46:453
15311991919,0cyclictest0-21swapper/319:51:463
15311991919,0cyclictest0-21swapper/300:36:433
15311991919,0cyclictest0-21swapper/300:31:473
15311991918,1cyclictest6647-21apt-get23:16:473
15311991918,0cyclictest6020-21apt-get00:21:473
15311991918,0cyclictest0-21swapper/322:16:483
15311991917,1cyclictest15930-21munin-run23:35:013
1531199190,0cyclictest27722-21apt-get20:41:483
15306991919,0cyclictest2853-21apt-get19:51:472
15306991919,0cyclictest0-21swapper/219:16:452
15306991919,0cyclictest0-21swapper/200:16:482
15306991918,0cyclictest0-21swapper/222:51:472
15306991918,0cyclictest0-21swapper/219:31:452
15306991917,1cyclictest9765-21munin-run21:10:012
15306991917,1cyclictest28056-21apt-get19:36:462
1530699190,19cyclictest24905-21apt-get20:36:462
15303991919,0cyclictest27722-21apt-get20:41:471
15303991919,0cyclictest0-21swapper/123:51:471
15303991917,1cyclictest3184-21awk00:15:011
15298991919,0cyclictest0-21swapper/022:26:460
15298991919,0cyclictest0-21swapper/021:41:450
15298991919,0cyclictest0-21swapper/000:16:480
15298991917,1cyclictest26906-21latency_hist20:40:000
15298991917,1cyclictest0-21swapper/022:31:480
15311991818,0cyclictest0-21swapper/323:36:463
15311991818,0cyclictest0-21swapper/323:06:463
15311991818,0cyclictest0-21swapper/322:36:473
15311991818,0cyclictest0-21swapper/320:01:453
15311991818,0cyclictest0-21swapper/319:56:473
15311991817,0cyclictest28817-21apt-get00:01:463
15311991815,2cyclictest783-21snmpd23:26:463
15306991818,0cyclictest405-21apt-get19:46:472
15303991818,0cyclictest0-21swapper/123:26:471
15303991818,0cyclictest0-21swapper/123:11:481
15303991818,0cyclictest0-21swapper/120:26:481
15303991818,0cyclictest0-21swapper/119:46:471
15303991818,0cyclictest0-21swapper/100:21:471
15298991818,0cyclictest0-21swapper/023:50:010
15298991818,0cyclictest0-21swapper/023:01:470
15298991818,0cyclictest0-21swapper/000:36:430
15298991818,0cyclictest0-21swapper/000:31:470
15298991816,1cyclictest606-21dbus-daemon20:00:000
15298991816,1cyclictest24528-21munin-run20:35:010
15311991714,2cyclictest19378-21awk21:30:003
1531199170,16cyclictest0-21swapper/323:56:473
1531199170,15cyclictest611-21irqbalance22:23:113
15306991717,0cyclictest19719-21apt-get20:26:482
15306991717,0cyclictest0-21swapper/222:06:462
15306991716,1cyclictest4207-21apt-get23:11:482
1530699170,17cyclictest0-21swapper/200:06:472
15303991717,0cyclictest0-21swapper/122:21:491
15303991717,0cyclictest0-21swapper/119:25:021
15303991717,0cyclictest0-21swapper/119:25:021
15303991715,1cyclictest12804-21turbostat00:35:001
1530399170,16cyclictest1-21systemd22:00:011
15298991717,0cyclictest0-21swapper/021:21:460
15298991717,0cyclictest0-21swapper/020:40:020
15311991616,0cyclictest10109-21apt-get20:06:453
15311991614,1cyclictest16923-21grep20:20:013
15311991613,2cyclictest25379-21sed22:46:533
1530699168,7cyclictest17817-21irqstats22:31:522
15306991616,0cyclictest0-21swapper/222:46:462
15306991616,0cyclictest0-21swapper/220:01:452
15306991614,1cyclictest19759-21apt-get21:31:472
15306991614,1cyclictest0-21swapper/219:56:472
1530699160,15cyclictest8739-21munin-run23:20:002
15303991616,0cyclictest0-21swapper/122:06:461
15303991615,0cyclictest30113-21apt-get20:46:451
15303991614,1cyclictest0-21swapper/100:36:451
15298991616,0cyclictest0-21swapper/023:51:470
15298991614,1cyclictest0-21swapper/022:00:010
1529899160,15cyclictest0-21swapper/021:36:500
15311991514,1cyclictest24134-21cron21:40:003
15311991513,1cyclictest0-21swapper/322:28:593
1531199150,14cyclictest0-21swapper/321:45:163
15306991515,0cyclictest0-21swapper/220:56:452
15306991515,0cyclictest0-21swapper/200:11:472
1530399150,1cyclictest5307-21apt-get21:01:471
15298991515,0cyclictest0-21swapper/019:51:470
15298991514,1cyclictest12504-21apt-get20:11:470
1529899150,1cyclictest0-21swapper/020:26:200
1529899150,1cyclictest0-21swapper/019:21:470
1529899150,15cyclictest0-21swapper/020:56:470
15311991414,0cyclictest0-21swapper/320:11:223
1531199140,14cyclictest0-21swapper/323:10:043
1531199140,14cyclictest0-21swapper/322:40:283
1531199140,14cyclictest0-21swapper/322:00:073
1531199140,14cyclictest0-21swapper/319:40:033
15306991414,0cyclictest0-21swapper/221:51:022
15306991414,0cyclictest0-21swapper/220:40:022
15306991414,0cyclictest0-21swapper/200:21:202
15306991414,0cyclictest0-21swapper/200:00:052
1530699140,14cyclictest0-21swapper/223:20:022
1530699140,14cyclictest0-21swapper/223:00:542
1530699140,14cyclictest0-21swapper/222:15:042
1530699140,14cyclictest0-21swapper/221:25:102
1530699140,14cyclictest0-21swapper/219:25:382
1530699140,14cyclictest0-21swapper/219:25:382
1530699140,14cyclictest0-21swapper/219:11:252
1530699140,14cyclictest0-21swapper/200:32:152
1530699140,0cyclictest0-21swapper/223:05:282
1530699140,0cyclictest0-21swapper/220:20:072
1530699140,0cyclictest0-21swapper/220:10:592
15303991414,0cyclictest0-21swapper/123:20:391
15303991414,0cyclictest0-21swapper/122:45:221
1530399140,14cyclictest0-21swapper/122:35:041
1530399140,14cyclictest0-21swapper/122:10:111
1530399140,14cyclictest0-21swapper/121:30:351
1530399140,14cyclictest0-21swapper/100:16:421
1530399140,0cyclictest0-21swapper/122:40:051
1530399140,0cyclictest0-21swapper/119:10:361
15298991414,0cyclictest0-21swapper/022:46:300
15298991414,0cyclictest0-21swapper/000:26:000
1529899140,14cyclictest0-21swapper/020:50:060
1529899140,14cyclictest0-21swapper/020:15:020
1529899140,14cyclictest0-21swapper/000:20:240
1529899140,0cyclictest0-21swapper/019:46:370
1529899140,0cyclictest0-21swapper/019:26:050
1529899140,0cyclictest0-21swapper/019:26:050
1529899140,0cyclictest0-21swapper/019:15:170
15298991313,0cyclictest0-21swapper/022:00:400
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional