You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 15:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Dec 18, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2625999250,4cyclictest12032-21awk10:00:001
26260992422,1cyclictest0-21swapper/209:09:412
2625999240,23cyclictest22858-21cron11:30:001
2625999240,23cyclictest0-21swapper/110:55:001
2626199230,23cyclictest0-21swapper/307:39:413
2626199230,22cyclictest17947-21apt-get12:29:413
26260992321,1cyclictest12968-21apt-get08:59:422
26260992320,2cyclictest313-21systemd-journal08:45:012
2626099230,2cyclictest14919-21perf12:20:002
2625999230,22cyclictest211rcuc/108:20:001
2625999230,1cyclictest313-21systemd-journal07:35:001
26258992323,0cyclictest21322-21apt-get08:09:440
26258992321,1cyclictest619-21polkitd09:25:010
26258992321,1cyclictest11086-21idleruntime-cro07:45:010
26261992222,0cyclictest0-21swapper/309:09:413
26261992220,1cyclictest7558-21latency_hist08:45:013
26261992220,1cyclictest0-21swapper/307:30:003
2626199220,21cyclictest622-21gdbus12:25:003
2626199220,21cyclictest3363-21apt-get08:39:403
2626199220,21cyclictest21092-21apt-get11:29:423
2626199220,21cyclictest0-21swapper/310:49:433
2626199220,21cyclictest0-21swapper/309:44:413
2626199220,21cyclictest0-21swapper/309:34:413
2626199220,21cyclictest0-21swapper/308:34:413
2626199220,21cyclictest0-21swapper/307:24:413
2626199220,21cyclictest0-21swapper/307:19:413
26260992220,1cyclictest32629-21apt-get09:39:412
26260992220,1cyclictest0-21swapper/211:04:422
26260992219,2cyclictest3363-21cron07:30:002
2626099220,22cyclictest0-21swapper/207:39:412
2626099220,21cyclictest9206-21apt-get09:55:022
2626099220,21cyclictest8300-21apt-get07:40:022
2626099220,21cyclictest2638-21apt-get09:44:412
2626099220,21cyclictest23488-21apt-get11:34:422
2626099220,21cyclictest0-21swapper/208:39:402
2626099220,21cyclictest0-21swapper/208:34:412
2626099220,21cyclictest0-21swapper/208:19:432
2626099220,21cyclictest0-21swapper/207:19:412
2626099220,1cyclictest0-21swapper/211:59:422
26259992220,1cyclictest958-21apt-get08:34:411
26259992220,1cyclictest25496-21munin-run08:15:001
2625999220,21cyclictest9098-21apt-get11:04:421
2625999220,21cyclictest0-21swapper/110:24:421
2625999220,21cyclictest0-21swapper/110:04:391
2625999220,21cyclictest0-21swapper/109:09:411
2625999220,1cyclictest16818-21munin-run10:10:011
26258992220,1cyclictest4010-21apt-get07:34:410
2625899220,21cyclictest606-21dbus-daemon12:15:010
2625899220,21cyclictest24379-21awk09:20:010
2625899220,21cyclictest16508-21apt-get07:59:400
2625899220,21cyclictest10575-21apt-get08:54:420
2625899220,1cyclictest31278-21perf10:40:000
2625899220,1cyclictest17775-21apt-get09:09:410
26261992121,0cyclictest0-21swapper/311:54:433
26261992120,1cyclictest0-21swapper/311:04:423
26261992120,0cyclictest28364-21apt-get11:44:433
26261992120,0cyclictest0-21swapper/312:34:383
26261992118,2cyclictest21955-21awk09:15:003
2626199210,21cyclictest0-21swapper/308:04:393
2626199210,20cyclictest9967-21perf08:50:013
2626199210,20cyclictest4924-21perf12:00:013
2626199210,20cyclictest14115-21apt-get07:54:413
2626199210,20cyclictest0-21swapper/312:20:003
2626199210,20cyclictest0-21swapper/311:34:423
2626199210,20cyclictest0-21swapper/310:29:413
2626199210,1cyclictest27442-21apt-get09:29:413
2626199210,0cyclictest0-21swapper/311:14:433
2626199210,0cyclictest0-21swapper/307:59:413
26260992120,0cyclictest723-21apt-get11:54:432
26260992120,0cyclictest18700-21apt-get11:24:432
26260992120,0cyclictest0-21swapper/212:34:382
2626099210,21cyclictest0-21swapper/208:04:392
2626099210,20cyclictest31901-21apt-get10:44:432
2626099210,20cyclictest0-21swapper/211:29:422
2626099210,20cyclictest0-21swapper/210:29:412
2626099210,1cyclictest9970-21munin-plugin-st08:50:012
2626099210,1cyclictest18052-21dump-pmu-power11:20:012
2626099210,0cyclictest0-21swapper/212:29:412
2626099210,0cyclictest0-21swapper/207:59:412
26259992121,0cyclictest5781-21apt-get08:44:411
26259992121,0cyclictest29482-21apt-get10:39:401
26259992121,0cyclictest0-21swapper/107:54:411
26259992120,1cyclictest5955-21apt-get12:04:431
26259992119,1cyclictest606-21dbus-daemon11:50:011
26259992119,1cyclictest13485-21sh07:50:011
26259992119,1cyclictest13485-21sh07:50:011
2625999210,21cyclictest0-21swapper/110:44:431
2625999210,1cyclictest25268-21latency_hist11:35:001
2625999210,0cyclictest8347-21apt-get12:09:411
2625999210,0cyclictest0-21swapper/112:24:441
2625999210,0cyclictest0-21swapper/109:49:401
26258992121,0cyclictest0-21swapper/012:29:410
26258992121,0cyclictest0-21swapper/010:14:430
26258992120,1cyclictest0-21swapper/010:04:400
26258992119,1cyclictest3368-21cron07:30:000
26258992119,1cyclictest28863-21turbostat10:35:010
26258992118,2cyclictest27742-21cat11:40:000
26258992117,3cyclictest18071-21perf11:20:010
2625899211,0cyclictest0-21swapper/010:44:420
2625899210,21cyclictest0-21swapper/008:04:380
2625899210,20cyclictest0-21swapper/011:14:430
2625899210,0cyclictest4287-21apt-get10:54:430
2625899210,0cyclictest0-21swapper/012:09:410
26261992020,0cyclictest0-21swapper/311:24:433
26261992020,0cyclictest0-21swapper/309:39:413
26261992020,0cyclictest0-21swapper/309:24:403
2626199200,20cyclictest13508-21perf07:50:013
2626199200,20cyclictest13508-21perf07:50:013
2626199200,20cyclictest0-21swapper/310:04:393
2626199200,0cyclictest0-21swapper/310:44:433
2626199200,0cyclictest0-21swapper/309:55:023
2626199200,0cyclictest0-21swapper/307:40:023
26260992020,0cyclictest0-21swapper/211:44:432
26260992018,1cyclictest21922-21cron09:15:002
2626099200,0cyclictest0-21swapper/207:54:412
26259992020,0cyclictest0-21swapper/111:59:431
26259992020,0cyclictest0-21swapper/111:19:421
26259992020,0cyclictest0-21swapper/109:45:011
26259992020,0cyclictest0-21swapper/108:59:421
26259992020,0cyclictest0-21swapper/108:39:401
26259992020,0cyclictest0-21swapper/108:24:421
26259992020,0cyclictest0-21swapper/107:44:401
26259992019,1cyclictest7431-21apt-get09:54:421
26259992018,1cyclictest19203-21idleruntime-cro10:15:011
2625999200,0cyclictest6681-21apt-get10:59:421
2625999200,0cyclictest0-21swapper/107:29:431
26258992020,0cyclictest3142-21apt-get11:59:420
26258992020,0cyclictest19821-21apt-get10:19:410
26258992020,0cyclictest19821-21apt-get10:19:410
26258992020,0cyclictest0-21swapper/012:39:380
26258992020,0cyclictest0-21swapper/011:49:420
26258992020,0cyclictest0-21swapper/010:24:420
26258992020,0cyclictest0-21swapper/009:44:410
26258992020,0cyclictest0-21swapper/008:59:420
26258992020,0cyclictest0-21swapper/008:29:400
26258992020,0cyclictest0-21swapper/007:54:410
26258992019,0cyclictest0-21swapper/009:49:400
26258992019,0cyclictest0-21swapper/007:49:400
26258992019,0cyclictest0-21swapper/007:49:400
2625899200,20cyclictest0-21swapper/012:19:400
2625899200,20cyclictest0-21swapper/009:35:020
2625899200,0cyclictest0-21swapper/012:24:440
2625899200,0cyclictest0-21swapper/012:04:430
2625899200,0cyclictest0-21swapper/007:19:410
26261991919,0cyclictest0-21swapper/311:39:413
26261991919,0cyclictest0-21swapper/310:39:403
26261991919,0cyclictest0-21swapper/310:24:423
26261991918,0cyclictest5032-21apt-get09:49:403
26260991919,0cyclictest23711-21apt-get08:14:402
26260991919,0cyclictest0-21swapper/212:24:442
26260991919,0cyclictest0-21swapper/210:39:402
26260991919,0cyclictest0-21swapper/210:24:422
26260991917,1cyclictest313-21systemd-journal09:55:002
26260991917,1cyclictest12637-21apt-get10:04:392
2626099190,18cyclictest25882-21apt-get11:39:412
26259991919,0cyclictest13888-21apt-get11:14:431
26259991919,0cyclictest0-21swapper/112:29:411
26259991919,0cyclictest0-21swapper/110:49:431
26259991919,0cyclictest0-21swapper/109:19:411
26259991918,0cyclictest0-21swapper/110:19:411
26259991918,0cyclictest0-21swapper/110:19:411
26259991917,1cyclictest0-21swapper/112:35:001
26258991919,0cyclictest23711-21apt-get08:14:400
26258991919,0cyclictest0-21swapper/011:44:420
26258991919,0cyclictest0-21swapper/011:34:430
26258991919,0cyclictest0-21swapper/009:04:410
26258991918,1cyclictest0-21swapper/011:24:430
26258991918,0cyclictest28587-21apt-get08:24:420
26261991818,0cyclictest0-21swapper/310:14:433
26261991816,1cyclictest9196-21cron09:55:003
26260991818,0cyclictest0-21swapper/210:14:432
26260991818,0cyclictest0-21swapper/209:49:402
26260991818,0cyclictest0-21swapper/209:19:422
26259991818,0cyclictest29840-21apt-get09:34:411
26259991818,0cyclictest18921-21apt-get08:04:391
26259991818,0cyclictest0-21swapper/107:39:411
26259991818,0cyclictest0-21swapper/107:14:411
26259991817,1cyclictest24985-21apt-get09:24:401
26259991815,2cyclictest993-21grep07:25:001
26258991818,0cyclictest0-21swapper/008:39:400
26258991818,0cyclictest0-21swapper/008:34:410
26258991817,1cyclictest723-21apt-get11:54:430
26258991817,0cyclictest0-21swapper/009:14:410
26258991816,1cyclictest8291-21perf07:40:010
26258991816,1cyclictest0-21swapper/008:19:500
2625899180,1cyclictest0-21swapper/009:29:430
26261991717,0cyclictest6681-21apt-get10:59:423
26261991717,0cyclictest0-21swapper/309:19:413
26261991715,1cyclictest30979-21apt-get08:29:403
2626199170,16cyclictest22734-21apt-get12:39:383
26260991717,0cyclictest0-21swapper/210:59:422
26260991716,0cyclictest30757-21apt-get11:49:422
26260991715,1cyclictest26831-21awk09:25:012
26259991717,0cyclictest8177-21apt-get08:49:411
26259991717,0cyclictest0-21swapper/111:24:431
26259991717,0cyclictest0-21swapper/110:34:421
26259991717,0cyclictest0-21swapper/108:54:431
26259991716,1cyclictest31607-21apt-get09:35:021
26259991716,1cyclictest29237-21awk09:30:011
26258991717,0cyclictest0-21swapper/010:09:420
26258991715,1cyclictest0-21swapper/007:15:010
26261991616,0cyclictest0-21swapper/311:49:423
26261991616,0cyclictest0-21swapper/307:34:413
26261991614,1cyclictest0-21swapper/312:04:433
2626199160,11cyclictest30345-21cron08:25:003
26260991616,0cyclictest0-21swapper/211:14:432
26260991616,0cyclictest0-21swapper/207:49:392
26260991616,0cyclictest0-21swapper/207:49:392
26260991616,0cyclictest0-21swapper/207:34:412
26260991615,0cyclictest0-21swapper/208:29:402
26260991614,1cyclictest26816-21apt-get07:14:412
26259991616,0cyclictest0-21swapper/111:39:411
26259991616,0cyclictest0-21swapper/108:09:441
26259991616,0cyclictest0-21swapper/107:59:411
26259991614,1cyclictest30147-21perf11:45:001
26259991614,1cyclictest0-21swapper/110:25:481
26258991616,0cyclictest0-21swapper/010:59:420
26258991616,0cyclictest0-21swapper/009:54:420
26261991515,0cyclictest0-21swapper/311:19:423
26261991515,0cyclictest0-21swapper/308:54:423
26261991511,3cyclictest27733-21smartctl10:34:443
2626199150,1cyclictest10740-21apt-get12:14:413
26260991515,0cyclictest0-21swapper/210:49:432
26260991515,0cyclictest0-21swapper/208:54:422
26260991513,1cyclictest30348-21ls08:25:002
26260991513,1cyclictest0-21swapper/209:29:412
2626099151,13cyclictest27516-21diskstats10:34:432
2626099150,6cyclictest0-21swapper/212:09:412
2626099150,14cyclictest0-21swapper/212:12:132
2626099150,14cyclictest0-21swapper/210:09:462
26258991515,0cyclictest0-21swapper/011:29:420
26258991515,0cyclictest0-21swapper/008:49:410
2625899150,14cyclictest9206-21apt-get09:55:020
26261991414,0cyclictest0-21swapper/308:10:273
2626199140,14cyclictest0-21swapper/310:50:303
2626199140,14cyclictest0-21swapper/310:06:183
2626199140,14cyclictest0-21swapper/308:15:593
2626199140,14cyclictest0-21swapper/308:05:133
2626199140,14cyclictest0-21swapper/307:12:273
2626199140,0cyclictest0-21swapper/312:05:033
2626199140,0cyclictest0-21swapper/311:05:213
2626199140,0cyclictest0-21swapper/310:15:313
2626199140,0cyclictest0-21swapper/310:15:313
2626199140,0cyclictest0-21swapper/309:00:203
2626099140,14cyclictest0-21swapper/212:35:132
2626099140,14cyclictest0-21swapper/211:05:362
2626099140,14cyclictest0-21swapper/210:50:302
2626099140,14cyclictest0-21swapper/209:30:142
2626099140,14cyclictest0-21swapper/209:02:092
2626099140,14cyclictest0-21swapper/207:21:072
2626099140,0cyclictest0-21swapper/212:00:302
2626099140,0cyclictest0-21swapper/210:15:442
2626099140,0cyclictest0-21swapper/210:15:442
2626099140,0cyclictest0-21swapper/208:05:132
26259991414,0cyclictest0-21swapper/112:36:081
26259991414,0cyclictest0-21swapper/109:10:071
2625999140,14cyclictest0-21swapper/112:10:301
2625999140,14cyclictest0-21swapper/111:50:181
2625999140,14cyclictest0-21swapper/109:00:181
2625999140,14cyclictest0-21swapper/108:25:101
26258991414,0cyclictest0-21swapper/010:46:070
26258991414,0cyclictest0-21swapper/008:40:120
26258991414,0cyclictest0-21swapper/007:20:280
2625899140,14cyclictest0-21swapper/012:30:200
2625899140,14cyclictest0-21swapper/011:05:120
2625899140,0cyclictest0-21swapper/011:00:190
2625899140,0cyclictest0-21swapper/010:26:110
2625899140,0cyclictest0-21swapper/009:30:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional