You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 10:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Thu Dec 18, 2025 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14192992523,1cyclictest4463-21apt-get21:04:380
14199992422,1cyclictest30875-21wc00:10:013
14193992422,1cyclictest16368-21perf23:40:001
1419399240,23cyclictest10528-21apt-get22:24:391
1419999230,1cyclictest14410-21apt20:19:403
1419599230,22cyclictest3444-21sendmail21:00:012
14193992322,1cyclictest0-21swapper/119:35:021
1419399230,22cyclictest5110-21perf22:10:001
1419399230,22cyclictest0-21swapper/121:00:021
14192992317,5cyclictest0-21swapper/021:39:370
1419299230,22cyclictest9160-21latency_hist23:25:010
1419299230,22cyclictest15848-21grep21:25:000
1419299230,22cyclictest12850-21perf00:40:000
1419299230,0cyclictest27553-21apt-get19:39:370
14199992221,1cyclictest828-21apt00:15:013
14199992221,1cyclictest591-21apt-get20:55:023
14199992220,1cyclictest15869-21munin-run21:25:003
1419999220,21cyclictest3885-21apt-get00:24:393
1419999220,21cyclictest28879-21apt-get20:49:393
1419999220,21cyclictest18616-21perf20:25:003
1419999220,1cyclictest622-21gdbus00:20:013
1419999220,1cyclictest24181-21apt-get23:59:403
14195992221,1cyclictest8671-21apt-get00:34:352
14195992220,1cyclictest9887-21cron22:20:002
14195992220,1cyclictest13802-21munin-run20:15:012
1419599220,21cyclictest26074-21apt-get21:49:392
1419599220,21cyclictest0-21swapper/223:39:392
1419599220,21cyclictest0-21swapper/220:09:392
1419599220,1cyclictest30663-21awk20:50:012
14193992220,1cyclictest26526-21cron19:35:001
1419399220,21cyclictest17721-21apt-get22:39:381
1419399220,21cyclictest11054-21basename21:15:001
1419399220,1cyclictest0-21swapper/121:09:381
14192992220,1cyclictest19535-21munin-run22:40:010
14192992220,1cyclictest0-21swapper/023:10:010
14192992220,1cyclictest0-21swapper/019:54:360
14192992216,5cyclictest0-21swapper/023:35:010
1419299220,21cyclictest21377-21munin-run19:25:010
1419299220,21cyclictest17103-21perf22:35:010
1419299220,21cyclictest16545-21apt19:15:010
1419299220,21cyclictest0-21swapper/022:19:390
1419299220,21cyclictest0-21swapper/020:14:380
14199992121,0cyclictest4966-21apt-get23:19:403
1419999210,21cyclictest0-21swapper/321:04:383
1419999210,20cyclictest21784-21apt-get23:54:393
1419999210,20cyclictest11063-21apt-get00:39:353
1419999210,20cyclictest0-21swapper/321:44:393
1419999210,1cyclictest19511-21apt-get22:40:023
1419999210,0cyclictest0-21swapper/323:24:383
14195992119,1cyclictest606-21dbus-daemon19:40:002
1419599210,21cyclictest0-21swapper/223:59:402
1419599210,20cyclictest30193-21apt-get23:04:412
1419599210,20cyclictest16827-21apt-get20:24:382
1419599210,20cyclictest0-21swapper/222:14:382
1419599210,20cyclictest0-21swapper/221:54:382
1419599210,20cyclictest0-21swapper/219:49:392
1419599210,1cyclictest21185-21basename23:50:002
1419599210,1cyclictest0-21swapper/221:35:012
1419599210,0cyclictest30026-21apt-get19:44:392
1419599210,0cyclictest26691-21apt-get00:04:392
1419599210,0cyclictest0-21swapper/223:19:402
14193992121,0cyclictest0-21swapper/123:14:391
14193992121,0cyclictest0-21swapper/121:44:381
14193992121,0cyclictest0-21swapper/120:24:381
14193992121,0cyclictest0-21swapper/119:59:391
14193992120,1cyclictest0-21swapper/123:29:381
1419399210,20cyclictest0-21swapper/123:34:381
14192992121,0cyclictest0-21swapper/000:19:400
14192992120,1cyclictest11653-21apt-get21:19:380
14192992119,1cyclictest6614-21munin-run20:00:010
14192992119,1cyclictest18269-21basename21:30:010
14192992118,3cyclictest0-21swapper/020:54:380
1419299210,20cyclictest29084-21apt-get00:09:390
1419299210,20cyclictest0-21swapper/023:05:000
1419299210,1cyclictest2568-21apt-get23:14:390
1419299210,0cyclictest0-21swapper/019:29:380
14199992020,0cyclictest30918-21apt-get21:59:383
14199992020,0cyclictest25323-21apt-get22:54:373
14199992020,0cyclictest12922-21apt-get22:29:393
14199992020,0cyclictest0-21swapper/321:19:383
14199992020,0cyclictest0-21swapper/320:39:383
1419999200,20cyclictest0-21swapper/321:54:383
1419999200,20cyclictest0-21swapper/319:30:023
1419999200,0cyclictest7217-21apt-get20:04:393
1419999200,0cyclictest0-21swapper/323:44:403
1419999200,0cyclictest0-21swapper/320:54:383
1419999200,0cyclictest0-21swapper/319:44:393
1419999200,0cyclictest0-21swapper/319:24:383
14195992020,0cyclictest14411-21apt-get20:19:402
14195992020,0cyclictest11653-21apt-get21:19:392
14195992020,0cyclictest0-21swapper/222:44:392
14195992020,0cyclictest0-21swapper/221:09:382
14195992020,0cyclictest0-21swapper/219:59:392
14195992020,0cyclictest0-21swapper/200:19:402
14195992019,1cyclictest21260-21apt-get21:39:372
14195992018,1cyclictest6279-21apt-get00:29:382
14195992018,1cyclictest29558-21apt23:00:002
14195992018,1cyclictest18919-21cron19:20:012
14195992018,1cyclictest0-21swapper/220:40:012
1419599200,20cyclictest0-21swapper/220:54:382
1419599200,19cyclictest23680-21apt-get21:44:392
1419599200,0cyclictest0-21swapper/221:04:382
14193992020,0cyclictest17165-21apt-get19:19:381
14193992020,0cyclictest0-21swapper/123:19:401
14193992020,0cyclictest0-21swapper/122:19:391
14193992020,0cyclictest0-21swapper/121:24:381
14193992020,0cyclictest0-21swapper/120:49:391
14193992020,0cyclictest0-21swapper/120:29:381
14193992020,0cyclictest0-21swapper/119:29:381
14193992020,0cyclictest0-21swapper/119:24:381
14193992019,1cyclictest0-21swapper/120:14:381
14193992018,1cyclictest0-21swapper/122:45:011
14193992018,1cyclictest0-21swapper/121:34:371
1419399200,20cyclictest0-21swapper/120:59:371
1419399200,19cyclictest9171-21apt23:25:011
1419399200,0cyclictest0-21swapper/123:04:411
1419399200,0cyclictest0-21swapper/120:19:401
14192992020,0cyclictest0-21swapper/020:59:380
14192992019,0cyclictest0-21swapper/021:14:380
14192992019,0cyclictest0-21swapper/020:34:380
14192992018,1cyclictest8038-21cron00:30:000
14192992018,1cyclictest28264-21latency_hist20:45:010
14192992018,1cyclictest0-21swapper/020:19:400
14192992017,3cyclictest0-21swapper/022:04:390
14192992017,3cyclictest0-21swapper/021:59:380
14192992015,0cyclictest0-21swapper/022:54:370
1419299200,0cyclictest0-21swapper/022:14:380
1419299200,0cyclictest0-21swapper/022:09:390
14199991919,0cyclictest16469-21apt-get21:29:393
14199991919,0cyclictest14574-21apt-get23:39:393
14199991919,0cyclictest0-21swapper/323:14:393
14199991919,0cyclictest0-21swapper/322:59:403
14199991919,0cyclictest0-21swapper/321:09:393
14199991918,1cyclictest26434-21apt-get20:44:393
14199991917,1cyclictest5089-21cron22:10:003
1419999190,18cyclictest0-21swapper/319:19:383
1419999190,0cyclictest0-21swapper/322:34:393
14195991919,0cyclictest0-21swapper/222:54:372
14195991919,0cyclictest0-21swapper/221:59:382
14195991919,0cyclictest0-21swapper/221:29:392
14195991919,0cyclictest0-21swapper/200:14:392
14195991918,1cyclictest14770-21apt-get19:14:392
14195991918,1cyclictest0-21swapper/200:24:392
14195991918,0cyclictest0-21swapper/222:09:392
14195991917,1cyclictest9174-21awk23:25:012
1419599190,0cyclictest0-21swapper/223:54:392
14193991919,0cyclictest0-21swapper/123:59:401
14193991919,0cyclictest0-21swapper/122:54:371
14193991919,0cyclictest0-21swapper/120:39:381
14193991919,0cyclictest0-21swapper/119:54:361
14193991919,0cyclictest0-21swapper/119:49:391
14193991919,0cyclictest0-21swapper/100:34:351
14193991919,0cyclictest0-21swapper/100:29:391
14193991918,1cyclictest21174-21basename23:50:001
14193991918,1cyclictest0-21swapper/120:55:011
14193991917,1cyclictest0-21swapper/122:00:001
14192991919,0cyclictest24014-21apt-get20:39:380
14192991919,0cyclictest0-21swapper/023:29:380
14192991919,0cyclictest0-21swapper/022:24:390
14192991919,0cyclictest0-21swapper/021:34:370
14192991919,0cyclictest0-21swapper/021:09:390
14192991919,0cyclictest0-21swapper/019:34:380
14192991918,1cyclictest0-21swapper/022:59:400
14192991917,1cyclictest31782-21cron19:45:000
14199991818,0cyclictest9611-21apt-get20:09:383
14199991818,0cyclictest9255-21apt-get21:14:383
14199991818,0cyclictest0-21swapper/322:49:393
14199991815,2cyclictest6582-21cron20:00:013
14195991818,0cyclictest0-21swapper/222:24:382
14195991817,0cyclictest29084-21apt-get00:09:402
14195991817,0cyclictest0-21swapper/222:29:392
14195991816,1cyclictest28-21ksoftirqd/219:35:002
14193991818,0cyclictest0-21swapper/123:54:391
14193991818,0cyclictest0-21swapper/119:14:381
14193991818,0cyclictest0-21swapper/100:14:391
14193991817,0cyclictest0-21swapper/120:09:391
14193991816,1cyclictest0-21swapper/100:40:001
14193991816,1cyclictest0-21swapper/100:20:011
14192991818,0cyclictest0-21swapper/021:44:390
14192991818,0cyclictest0-21swapper/020:09:380
14192991818,0cyclictest0-21swapper/000:14:400
14192991816,1cyclictest0-21swapper/022:40:020
14192991815,0cyclictest0-21swapper/023:59:400
14199991717,0cyclictest0-21swapper/319:54:363
14199991716,1cyclictest10471-21perf00:35:003
14199991715,1cyclictest21148-21cron23:50:003
14195991717,0cyclictest2568-21apt-get23:14:392
14195991717,0cyclictest0-21swapper/220:04:382
14195991716,1cyclictest0-21swapper/220:29:372
14195991715,1cyclictest28-21ksoftirqd/219:30:002
14193991717,0cyclictest5713-21apt-get22:14:371
14193991717,0cyclictest16992-21apt-get23:44:401
14193991717,0cyclictest0-21swapper/100:24:391
14193991717,0cyclictest0-21swapper/100:04:391
14192991717,0cyclictest0-21swapper/019:49:390
14192991716,1cyclictest0-21swapper/023:49:410
14192991716,1cyclictest0-21swapper/000:34:350
14192991715,1cyclictest24687-21cron22:50:000
14192991715,1cyclictest0-21swapper/019:19:380
14192991714,2cyclictest313-21systemd-journal22:30:010
1419299171,15cyclictest622-21gdbus20:25:000
14199991616,0cyclictest19219-21apt-get20:29:383
14199991616,0cyclictest0-21swapper/323:04:413
14199991616,0cyclictest0-21swapper/321:39:373
14199991616,0cyclictest0-21swapper/320:14:383
14199991614,1cyclictest19540-21idleruntime-cro22:40:013
14199991614,1cyclictest0-21swapper/300:30:003
1419999161,14cyclictest783-21snmpd19:48:523
1419999160,1cyclictest0-21swapper/323:34:403
1419999160,15cyclictest9879-21cron22:20:003
1419999160,15cyclictest28218-21timerandwakeup00:04:483
1419999160,15cyclictest16738-21munin-run19:15:013
14195991616,0cyclictest0-21swapper/222:39:382
14195991616,0cyclictest0-21swapper/222:04:392
14195991616,0cyclictest0-21swapper/200:39:352
14195991615,1cyclictest14066-21apt-get21:24:382
14195991615,0cyclictest32582-21apt-get23:09:392
14193991616,0cyclictest0-21swapper/122:34:391
14193991616,0cyclictest0-21swapper/121:19:391
14192991616,0cyclictest26074-21apt-get21:49:390
14192991616,0cyclictest0-21swapper/023:39:390
14192991614,1cyclictest21427-21chrt23:50:280
14192991614,1cyclictest0-21swapper/020:30:000
14199991515,0cyclictest0-21swapper/323:09:383
14199991515,0cyclictest0-21swapper/322:24:393
14199991515,0cyclictest0-21swapper/319:29:383
14199991513,1cyclictest0-21swapper/323:25:423
14195991515,0cyclictest15329-21apt-get22:34:382
14195991515,0cyclictest0-21swapper/219:24:382
1419599150,9cyclictest0-21swapper/220:44:392
14193991515,0cyclictest0-21swapper/121:29:391
14193991515,0cyclictest0-21swapper/100:09:401
1419399150,1cyclictest0-21swapper/121:47:451
14192991515,0cyclictest0-21swapper/023:44:400
14192991515,0cyclictest0-21swapper/023:19:400
14192991515,0cyclictest0-21swapper/020:04:390
14192991515,0cyclictest0-21swapper/000:24:390
1419999140,14cyclictest0-21swapper/322:10:093
1419999140,14cyclictest0-21swapper/322:02:373
1419999140,14cyclictest0-21swapper/320:30:073
1419999140,14cyclictest0-21swapper/319:35:183
1419999140,0cyclictest0-21swapper/321:45:203
1419999140,0cyclictest0-21swapper/321:30:163
14195991414,0cyclictest0-21swapper/221:10:462
1419599140,14cyclictest0-21swapper/223:40:452
1419599140,14cyclictest0-21swapper/223:30:342
1419599140,14cyclictest0-21swapper/223:25:392
1419599140,14cyclictest0-21swapper/222:45:252
1419599140,14cyclictest0-21swapper/220:30:292
1419599140,14cyclictest0-21swapper/219:50:452
14193991414,0cyclictest0-21swapper/122:55:071
14193991414,0cyclictest0-21swapper/121:35:301
1419399140,14cyclictest0-21swapper/122:27:071
1419399140,14cyclictest0-21swapper/122:00:071
1419399140,14cyclictest0-21swapper/121:50:101
1419399140,14cyclictest0-21swapper/120:01:311
1419399140,0cyclictest0-21swapper/120:30:071
14192991414,0cyclictest0-21swapper/000:00:010
1419299140,0cyclictest0-21swapper/021:50:160
1419299140,0cyclictest0-21swapper/020:45:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional