You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 17:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Tue Dec 09, 2025 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15453992422,1cyclictest17173-21sendmail08:20:002
1544299240,23cyclictest17796-21cron07:15:000
1544299240,23cyclictest10337-21apt-get11:28:420
1545399230,2cyclictest7376-21turbostat.cron11:20:002
1545399230,2cyclictest29218-21dump-pmu-power08:45:002
1545399230,23cyclictest21828-21apt-get09:38:402
1545399230,21cyclictest313-21systemd-journal11:55:002
15448992322,1cyclictest24948-21apt-get08:38:391
1544899231,21cyclictest11993-21sh08:10:001
1544899231,21cyclictest0-21swapper/107:18:391
1544899230,1cyclictest17577-21/usr/sbin/munin11:43:381
15442992320,2cyclictest2573-21cron11:10:000
1544299230,2cyclictest9765-21cron11:25:010
15456992221,1cyclictest9609-21apt-get12:33:393
15456992220,1cyclictest30886-21turbostat.cron09:55:003
1545699220,21cyclictest593-21dbus-daemon11:10:003
1545699220,21cyclictest27435-21awk07:35:003
1545699220,21cyclictest18355-21apt-get07:18:393
1545699220,21cyclictest0-21swapper/311:18:403
1545699220,1cyclictest8470-21cron10:15:003
15453992221,1cyclictest24805-21apt-get11:58:412
15453992221,1cyclictest2396-21apt-get12:18:392
15453992220,1cyclictest593-21dbus-daemon09:30:002
1545399220,21cyclictest4739-21cat07:55:002
1545399220,21cyclictest29950-21awk07:40:002
1545399220,21cyclictest2543-21apt-get08:58:382
1545399220,21cyclictest22960-21idleruntime-cro10:45:002
1545399220,21cyclictest0-21swapper/212:28:402
1545399220,1cyclictest32606-21munin-run11:05:002
1545399220,1cyclictest0-21swapper/208:08:392
1545399220,0cyclictest12213-21apt-get09:18:402
15448992220,1cyclictest612-21gdbus10:35:011
15448992220,1cyclictest25394-21munin-run10:50:001
15448992220,1cyclictest14791-21perf08:15:001
1544899220,21cyclictest0-21swapper/111:18:401
1544899220,21cyclictest0-21swapper/108:03:381
1544899220,21cyclictest0-21swapper/107:53:401
1544899220,1cyclictest0-21swapper/111:30:001
15442992222,0cyclictest0-21swapper/009:58:400
15442992220,1cyclictest0-21swapper/011:20:000
1544299220,22cyclictest612-21gdbus07:44:590
1544299220,21cyclictest3119-21apt-get11:13:390
1544299220,21cyclictest17180-21cron08:20:000
1544299220,21cyclictest0-21swapper/008:13:410
15456992121,0cyclictest0-21swapper/311:33:413
15456992121,0cyclictest0-21swapper/310:18:433
15456992120,0cyclictest11991-21apt-get08:10:023
15456992119,1cyclictest9075-21apt12:30:003
1545699210,20cyclictest0-21swapper/312:38:383
1545699210,20cyclictest0-21swapper/309:58:403
1545699210,0cyclictest0-21swapper/308:28:383
1545699210,0cyclictest0-21swapper/307:48:393
15453992121,0cyclictest25922-21apt-get10:53:402
15453992121,0cyclictest18711-21apt-get10:38:412
15453992120,1cyclictest0-21swapper/210:18:432
15453992119,1cyclictest20152-21apt-get08:28:392
15453992119,1cyclictest11682-21munin-plugin-st09:15:002
1545399210,20cyclictest419-21apt-get07:48:392
1545399210,20cyclictest12929-21apt-get08:13:402
1545399210,0cyclictest15183-21apt-get11:38:412
1545399210,0cyclictest0-21swapper/212:13:422
1545399210,0cyclictest0-21swapper/207:43:402
15448992121,0cyclictest0-21swapper/112:38:371
15448992121,0cyclictest0-21swapper/111:58:421
15448992121,0cyclictest0-21swapper/109:58:401
15448992121,0cyclictest0-21swapper/109:18:411
15448992119,1cyclictest609-21polkitd11:35:001
1544899210,20cyclictest0-21swapper/112:28:401
1544899210,20cyclictest0-21swapper/110:53:391
1544899210,20cyclictest0-21swapper/110:18:431
1544899210,20cyclictest0-21swapper/109:48:391
1544899210,20cyclictest0-21swapper/108:45:021
1544899210,1cyclictest15778-21perf10:30:001
1544899210,0cyclictest25568-21apt-get07:33:411
1544899210,0cyclictest0-21swapper/109:03:381
15442992121,0cyclictest0-21swapper/012:23:410
15442992121,0cyclictest0-21swapper/008:28:390
15442992119,1cyclictest21874-21wc11:50:000
15442992119,1cyclictest0-21swapper/008:10:010
1544299210,20cyclictest0-21swapper/012:28:400
1544299210,20cyclictest0-21swapper/010:03:410
1544299210,0cyclictest0-21swapper/012:18:390
1544299210,0cyclictest0-21swapper/012:08:400
1544299210,0cyclictest0-21swapper/010:43:420
15456992020,0cyclictest0-21swapper/312:18:393
15456992020,0cyclictest0-21swapper/309:28:433
15456992020,0cyclictest0-21swapper/307:43:393
15456992019,1cyclictest2872-21apt-get07:53:403
15456992019,0cyclictest0-21swapper/310:33:403
15456992018,1cyclictest13370-21perf10:25:003
15456992018,1cyclictest0-21swapper/308:23:373
1545699200,1cyclictest14096-21sendmail-msp09:20:003
1545699200,0cyclictest0-21swapper/308:48:393
15453992020,0cyclictest7684-21apt-get08:03:382
15453992020,0cyclictest24246-21apt-get09:43:402
15453992020,0cyclictest20770-21apt-get07:23:372
15453992020,0cyclictest0-21swapper/211:08:402
15453992020,0cyclictest0-21swapper/210:48:402
15453992020,0cyclictest0-21swapper/207:13:392
15453992018,1cyclictest31489-21perf12:10:002
15453992017,2cyclictest11540-21grep12:35:002
1545399200,20cyclictest0-21swapper/207:28:422
1545399200,0cyclictest0-21swapper/208:33:412
15448992020,0cyclictest0-21swapper/112:03:401
15448992020,0cyclictest0-21swapper/111:23:411
15448992020,0cyclictest0-21swapper/109:23:411
15448992018,1cyclictest17181-21sh08:20:001
1544899200,20cyclictest0-21swapper/110:15:001
1544899200,20cyclictest0-21swapper/107:13:381
1544899200,0cyclictest0-21swapper/108:53:381
1544899200,0cyclictest0-21swapper/108:33:411
1544899200,0cyclictest0-21swapper/107:38:401
15442992020,0cyclictest9040-21apt-get10:18:430
15442992020,0cyclictest0-21swapper/012:38:380
15442992020,0cyclictest0-21swapper/008:48:380
15442992020,0cyclictest0-21swapper/008:33:410
15442992020,0cyclictest0-21swapper/007:48:380
15442992020,0cyclictest0-21swapper/007:33:420
15442992020,0cyclictest0-21swapper/007:18:390
15442992019,1cyclictest27963-21apt-get07:38:390
15442992019,1cyclictest0-21swapper/007:53:390
15442992018,1cyclictest30885-21apt09:55:000
1544299200,20cyclictest0-21swapper/010:58:410
1544299200,20cyclictest0-21swapper/010:28:400
1544299200,0cyclictest0-21swapper/011:33:410
1544299200,0cyclictest0-21swapper/010:08:400
1544299200,0cyclictest0-21swapper/009:18:410
1544299200,0cyclictest0-21swapper/009:03:390
1544299200,0cyclictest0-21swapper/007:58:410
15456991919,0cyclictest0-21swapper/311:28:423
15456991919,0cyclictest0-21swapper/311:13:403
15456991919,0cyclictest0-21swapper/310:43:423
15456991919,0cyclictest0-21swapper/309:38:393
15456991919,0cyclictest0-21swapper/307:13:393
15456991918,1cyclictest0-21swapper/308:58:383
1545699190,18cyclictest0-21swapper/309:05:003
1545699190,0cyclictest0-21swapper/312:13:413
15453991919,0cyclictest4819-21apt-get12:23:422
15453991919,0cyclictest12788-21apt-get11:33:412
15453991919,0cyclictest12059-21apt-get12:38:382
15453991919,0cyclictest0-21swapper/211:43:392
15453991919,0cyclictest0-21swapper/210:33:402
15453991919,0cyclictest0-21swapper/210:13:392
15453991919,0cyclictest0-21swapper/209:33:392
15453991919,0cyclictest0-21swapper/208:53:382
15453991919,0cyclictest0-21swapper/207:58:412
15453991919,0cyclictest0-21swapper/207:18:392
15453991917,1cyclictest28517-21cut09:50:012
15453991917,1cyclictest14630-21apt-get09:23:412
15448991919,0cyclictest0-21swapper/112:08:391
15448991919,0cyclictest0-21swapper/111:38:401
15448991919,0cyclictest0-21swapper/109:28:431
15448991917,1cyclictest3277-21cron10:05:001
15442991919,0cyclictest0-21swapper/012:33:390
15442991919,0cyclictest0-21swapper/011:43:390
15442991919,0cyclictest0-21swapper/010:38:410
15442991918,1cyclictest23522-21apt-get10:48:400
15456991818,0cyclictest0-21swapper/312:08:393
15456991818,0cyclictest0-21swapper/311:48:423
15456991818,0cyclictest0-21swapper/310:38:413
15456991818,0cyclictest0-21swapper/310:03:413
15456991818,0cyclictest0-21swapper/309:13:393
15456991818,0cyclictest0-21swapper/308:43:403
15456991817,0cyclictest23172-21apt-get07:28:423
1545699180,0cyclictest0-21swapper/310:48:403
15448991818,0cyclictest32409-21apt-get12:13:411
15448991818,0cyclictest0-21swapper/112:33:391
15448991818,0cyclictest0-21swapper/112:18:391
15448991818,0cyclictest0-21swapper/110:40:001
15448991818,0cyclictest0-21swapper/109:53:401
15442991818,0cyclictest0-21swapper/009:28:430
15456991717,0cyclictest0-21swapper/312:03:403
15456991717,0cyclictest0-21swapper/311:23:413
15456991717,0cyclictest0-21swapper/307:38:393
15456991716,1cyclictest22551-21apt-get08:33:413
15456991716,1cyclictest17609-21apt-get11:43:393
1545699170,0cyclictest0-21swapper/307:58:413
15453991717,0cyclictest0-21swapper/211:23:412
15453991717,0cyclictest0-21swapper/210:05:012
15453991717,0cyclictest0-21swapper/210:03:412
15448991717,0cyclictest0-21swapper/110:23:391
15448991717,0cyclictest0-21swapper/107:48:391
1544899170,15cyclictest313-21systemd-journal11:12:581
15442991717,0cyclictest0-21swapper/010:33:400
15442991717,0cyclictest0-21swapper/010:13:390
15442991717,0cyclictest0-21swapper/009:38:380
15442991716,0cyclictest0-21swapper/008:23:370
1544299170,1cyclictest27777-21latency_hist10:55:000
15456991616,0cyclictest0-21swapper/311:55:003
15456991616,0cyclictest0-21swapper/309:33:393
15456991616,0cyclictest0-21swapper/309:08:393
15456991614,1cyclictest0-21swapper/311:38:403
1545699160,16cyclictest0-21swapper/308:08:433
15453991613,2cyclictest24951-21chrt08:38:402
15453991613,2cyclictest14513-21tail10:28:432
1545399160,15cyclictest31042-21munin-run09:55:002
15448991616,0cyclictest19431-21apt-get09:33:391
15448991616,0cyclictest0-21swapper/112:23:421
15448991616,0cyclictest0-21swapper/111:53:421
15448991616,0cyclictest0-21swapper/111:08:421
15448991616,0cyclictest0-21swapper/111:03:391
15448991616,0cyclictest0-21swapper/107:58:401
15448991616,0cyclictest0-21swapper/107:23:381
15442991616,0cyclictest0-21swapper/010:25:000
15442991616,0cyclictest0-21swapper/008:58:380
15442991616,0cyclictest0-21swapper/008:43:400
15442991614,1cyclictest0-21swapper/011:55:000
15442991614,1cyclictest0-21swapper/009:08:390
1544299160,15cyclictest0-21swapper/011:38:400
15456991515,0cyclictest0-21swapper/310:28:403
15456991513,1cyclictest25395-21cut09:43:463
1545699150,1cyclictest5340-21grep12:23:443
15453991515,0cyclictest0-21swapper/208:23:372
15453991512,2cyclictest10526-21cpuspeed_turbos11:28:432
1545399150,1cyclictest31437-21apt-get09:58:382
1545399150,1cyclictest0-21swapper/211:10:532
15448991515,0cyclictest0-21swapper/109:08:391
1544899150,7cyclictest0-21swapper/108:43:401
15442991515,0cyclictest0-21swapper/012:03:400
15442991515,0cyclictest0-21swapper/007:28:420
15456991414,0cyclictest0-21swapper/309:48:393
15456991414,0cyclictest0-21swapper/307:21:313
1545699140,14cyclictest0-21swapper/311:55:583
1545699140,14cyclictest0-21swapper/310:07:203
1545699140,14cyclictest0-21swapper/308:52:393
1545699140,14cyclictest0-21swapper/308:36:023
1545699140,14cyclictest0-21swapper/308:16:463
1545699140,14cyclictest0-21swapper/308:03:363
1545699140,0cyclictest0-21swapper/311:03:123
1545699140,0cyclictest0-21swapper/310:51:333
1545699140,0cyclictest0-21swapper/309:20:513
15453991414,0cyclictest0-21swapper/209:01:342
1545399140,14cyclictest0-21swapper/212:01:392
1545399140,14cyclictest0-21swapper/210:55:012
1545399140,14cyclictest0-21swapper/209:05:002
1545399140,0cyclictest0-21swapper/211:45:582
1545399140,0cyclictest0-21swapper/210:21:072
15448991414,0cyclictest0-21swapper/109:41:541
15448991414,0cyclictest0-21swapper/109:10:001
15448991414,0cyclictest0-21swapper/107:28:421
1544899140,14cyclictest0-21swapper/110:06:001
1544899140,14cyclictest0-21swapper/108:55:241
1544899140,14cyclictest0-21swapper/108:28:561
1544899140,14cyclictest0-21swapper/107:40:201
1544899140,0cyclictest0-21swapper/110:55:051
15442991414,0cyclictest0-21swapper/009:48:440
15442991414,0cyclictest0-21swapper/009:40:290
15442991414,0cyclictest0-21swapper/009:31:240
15442991414,0cyclictest0-21swapper/008:37:320
15442991414,0cyclictest0-21swapper/008:00:080
15442991414,0cyclictest0-21swapper/007:20:210
1544299140,14cyclictest0-21swapper/011:56:380
1544299140,14cyclictest0-21swapper/011:04:020
1544299140,0cyclictest0-21swapper/012:11:420
1544299140,0cyclictest0-21swapper/009:21:250
1544299140,0cyclictest0-21swapper/008:53:410
15453991313,0cyclictest0-21swapper/207:31:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional