You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 19:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jun 13, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1006799280,27cyclictest0-21swapper/212:07:262
1007299264,21cyclictest10040-21ssh12:19:403
10072992625,1cyclictest3416-21diskmemload11:05:413
10067992620,5cyclictest379-21apt-get10:39:382
1006799260,25cyclictest31679-21apt-get11:39:382
1006799260,25cyclictest23303-21memory09:59:412
1006799260,25cyclictest0-21swapper/212:13:412
1006799260,25cyclictest0-21swapper/209:51:372
10062992624,1cyclictest8425-21sh12:18:230
1007299253,21cyclictest3416-21diskmemload12:39:473
10072992523,2cyclictest0-21swapper/311:04:373
1007299252,22cyclictest27382-21ssh09:34:023
1007299250,24cyclictest3416-21diskmemload10:39:223
1007299250,24cyclictest0-21swapper/309:46:313
10067992523,2cyclictest0-21swapper/212:38:382
10067992519,5cyclictest14846-21sendmail-msp07:20:012
10067992519,5cyclictest0-21swapper/209:19:372
10067992518,1cyclictest622-21gdbus08:35:002
1006799250,24cyclictest487-21apt-get10:09:362
1006799250,24cyclictest0-21swapper/211:55:402
1006799250,24cyclictest0-21swapper/209:26:162
1006799250,1cyclictest0-21swapper/212:03:072
1006299250,24cyclictest0-21swapper/010:50:460
10072992423,1cyclictest0-21swapper/309:59:373
10072992423,1cyclictest0-21swapper/309:25:353
10072992422,1cyclictest6911-21ssh11:45:083
10072992422,1cyclictest31514-21ssh10:07:313
10072992422,1cyclictest10991-21sh09:18:113
1007299242,21cyclictest0-21swapper/311:33:363
10072992422,1cyclictest0-21swapper/310:10:453
1007299242,21cyclictest0-21swapper/309:20:083
1007299240,24cyclictest0-21swapper/311:18:113
1007299240,0cyclictest0-21swapper/310:45:183
10067992420,3cyclictest0-21swapper/210:29:052
10067992420,3cyclictest0-21swapper/209:44:392
10067992419,4cyclictest32357-21ssh09:38:292
1006799240,23cyclictest3416-21diskmemload11:02:592
1006799240,23cyclictest3416-21diskmemload10:17:112
1006799240,23cyclictest27948-21apt-get07:49:362
1006799240,23cyclictest0-21swapper/212:33:422
1006799240,23cyclictest0-21swapper/211:41:422
1006799240,23cyclictest0-21swapper/211:34:342
1006799240,23cyclictest0-21swapper/211:22:522
1006799240,23cyclictest0-21swapper/211:06:042
1006799240,23cyclictest0-21swapper/209:32:492
1006799240,20cyclictest0-21swapper/211:13:232
1006799240,0cyclictest0-21swapper/212:20:242
1006799240,0cyclictest0-21swapper/212:18:422
10064992421,2cyclictest31203-21sh11:38:531
1006499240,24cyclictest3416-21diskmemload10:33:511
1006499240,23cyclictest0-21swapper/110:03:311
1006499240,1cyclictest20752-21sh09:26:581
1006499240,0cyclictest0-21swapper/112:05:381
10062992423,0cyclictest0-21swapper/010:00:330
10062992419,4cyclictest23845-21perf10:30:010
1006299240,24cyclictest0-21swapper/010:46:190
1006299240,23cyclictest8115-21ssh11:16:040
1006299240,23cyclictest3416-21diskmemload11:47:490
1006299240,23cyclictest3416-21diskmemload10:41:070
1006299240,23cyclictest0-21swapper/012:20:080
1006299240,0cyclictest3416-21diskmemload11:44:060
10072992323,0cyclictest0-21swapper/310:23:403
10072992323,0cyclictest0-21swapper/310:19:553
10072992323,0cyclictest0-21swapper/310:01:333
10072992323,0cyclictest0-21swapper/309:40:583
10072992323,0cyclictest0-21swapper/309:14:123
10072992322,1cyclictest0-21swapper/312:05:473
10072992322,1cyclictest0-21swapper/311:58:213
10072992321,2cyclictest0-21swapper/312:04:463
10072992320,2cyclictest5092-21fschecks_time11:44:393
10072992320,2cyclictest24949-21grep07:40:003
10072992320,2cyclictest23801-21perf08:45:013
10072992320,2cyclictest16963-21sh12:25:113
1007299231,22cyclictest0-21swapper/309:54:213
1007299231,22cyclictest0-21swapper/308:11:213
1007299231,21cyclictest3416-21diskmemload11:36:353
1007299231,1cyclictest0-21swapper/310:56:333
1007299230,22cyclictest20371-21ssh11:28:283
1007299230,22cyclictest0-21swapper/308:19:373
1007299230,1cyclictest0-21swapper/311:52:473
1007299230,1cyclictest0-21swapper/308:24:373
1007299230,0cyclictest3416-21diskmemload11:20:043
1007299230,0cyclictest0-21swapper/312:23:353
1007299230,0cyclictest0-21swapper/310:52:173
1007299230,0cyclictest0-21swapper/310:43:053
1007299230,0cyclictest0-21swapper/309:36:203
10067992323,0cyclictest0-21swapper/211:51:492
10067992323,0cyclictest0-21swapper/211:15:142
10067992323,0cyclictest0-21swapper/210:59:332
10067992321,1cyclictest606-21dbus-daemon07:35:002
10067992320,3cyclictest0-21swapper/210:21:112
10067992320,3cyclictest0-21swapper/210:02:442
10067992320,2cyclictest0-21swapper/209:45:472
10067992319,4cyclictest0-21swapper/211:29:362
10067992317,0cyclictest0-21swapper/207:39:372
1006799230,2cyclictest6982-21wc08:10:012
1006799230,23cyclictest0-21swapper/210:42:552
1006799230,22cyclictest8760-21sh11:47:572
1006799230,22cyclictest29592-21sh10:35:012
1006799230,0cyclictest3416-21diskmemload10:47:402
1006799230,0cyclictest0-21swapper/209:21:022
10064992323,0cyclictest0-21swapper/112:35:451
10064992323,0cyclictest0-21swapper/112:10:151
10064992323,0cyclictest0-21swapper/111:06:291
10064992323,0cyclictest0-21swapper/110:15:111
10064992323,0cyclictest0-21swapper/109:38:261
10064992321,2cyclictest10147-21ssh10:48:091
10064992321,1cyclictest622-21gdbus07:55:011
10064992321,1cyclictest0-21swapper/110:42:381
10064992320,2cyclictest7432-21ssh12:16:491
1006499230,23cyclictest3416-21diskmemload11:19:241
1006499230,23cyclictest0-21swapper/109:19:221
1006499230,22cyclictest9261-21ssh09:45:531
1006499230,22cyclictest30328-21sh10:35:521
1006499230,22cyclictest24334-21ssh11:00:341
1006499230,22cyclictest23944-21latency_hist10:30:011
1006499230,22cyclictest2368-21ssh11:10:111
1006499230,22cyclictest19920-21sh11:27:511
1006499230,22cyclictest17583-21ssh11:55:081
1006499230,22cyclictest15194-21rm11:23:351
1006499230,22cyclictest12751-21sh11:50:561
1006499230,22cyclictest0-21swapper/112:29:371
1006499230,0cyclictest0-21swapper/112:33:261
1006499230,0cyclictest0-21swapper/112:04:001
1006499230,0cyclictest0-21swapper/111:30:301
1006499230,0cyclictest0-21swapper/110:50:311
10062992323,0cyclictest62550irq/127-eno112:37:040
10062992323,0cyclictest0-21swapper/010:12:590
10062992323,0cyclictest0-21swapper/009:31:200
10062992323,0cyclictest0-21swapper/008:39:390
10062992322,1cyclictest62550irq/127-eno110:34:570
10062992322,1cyclictest0-21swapper/010:22:460
10062992321,1cyclictest2969-21ssh11:11:120
10062992320,2cyclictest23771-21sh11:30:300
10062992320,2cyclictest1680-21rm12:11:130
1006299230,23cyclictest3416-21diskmemload09:24:130
1006299230,23cyclictest0-21swapper/010:18:170
1006299230,23cyclictest0-21swapper/010:08:520
1006299230,23cyclictest0-21swapper/009:48:010
1006299230,23cyclictest0-21swapper/009:41:280
1006299230,22cyclictest62550irq/127-eno111:55:210
1006299230,22cyclictest3416-21diskmemload10:36:590
1006299230,22cyclictest3416-21diskmemload09:36:380
1006299230,22cyclictest24497-21ssh11:00:470
1006299230,22cyclictest22010-21apt-get08:44:370
1006299230,22cyclictest15652-21ssh09:52:340
1006299230,22cyclictest15589-21ssh11:24:170
1006299230,22cyclictest0-21swapper/009:10:440
1006299230,0cyclictest0-21swapper/012:05:530
1006299230,0cyclictest0-21swapper/011:28:160
10072992221,1cyclictest0-21swapper/308:59:363
10072992220,1cyclictest3416-21diskmemload12:30:433
10072992219,2cyclictest3416-21diskmemload09:10:003
1007299220,21cyclictest5189-21apt-get08:09:353
1007299220,21cyclictest0-21swapper/310:25:413
1007299220,21cyclictest0-21swapper/307:24:373
1007299220,1cyclictest25009-21ssh10:30:543
10067992220,1cyclictest16937-21ssh12:25:092
1006799220,22cyclictest0-21swapper/208:54:372
1006799220,21cyclictest30991-21turbostat.cron09:00:012
1006799220,21cyclictest12435-21munin-run07:15:012
1006799220,21cyclictest0-21swapper/209:11:262
10064992222,0cyclictest0-21swapper/110:06:011
10064992222,0cyclictest0-21swapper/109:51:411
10064992222,0cyclictest0-21swapper/109:32:121
10064992220,2cyclictest20338-21ssh09:56:331
1006499220,22cyclictest0-21swapper/111:45:441
1006499220,21cyclictest24053-21latency_hist11:00:011
1006499220,21cyclictest12411-21latency_hist07:15:011
1006499220,21cyclictest0-21swapper/109:20:051
1006499220,1cyclictest5551-21ssh09:43:151
1006499220,1cyclictest5417-21irqstats11:44:411
1006499220,1cyclictest16619-21munin-run12:25:001
1006499220,1cyclictest15411-21ssh10:22:581
1006499220,1cyclictest13033-21apt-get07:19:361
1006499220,1cyclictest0-21swapper/110:13:131
1006499220,0cyclictest0-21swapper/109:10:491
10062992222,0cyclictest0-21swapper/011:50:030
10062992221,1cyclictest3416-21diskmemload11:06:390
10062992221,1cyclictest0-21swapper/009:55:530
10062992221,0cyclictest0-21swapper/012:01:130
10062992220,1cyclictest24947-21cat07:40:000
10062992220,1cyclictest17249-21sh12:25:350
1006299220,21cyclictest28926-21ssh11:35:230
1006299220,1cyclictest0-21swapper/012:34:340
1006299220,1cyclictest0-21swapper/009:00:010
1006299220,0cyclictest0-21swapper/009:16:470
1007299214,16cyclictest0-21swapper/307:44:373
1007299210,20cyclictest0-21swapper/307:29:373
1007299210,1cyclictest24403-21apt-get08:49:343
10067992120,0cyclictest12406-21apt-get08:24:372
10067992120,0cyclictest0-21swapper/208:44:372
10067992119,1cyclictest17846-21apt-get07:29:372
10067992118,0cyclictest0-21swapper/207:59:382
1006799211,0cyclictest0-21swapper/207:24:362
1006799210,0cyclictest0-21swapper/207:44:372
1006499210,1cyclictest21408-21tr08:40:001
1006499210,0cyclictest0-21swapper/108:04:361
1006299210,20cyclictest9380-21munin-run08:15:010
1006299210,1cyclictest22018-21idleruntime-cro07:35:000
1006299210,0cyclictest0-21swapper/007:59:380
10072992020,0cyclictest0-21swapper/309:04:383
10072992018,1cyclictest28678-21latency_hist08:55:013
10072992016,3cyclictest0-21swapper/308:29:363
1007299200,0cyclictest0-21swapper/307:19:363
1007299200,0cyclictest0-21swapper/307:14:373
1006799200,20cyclictest0-21swapper/208:49:342
1006799200,0cyclictest0-21swapper/207:54:362
10064992020,0cyclictest0-21swapper/108:49:341
10064992020,0cyclictest0-21swapper/107:39:371
10064992019,1cyclictest7584-21apt-get08:14:361
10064992019,1cyclictest31009-21sendmail-msp09:00:011
10064992019,1cyclictest25558-21apt-get07:44:371
10064992018,1cyclictest2194-21perf08:00:011
1006499200,0cyclictest0-21swapper/109:04:381
10062992020,0cyclictest0-21swapper/008:54:370
10062992020,0cyclictest0-21swapper/007:49:360
10062992018,1cyclictest14802-21apt-get08:29:360
1006299200,0cyclictest0-21swapper/007:29:360
10072991919,0cyclictest0-21swapper/308:39:393
10072991916,2cyclictest3965-21awk08:04:423
10067991919,0cyclictest0-21swapper/208:04:362
10064991919,0cyclictest0-21swapper/108:19:371
10062991919,0cyclictest0-21swapper/009:09:370
10062991919,0cyclictest0-21swapper/007:19:360
10062991918,0cyclictest0-21swapper/008:09:350
10062991918,0cyclictest0-21swapper/007:54:360
10062991918,0cyclictest0-21swapper/007:44:370
10072991818,0cyclictest0-21swapper/307:34:363
10062991817,1cyclictest31616-21apt-get09:04:380
10072991717,0cyclictest0-21swapper/308:34:363
10072991715,1cyclictest415-21cpuspeed_turbos07:59:383
10067991717,0cyclictest0-21swapper/209:09:372
10067991717,0cyclictest0-21swapper/208:14:362
10064991717,0cyclictest0-21swapper/108:54:371
10064991717,0cyclictest0-21swapper/108:44:371
10064991715,1cyclictest178492sleep107:29:371
10062991717,0cyclictest2797-21apt-get08:04:360
10072991614,1cyclictest32139-21grep07:55:013
10067991616,0cyclictest0-21swapper/209:04:382
10067991614,1cyclictest21370-21dump-pmu-power08:40:002
10064991616,0cyclictest0-21swapper/108:29:361
10064991616,0cyclictest0-21swapper/107:34:371
1006499160,16cyclictest0-21swapper/109:09:371
10062991616,0cyclictest0-21swapper/008:24:370
10062991614,1cyclictest12410-21awk07:15:010
10062991613,3cyclictest0-21swapper/008:33:510
10072991515,0cyclictest0-21swapper/307:49:363
10062991515,0cyclictest0-21swapper/008:49:340
10062991515,0cyclictest0-21swapper/007:24:370
1006799140,14cyclictest0-21swapper/208:26:322
1006799140,0cyclictest0-21swapper/208:15:112
10064991414,0cyclictest0-21swapper/108:05:111
10064991414,0cyclictest0-21swapper/107:45:071
1006499140,14cyclictest0-21swapper/107:20:111
1006499140,0cyclictest0-21swapper/108:20:011
1006299140,14cyclictest0-21swapper/008:15:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional