You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 07:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Jun 09, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
261439911038,9cyclictest27454-21ssh21:10:032
261439910637,12cyclictest0-21swapper/221:21:252
1042621040,4sleep010425-21head20:39:550
2614399993,22cyclictest0-21swapper/222:04:542
26143999722,15cyclictest0-21swapper/222:40:032
37672960,4sleep23816-21sendmail_mailtr20:25:072
26143999322,22cyclictest0-21swapper/222:45:552
26143999317,17cyclictest0-21swapper/219:40:072
52962810,6sleep35294-21ls23:00:033
52962810,6sleep35294-21ls23:00:033
26144998137,27cyclictest27571-21needreboot19:00:053
26144998135,30cyclictest1124-21snmpd21:06:223
26144998028,43cyclictest31006-21rm00:25:533
26144998028,43cyclictest31006-21rm00:25:533
112592800,5sleep3361ktimersoftd/321:34:483
26144997936,26cyclictest7395-21unixbench_multi22:15:053
26144997934,27cyclictest83371ssh23:54:223
26144997932,31cyclictest188771diskmemload22:29:153
26144997824,38cyclictest249661ssh23:29:493
26144997732,28cyclictest243761munin-node21:54:513
26144997635,26cyclictest0-21swapper/300:04:473
26144997533,35cyclictest1165-21ssh22:07:103
26144997433,35cyclictest18877-21diskmemload22:10:393
26144997432,27cyclictest22190-21munin-node23:25:013
26144997428,29cyclictest24251ssh22:55:513
26144997426,32cyclictest0-21swapper/322:41:003
26144997337,12cyclictest31569-21grep23:39:473
26144997334,23cyclictest107550irq/46-eth021:24:493
26144997333,12cyclictest8765-21aten_r1power_po23:54:423
26144997331,34cyclictest267011ssh00:19:513
26144997331,29cyclictest18877-21diskmemload22:33:073
26144997331,27cyclictest2096-21ssh21:20:063
26144997329,37cyclictest9051-21ssh23:05:243
26144997329,37cyclictest9051-21ssh23:05:243
26144997326,28cyclictest24105-21sh00:15:173
2614199733,64cyclictest0-21swapper/023:35:120
26144997234,23cyclictest13867-21aten_r1power_en23:14:413
26144997232,22cyclictest107550irq/46-eth022:35:383
26144997231,34cyclictest17245-21aten_r1power_en23:19:393
2614199725,59cyclictest18755-21load21:44:560
2614199723,13cyclictest0-21swapper/023:04:230
2614199723,13cyclictest0-21swapper/023:04:230
26144997134,29cyclictest1227-21runrttasks20:36:273
26144997131,34cyclictest18877-21diskmemload21:33:463
26144997130,26cyclictest10359-21ssh22:20:003
26144997130,26cyclictest10359-21ssh22:20:003
26144997129,19cyclictest26309-21ssh21:09:473
2614299714,58cyclictest2557-21tr22:09:471
26144997036,27cyclictest11650-21seq20:44:023
26144997033,30cyclictest0-21swapper/321:46:473
26144997033,18cyclictest14128-21ssh00:00:523
26144997031,26cyclictest15410-21ssh21:39:593
26144997031,26cyclictest15410-21ssh21:39:593
26144997030,28cyclictest0-21swapper/321:00:453
26144997030,28cyclictest0-21swapper/321:00:453
26144997028,35cyclictest2446-21ssh23:44:443
26144997028,35cyclictest2446-21ssh23:44:443
26144997028,26cyclictest18877-21diskmemload22:02:153
26144997027,26cyclictest0-21swapper/322:46:553
26144996931,25cyclictest29064-21timerwakeupswit23:35:023
26144996930,32cyclictest23129-21ssh21:51:003
26144996928,33cyclictest10907-21sshd23:09:453
26144996832,20cyclictest18877-21diskmemload00:12:553
26144996830,32cyclictest30294-21ssh22:49:543
2614299685,54cyclictest0-21swapper/122:35:411
26144996725,25cyclictest30123-21ssh21:14:513
26144996636,13cyclictest25686-21diskstats20:04:533
26144996632,23cyclictest831-21latency_hist19:14:403
26143996637,14cyclictest0-21swapper/222:23:542
26143996637,14cyclictest0-21swapper/222:23:542
2614299663,28cyclictest0-21swapper/122:56:041
2614199663,54cyclictest0-21swapper/021:40:080
2614199663,54cyclictest0-21swapper/021:40:080
219499660,7rtkit-daemon0-21swapper/321:04:010
219499660,7rtkit-daemon0-21swapper/321:04:010
26143996539,12cyclictest0-21swapper/221:39:542
26143996539,12cyclictest0-21swapper/221:39:542
2614199655,52cyclictest0-21swapper/022:55:040
26144996445,12cyclictest17701-21crond19:49:383
26144996437,20cyclictest28823-21aten_r1power_fr19:04:513
26144996436,22cyclictest5645-21taskset19:23:003
26144996429,13cyclictest22980-21cpuspeed19:59:523
26144996428,17cyclictest0-21swapper/319:56:083
2614199645,53cyclictest0-21swapper/023:40:030
2614199644,52cyclictest0-21swapper/020:59:350
26144996344,13cyclictest17916-21needreboot20:55:003
26144996344,12cyclictest712-21smartctl20:19:563
26144996342,16cyclictest107550irq/46-eth019:29:513
26144996333,13cyclictest4529-21idleruntime-cro20:29:363
2614299634,9cyclictest20942-21uptime21:00:101
2614299634,9cyclictest20942-21uptime21:00:101
2614299634,51cyclictest0-21swapper/123:49:381
2614299634,50cyclictest7949-21cut23:04:471
2614299634,50cyclictest7949-21cut23:04:471
2614299633,52cyclictest0-21swapper/123:19:401
2614199635,51cyclictest0-21swapper/023:44:400
2614199635,51cyclictest0-21swapper/023:44:400
2614199635,51cyclictest0-21swapper/021:50:070
2614199635,51cyclictest0-21swapper/000:19:470
2614199635,50cyclictest21725-21latency23:24:530
2614199635,50cyclictest0-21swapper/022:02:400
2614199635,50cyclictest0-21swapper/000:24:540
2614199635,50cyclictest0-21swapper/000:24:540
2614199634,52cyclictest0-21swapper/021:14:520
2614199633,54cyclictest0-21swapper/023:22:330
2614299624,51cyclictest0-21swapper/122:02:291
26142996222,33cyclictest32523-21proc_pri22:04:581
2614199625,50cyclictest0-21swapper/023:30:020
2614199625,50cyclictest0-21swapper/023:14:590
2614199625,11cyclictest0-21swapper/022:14:490
2614199624,51cyclictest0-21swapper/022:29:500
2614199624,50cyclictest0-21swapper/022:10:010
2614199624,50cyclictest0-21swapper/021:30:070
26144996143,12cyclictest30221-21cpuspeed_turbos20:14:503
26144996143,12cyclictest30221-21cpuspeed_turbos20:14:503
26144996143,11cyclictest8154-21crond19:29:383
26144996140,13cyclictest16006-21unixbench_multi20:50:083
26144996133,20cyclictest18956-21munin-node19:49:583
26144996122,33cyclictest0-21swapper/319:41:363
26143996139,10cyclictest0-21swapper/223:28:132
26143996138,10cyclictest0-21swapper/200:26:052
26143996138,10cyclictest0-21swapper/200:26:052
26143996136,10cyclictest13586-21yum-updatesd-he21:38:252
2614299615,49cyclictest0-21swapper/120:44:471
2614299614,50cyclictest0-21swapper/122:15:011
2614299614,49cyclictest0-21swapper/123:14:311
2614299614,49cyclictest0-21swapper/121:49:331
2614299614,49cyclictest0-21swapper/121:23:151
2614299614,49cyclictest0-21swapper/121:09:321
2614299614,13cyclictest0-21swapper/121:38:251
2614299613,11cyclictest0-21swapper/122:29:321
2614199615,13cyclictest0-21swapper/023:04:500
2614199615,13cyclictest0-21swapper/023:04:500
2614199614,50cyclictest0-21swapper/022:41:510
2614199614,50cyclictest0-21swapper/021:55:000
2614199614,50cyclictest0-21swapper/020:15:070
2614199614,50cyclictest0-21swapper/020:15:070
2614199614,49cyclictest0-21swapper/021:10:310
2614199614,49cyclictest0-21swapper/000:11:380
2614199613,52cyclictest0-21swapper/022:49:010
2614199613,51cyclictest0-21swapper/022:19:520
2614199613,51cyclictest0-21swapper/022:19:520
2614199613,14cyclictest0-21swapper/000:14:390
2614199613,11cyclictest0-21swapper/022:38:130
26144996041,11cyclictest1124-21snmpd20:09:493
26144996036,17cyclictest12632-21fschecks_time20:44:533
26144996034,19cyclictest10779-21munin-node19:34:543
26144996034,19cyclictest10779-21munin-node19:34:543
26143996038,10cyclictest0-21swapper/200:11:222
26143996020,24cyclictest0-21swapper/222:12:402
2614299604,49cyclictest0-21swapper/123:46:201
2614299604,49cyclictest0-21swapper/123:46:201
2614299604,49cyclictest0-21swapper/123:35:001
2614299604,49cyclictest0-21swapper/123:24:431
2614299603,50cyclictest27768-21unixbench_multi21:10:071
2614299603,50cyclictest0-21swapper/122:51:361
2614199605,48cyclictest1400-21gltestperf21:19:540
2614199605,48cyclictest0-21swapper/022:25:090
2614199605,48cyclictest0-21swapper/000:04:470
2614199604,50cyclictest0-21swapper/022:50:250
2614199604,49cyclictest0-21swapper/022:07:500
2614199604,49cyclictest0-21swapper/021:37:530
2614199604,49cyclictest0-21swapper/019:00:000
2614199604,48cyclictest22772-21grep21:04:480
2614199604,48cyclictest0-21swapper/019:57:520
2614199603,51cyclictest0-21swapper/021:24:540
26144995942,12cyclictest1468-21cpuspeed_turbos19:14:533
26143995937,10cyclictest0-21swapper/222:59:562
26143995937,10cyclictest0-21swapper/222:59:562
2614299595,46cyclictest0-21swapper/121:15:031
2614299594,50cyclictest0-21swapper/119:55:071
2614299594,48cyclictest0-21swapper/121:42:541
2614299594,48cyclictest0-21swapper/121:42:541
2614299594,48cyclictest0-21swapper/119:05:091
2614299594,47cyclictest0-21swapper/100:23:331
2614299594,47cyclictest0-21swapper/100:04:421
2614299594,14cyclictest0-21swapper/123:16:181
2614299594,14cyclictest0-21swapper/123:03:111
2614299594,14cyclictest0-21swapper/123:03:111
2614299593,49cyclictest0-21swapper/123:29:581
2614299593,49cyclictest0-21swapper/121:50:051
2614299593,13cyclictest0-21swapper/100:25:531
2614299593,13cyclictest0-21swapper/100:25:531
2614199595,48cyclictest0-21swapper/023:09:540
2614199594,48cyclictest0-21swapper/023:49:590
2614199594,48cyclictest0-21swapper/020:36:500
2614199594,48cyclictest0-21swapper/019:15:100
2614199593,13cyclictest0-21swapper/023:59:210
219499590,6rtkit-daemon0-21swapper/320:15:112
219499590,6rtkit-daemon0-21swapper/320:15:112
26144995839,12cyclictest5160-21sshd20:29:513
2614399585,39cyclictest0-21swapper/221:45:142
26143995825,14cyclictest0-21swapper/221:30:032
26143995814,26cyclictest0-21swapper/221:55:252
2614299587,45cyclictest18625-21cut19:49:551
2614299585,44cyclictest22786-21head19:59:501
2614299584,49cyclictest0-21swapper/123:40:491
2614299584,48cyclictest0-21swapper/122:20:471
2614299584,48cyclictest0-21swapper/122:20:471
2614299584,48cyclictest0-21swapper/121:29:261
2614299584,47cyclictest0-21swapper/119:19:511
2614299584,46cyclictest8420-21aten2.4-expect19:29:501
2614299584,13cyclictest0-21swapper/121:59:001
2614299583,50cyclictest0-21swapper/123:54:411
2614299583,48cyclictest0-21swapper/122:49:311
2614199583,49cyclictest13081-21iostat_ios23:59:500
2614199583,48cyclictest11929-21munin-node20:44:550
2609525839,11sleep326099-21kworker/u8:218:59:353
219499580,4rtkit-daemon0-21swapper/323:37:102
210282588,42sleep20-21swapper/222:35:192
2614399579,27cyclictest0-21swapper/223:14:302
26143995724,14cyclictest0-21swapper/222:49:442
26143995721,16cyclictest0-21swapper/223:30:002
2614299574,48cyclictest20633-21uptime00:10:011
2614299573,47cyclictest4726-21sort20:29:371
2614299573,13cyclictest0-21swapper/100:15:131
2614199574,47cyclictest0-21swapper/019:13:460
2614199573,48cyclictest0-21swapper/019:25:000
2614199573,13cyclictest0-21swapper/019:39:490
2614399565,34cyclictest0-21swapper/223:52:042
2614399565,15cyclictest0-21swapper/223:58:222
26143995635,10cyclictest0-21swapper/221:14:502
26143995623,13cyclictest0-21swapper/221:04:492
26143995622,15cyclictest0-21swapper/223:39:512
2614299564,44cyclictest25749-21cut20:04:551
2614299563,47cyclictest0-21swapper/122:30:041
2614299563,46cyclictest9545-21munin-node20:40:071
2614199565,45cyclictest1227-21runrttasks20:06:110
2614199564,12cyclictest0-21swapper/020:24:490
2614199563,46cyclictest0-21swapper/020:21:410
219499560,5rtkit-daemon107550irq/46-eth022:15:062
2614399554,43cyclictest0-21swapper/220:54:532
2614399554,20cyclictest107550irq/46-eth000:03:492
2614399553,10cyclictest107550irq/46-eth021:25:072
26143995514,21cyclictest0-21swapper/223:04:402
26143995514,21cyclictest0-21swapper/223:04:402
26143995511,27cyclictest0-21swapper/223:46:102
26143995511,27cyclictest0-21swapper/223:46:102
2614299554,44cyclictest3594-21cat19:19:401
2614299553,45cyclictest1124-21snmpd19:01:001
2614299553,13cyclictest0-21swapper/100:03:001
2614199554,46cyclictest0-21swapper/019:50:090
2614399545,29cyclictest0-21swapper/219:34:502
2614399545,29cyclictest0-21swapper/219:34:502
2614399544,44cyclictest0-21swapper/200:22:452
2614399544,29cyclictest18074-21ssh23:19:482
26143995423,13cyclictest0-21swapper/221:49:532
26143995423,13cyclictest0-21swapper/219:00:022
26143995422,13cyclictest0-21swapper/200:05:012
26143995411,24cyclictest29396-21ssh22:00:052
2614299544,45cyclictest0-21swapper/120:50:081
2614299543,12cyclictest0-21swapper/121:33:231
2614199543,45cyclictest29683-21latency_hist20:14:370
62842530,4sleep16409-21timerwakeupswit20:30:101
2614399536,40cyclictest0-21swapper/200:16:432
2614399535,40cyclictest0-21swapper/220:00:002
2614399535,30cyclictest0-21swapper/220:49:532
2614399534,30cyclictest0-21swapper/222:55:102
2614399534,30cyclictest0-21swapper/220:29:502
26143995322,13cyclictest0-21swapper/220:35:102
26143995322,13cyclictest0-21swapper/219:49:532
26143995322,12cyclictest0-21swapper/219:04:562
2614399532,46cyclictest0-21swapper/222:24:512
2614299533,45cyclictest0-21swapper/119:39:491
2614299533,45cyclictest0-21swapper/119:09:421
2614299533,44cyclictest0-21swapper/119:46:121
2614299533,44cyclictest0-21swapper/119:26:031
26141995319,12cyclictest0-21swapper/019:21:530
2614399525,40cyclictest0-21swapper/223:14:362
2614399525,29cyclictest0-21swapper/222:29:482
2614399525,29cyclictest0-21swapper/219:21:032
2614399525,28cyclictest0-21swapper/219:54:532
2614399525,28cyclictest0-21swapper/219:09:582
2614399524,29cyclictest0-21swapper/220:09:492
2614399524,29cyclictest0-21swapper/219:30:062
26143995227,11cyclictest0-21swapper/221:00:012
26143995227,11cyclictest0-21swapper/221:00:012
26143995221,13cyclictest0-21swapper/219:15:022
2614299523,43cyclictest0-21swapper/122:39:411
2614199523,44cyclictest0-21swapper/019:04:410
2614199523,12cyclictest0-21swapper/020:30:080
2614199523,10cyclictest0-21swapper/019:47:000
2614399515,28cyclictest0-21swapper/220:46:182
2614399515,27cyclictest0-21swapper/219:25:062
26143995120,13cyclictest0-21swapper/220:40:032
2614199513,43cyclictest0-21swapper/019:35:040
2614199513,43cyclictest0-21swapper/019:35:040
2614199513,13cyclictest0-21swapper/019:29:500
91602503,41sleep10-21swapper/120:37:471
295112503,9sleep10-21swapper/120:12:481
2614399505,27cyclictest0-21swapper/220:04:532
2614299503,10cyclictest31599-21unixbench_multi20:15:101
2614299503,10cyclictest31599-21unixbench_multi20:15:101
2614199503,13cyclictest0-21swapper/020:49:470
2614199502,13cyclictest0-21swapper/019:59:500
2614399495,27cyclictest0-21swapper/220:21:132
2614299493,13cyclictest0-21swapper/120:54:461
260302494,39sleep00-21swapper/018:58:430
2614399483,27cyclictest0-21swapper/219:45:112
2614299474,37cyclictest0-21swapper/120:19:521
2614299463,37cyclictest0-21swapper/118:59:401
2614299454,36cyclictest0-21swapper/119:38:321
2614299454,36cyclictest0-21swapper/119:38:321
26143994022,13cyclictest0-21swapper/218:59:412
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional