You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-27 - 07:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jul 27, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113849910320,9cyclictest12867-21sshd23:42:450
113849910320,9cyclictest12867-21sshd23:42:450
113889910019,59cyclictest0-21swapper/121:14:471
1138999995,87cyclictest0-21swapper/221:24:252
1138499994,38cyclictest0-21swapper/021:40:150
1138499994,38cyclictest0-21swapper/021:40:150
1138499986,45cyclictest0-21swapper/023:34:370
1138499986,16cyclictest13324-21python21:14:560
11389999751,39cyclictest0-21swapper/221:09:462
11389999739,49cyclictest0-21swapper/223:34:362
1138499966,28cyclictest0-21swapper/020:55:120
219499940,6rtkit-daemon2193-21rtkit-daemon20:50:020
11389999440,48cyclictest0-21swapper/220:34:422
11389999430,13cyclictest0-21swapper/223:40:372
11389999430,13cyclictest0-21swapper/223:40:372
11388999437,40cyclictest0-21swapper/121:28:121
1138999925,26cyclictest0-21swapper/223:00:472
1138999925,26cyclictest0-21swapper/223:00:472
11389999235,13cyclictest0-21swapper/222:46:482
11389999221,9cyclictest2375-21ssh21:49:252
11389999219,13cyclictest0-21swapper/222:54:222
11388999230,47cyclictest0-21swapper/121:02:001
11390999123,45cyclictest1227-21runrttasks21:39:403
11390999123,45cyclictest1227-21runrttasks21:39:403
1138999916,27cyclictest0-21swapper/222:29:532
1138999914,19cyclictest1227-21runrttasks20:48:212
1138999914,14cyclictest0-21swapper/221:09:252
11389999136,49cyclictest0-21swapper/222:39:512
11389999132,12cyclictest0-21swapper/221:33:092
1138899914,80cyclictest0-21swapper/118:55:131
11388999130,46cyclictest0-21swapper/121:21:321
1138999906,27cyclictest0-21swapper/221:34:462
1138999904,25cyclictest0-21swapper/220:56:322
1138999904,24cyclictest0-21swapper/223:33:272
11389999031,9cyclictest7734-21ssh20:19:422
11389999015,13cyclictest0-21swapper/222:54:512
11389999014,16cyclictest0-21swapper/223:09:352
11389999010,71cyclictest3412-21idleruntime-cro23:29:192
11389999010,14cyclictest0-21swapper/220:53:132
11388999033,39cyclictest21867-21fschecks_time18:34:491
1138899903,79cyclictest19463-21latency_hist23:04:221
1138899903,79cyclictest19463-21latency_hist23:04:221
11388999028,44cyclictest0-21swapper/120:26:371
11390998932,37cyclictest18098-21ssh22:59:563
11390998932,37cyclictest18098-21ssh22:59:563
11390998922,48cyclictest12244-21ssh20:24:553
11390998919,53cyclictest0-21swapper/323:19:383
1138999895,12cyclictest1227-21runrttasks21:50:532
1138999894,29cyclictest0-21swapper/220:41:072
11389998934,11cyclictest0-21swapper/219:29:512
11389998934,11cyclictest0-21swapper/219:29:512
11389998919,11cyclictest7697-21ssh21:55:022
11389998914,9cyclictest107550irq/46-eth022:04:372
11389998912,12cyclictest0-21swapper/221:18:022
1138999886,25cyclictest0-21swapper/221:26:252
1138999885,28cyclictest0-21swapper/218:30:422
1138999884,15cyclictest0-21swapper/222:18:412
1138999884,14cyclictest0-21swapper/223:05:212
11389998817,16cyclictest0-21swapper/222:25:492
11389998813,27cyclictest0-21swapper/222:34:402
11388998837,35cyclictest9901-21perl21:59:431
11388998831,42cyclictest0-21swapper/122:24:431
11390998724,47cyclictest12701-21sort22:54:213
11390998723,47cyclictest0-21swapper/322:21:503
11390998723,47cyclictest0-21swapper/322:21:503
11390998723,42cyclictest4116-21diskmemload21:01:473
11390998723,42cyclictest23689-21rm20:42:443
1138999875,14cyclictest0-21swapper/220:29:532
1138999873,25cyclictest26377-21sort23:14:372
11389998720,10cyclictest4178-21ssh21:01:182
1138899874,74cyclictest0-21swapper/122:44:211
11388998733,47cyclictest0-21swapper/122:09:141
11388998729,44cyclictest0-21swapper/121:31:431
11388998725,53cyclictest0-21swapper/120:54:381
11390998626,46cyclictest2405-21runrttasks23:25:273
1138999869,12cyclictest0-21swapper/220:24:492
1138999865,34cyclictest0-21swapper/219:24:422
1138999865,15cyclictest0-21swapper/220:18:192
1138999865,15cyclictest0-21swapper/220:18:192
1138999864,14cyclictest0-21swapper/222:19:372
1138999864,14cyclictest0-21swapper/222:19:372
11389998636,8cyclictest980-21cpuspeed_turbos18:59:442
11389998630,11cyclictest19277-21grep19:35:022
11389998621,13cyclictest0-21swapper/223:20:492
1138899863,76cyclictest3123-21fschecks_count21:49:411
11388998623,56cyclictest0-21swapper/122:09:381
1139099853,17cyclictest0-21swapper/321:30:353
11390998528,42cyclictest152641telnet21:19:383
11390998525,38cyclictest2934-21kworker/3:119:39:423
11390998523,46cyclictest18477-21rm22:13:333
11390998521,47cyclictest31968-21ssh21:44:403
1138999855,23cyclictest0-21swapper/221:42:522
1138999855,23cyclictest0-21swapper/221:42:522
1138999854,26cyclictest0-21swapper/222:10:462
1138999854,26cyclictest0-21swapper/218:52:182
1138999854,26cyclictest0-21swapper/218:52:182
11389998534,10cyclictest0-21swapper/222:00:582
11389998528,12cyclictest28071-21crond18:49:312
1138899855,66cyclictest0-21swapper/123:23:411
11388998533,37cyclictest0-21swapper/119:09:501
11390998427,42cyclictest32643-21ssh20:54:583
11390998424,53cyclictest1227-21runrttasks20:14:303
11390998424,53cyclictest1227-21runrttasks20:14:303
11390998420,42cyclictest0-21swapper/322:58:393
11390998417,51cyclictest0-21swapper/320:19:493
1138999844,27cyclictest0-21swapper/219:09:442
11389998430,12cyclictest29458-21munin-node19:59:572
1138899844,73cyclictest0-21swapper/123:34:511
1138899844,11cyclictest0-21swapper/120:30:551
11388998434,37cyclictest0-21swapper/123:42:461
11388998434,37cyclictest0-21swapper/123:42:461
11388998432,37cyclictest0-21swapper/122:32:411
1138899843,73cyclictest0-21swapper/123:09:451
1138899843,73cyclictest0-21swapper/121:49:241
1138899843,71cyclictest0-21swapper/120:49:491
11388998424,7cyclictest6197-21ssh20:15:031
11388998424,7cyclictest6197-21ssh20:15:031
1139099839,12cyclictest0-21swapper/318:54:453
1139099833,72cyclictest0-21swapper/323:34:193
11390998322,45cyclictest21810-21runrttasks23:06:223
11390998322,44cyclictest11820-21munin-node21:14:393
11390998321,46cyclictest4145-21timerandwakeup21:49:563
11390998321,45cyclictest29394-21diskstats22:29:413
11390998314,52cyclictest0-21swapper/322:39:413
1138999833,27cyclictest0-21swapper/218:39:442
11388998335,31cyclictest0-21swapper/122:21:381
11388998335,31cyclictest0-21swapper/122:21:381
11388998334,36cyclictest0-21swapper/119:54:281
11388998334,35cyclictest0-21swapper/118:14:481
11388998330,39cyclictest0-21swapper/120:45:211
124382820,5sleep30-21swapper/318:14:513
11390998227,41cyclictest8401-21rm21:57:463
11390998226,40cyclictest12014-21ssh22:04:023
11390998221,43cyclictest17502-21latency_hist20:34:283
11390998216,45cyclictest0-21swapper/322:48:083
1138999824,28cyclictest0-21swapper/220:09:492
1138999824,27cyclictest0-21swapper/219:05:472
1138999824,27cyclictest0-21swapper/218:25:412
1138999824,25cyclictest12466-21sshd19:23:552
1138999823,23cyclictest1124-21snmpd19:56:042
1138899829,8cyclictest9709-21ssh21:09:491
1138899824,70cyclictest0-21swapper/123:15:011
11388998225,50cyclictest12344-21ssh22:53:061
11388998219,9cyclictest18461munin-node20:09:501
11388998216,9cyclictest903-21cut23:24:391
11388998214,12cyclictest0-21swapper/122:34:511
11390998118,42cyclictest0-21swapper/321:10:063
1138999814,36cyclictest0-21swapper/219:15:032
1138999814,26cyclictest0-21swapper/218:21:582
1138999814,25cyclictest0-21swapper/218:15:052
1138899815,69cyclictest0-21swapper/122:55:121
1138899814,70cyclictest21982-21munin-run22:19:231
11388998130,37cyclictest0-21swapper/120:04:251
1138899813,70cyclictest14017-21head18:19:451
1138899813,70cyclictest0-21swapper/118:52:451
1138899813,70cyclictest0-21swapper/118:52:451
1138899813,15cyclictest0-21swapper/121:39:401
1138899813,15cyclictest0-21swapper/121:39:401
11388998114,7cyclictest20140-21ssh23:04:391
11390998022,51cyclictest27336-21unixbench_singl22:24:573
11390998021,44cyclictest1124-21snmpd23:40:323
11390998021,44cyclictest1124-21snmpd23:40:323
11390998017,47cyclictest0-21swapper/322:38:483
1138899804,68cyclictest0-21swapper/119:04:311
11388998033,41cyclictest23790-21ssh20:43:071
11388998032,42cyclictest24342-21grep18:39:521
1138899803,9cyclictest7434-21ssh22:44:451
1138899803,8cyclictest32523-21grep20:04:441
11388998029,43cyclictest0-21swapper/121:57:501
11388998027,39cyclictest27947-21sshd18:47:571
11388998026,47cyclictest0-21swapper/123:33:521
1139099793,68cyclictest206861ssh21:26:403
1139099793,68cyclictest14085-21tail18:19:453
11390997916,42cyclictest0-21swapper/323:11:343
1138899794,25cyclictest0-21swapper/120:21:471
1138899793,20cyclictest0-21swapper/120:35:301
11388997929,36cyclictest0-21swapper/121:35:361
11388997920,7cyclictest20930-21iostat19:39:521
1139099783,65cyclictest0-21swapper/323:14:363
1139099783,24cyclictest0-21swapper/320:04:443
11390997828,32cyclictest25397-21rm21:34:413
11390997824,47cyclictest25638-21needreboot20:44:523
11390997819,43cyclictest0-21swapper/322:04:413
1138999785,23cyclictest30695-21munin-node18:54:462
1138899784,66cyclictest0-21swapper/121:05:011
11388997830,41cyclictest11972-21sort19:20:031
1139099773,67cyclictest21976-21rm22:19:223
1139099773,66cyclictest3973-21cut19:04:503
11390997727,43cyclictest15695-21df_abs19:29:453
11390997727,43cyclictest15695-21df_abs19:29:453
11390997719,43cyclictest20601-21ssh20:38:363
11390997718,51cyclictest8328-21cpuspeed_turbos19:14:463
11390997713,56cyclictest0-21swapper/319:27:583
1138999774,27cyclictest0-21swapper/218:34:492
1138899778,14cyclictest0-21swapper/119:34:301
1138899778,14cyclictest0-21swapper/119:34:301
11388997722,8cyclictest1227-21runrttasks19:06:321
11388997713,11cyclictest17023-21fschecks_count18:24:481
11390997620,49cyclictest6121-21df_abs19:09:473
11390997618,50cyclictest2257-21switchtime19:00:013
1138999764,28cyclictest0-21swapper/219:51:552
11388997616,9cyclictest28802-21unixbench_multi19:55:021
11388997616,9cyclictest19771-21interrupts18:29:531
11388997615,9cyclictest13957-21needreboot19:24:541
11388997611,10cyclictest19634-21runrttasks19:38:581
1139099756,13cyclictest0-21swapper/319:19:563
1139099754,64cyclictest0-21swapper/323:34:323
1139099754,63cyclictest0-21swapper/320:49:333
1139099753,65cyclictest25347-21fschecks_count19:49:453
11390997520,48cyclictest17447-21sed18:24:543
11388997526,42cyclictest8122-21aten_r1power_vo19:14:441
11390997429,31cyclictest8288-21idleruntime-cro21:09:263
11390997426,40cyclictest1547-21nscd20:14:273
11390997418,49cyclictest27060-21missed_timers18:44:563
1139099734,22cyclictest0-21swapper/319:55:163
1139099734,15cyclictest0-21swapper/318:40:013
11390997327,40cyclictest28808-21df_abs18:49:463
11390997327,40cyclictest28808-21df_abs18:49:463
11390997320,46cyclictest23059-21fschecks_time19:44:483
1138999734,27cyclictest0-21swapper/219:44:592
11390997210,8cyclictest18656-21missed_timers19:34:533
11390997119,46cyclictest22042-21hddtemp_smartct18:34:513
11390997119,45cyclictest19362-21fschecks_count18:29:493
11390997111,12cyclictest0-21swapper/319:59:473
1138899713,61cyclictest0-21swapper/119:44:581
11388997114,9cyclictest0-21swapper/118:14:331
43672667,51sleep00-21swapper/020:14:400
43672667,51sleep00-21swapper/020:14:400
11384996524,35cyclictest0-21swapper/022:19:410
11384996524,35cyclictest0-21swapper/022:19:410
1138499643,54cyclictest0-21swapper/020:37:330
1139099634,21cyclictest0-21swapper/318:14:333
11384996319,28cyclictest0-21swapper/023:33:070
1138499614,39cyclictest0-21swapper/022:13:370
1138499614,21cyclictest0-21swapper/020:42:360
1138499604,29cyclictest0-21swapper/022:55:050
1138499604,26cyclictest0-21swapper/021:59:240
1138499604,25cyclictest0-21swapper/021:34:320
1138499595,29cyclictest0-21swapper/022:59:380
1138499595,29cyclictest0-21swapper/022:59:380
1138499595,29cyclictest0-21swapper/022:15:380
1138499595,24cyclictest0-21swapper/020:23:470
1138499595,15cyclictest0-21swapper/022:28:520
1138499595,13cyclictest0-21swapper/023:24:280
1138499594,28cyclictest0-21swapper/020:28:200
1138499594,26cyclictest0-21swapper/022:31:530
1138499594,26cyclictest0-21swapper/021:59:290
1138499594,26cyclictest0-21swapper/021:03:220
1138499594,25cyclictest0-21swapper/021:32:500
1138499594,24cyclictest0-21swapper/021:24:370
11384995919,25cyclictest30695-21munin-node18:54:530
11384995918,10cyclictest0-21swapper/023:06:180
11384995917,13cyclictest0-21swapper/023:22:100
1138499585,29cyclictest0-21swapper/021:44:460
1138499585,28cyclictest0-21swapper/020:47:480
1138499585,24cyclictest0-21swapper/022:42:480
1138499585,24cyclictest0-21swapper/021:09:280
1138499584,26cyclictest0-21swapper/021:06:390
1138499584,25cyclictest0-21swapper/022:51:430
1138499584,25cyclictest0-21swapper/021:51:520
1138499584,25cyclictest0-21swapper/019:25:540
1138499583,27cyclictest0-21swapper/023:13:060
11384995822,13cyclictest0-21swapper/023:14:530
11384995822,13cyclictest0-21swapper/019:29:590
11384995822,13cyclictest0-21swapper/019:29:590
11384995820,14cyclictest0-21swapper/020:29:320
13742574,11sleep00-21swapper/020:06:380
1138499575,26cyclictest0-21swapper/022:44:300
1138499574,29cyclictest0-21swapper/021:19:410
1138499574,29cyclictest0-21swapper/019:49:450
1138499574,29cyclictest0-21swapper/019:14:590
1138499574,28cyclictest0-21swapper/019:56:040
1138499574,27cyclictest0-21swapper/018:35:420
1138499574,25cyclictest0-21swapper/022:34:360
1138499574,25cyclictest0-21swapper/019:39:420
1138499573,28cyclictest0-21swapper/018:30:060
11384995718,12cyclictest0-21swapper/019:44:410
11384995718,12cyclictest0-21swapper/018:44:540
11384995712,14cyclictest0-21swapper/020:09:490
152572565,11sleep00-21swapper/018:20:010
1138499565,28cyclictest0-21swapper/022:04:290
1138499564,29cyclictest0-21swapper/019:34:500
1138499564,26cyclictest0-21swapper/019:59:400
11384995620,9cyclictest647-21telnet18:59:410
11384995618,13cyclictest0-21swapper/018:52:100
11384995618,13cyclictest0-21swapper/018:52:100
1138499555,28cyclictest0-21swapper/018:24:470
1138499554,27cyclictest0-21swapper/019:24:300
1138499554,27cyclictest0-21swapper/018:39:480
59632543,43sleep00-21swapper/019:09:470
137102546,12sleep00-21swapper/018:19:000
1138999543,10cyclictest0-21swapper/220:04:492
219499530,5rtkit-daemon2193-21rtkit-daemon18:10:000
11389995136,8cyclictest22061-21crond19:44:292
1138499505,29cyclictest0-21swapper/019:05:060
1138999433,34cyclictest0-21swapper/218:14:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional