You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 05:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Apr 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1749821120,7sleep317499-21ls20:19:263
511821100,4sleep05119-21tune2fs18:09:350
54149910034,58cyclictest9607-21crond21:44:083
541499964,18cyclictest956-21fschecks_time19:54:333
5414999534,52cyclictest19342-21grep21:09:283
541499915,12cyclictest0-21swapper/320:55:343
541499914,23cyclictest0-21swapper/319:15:003
541499904,24cyclictest0-21swapper/317:44:453
5414999018,11cyclictest13245-21munin-node21:49:223
5414999015,9cyclictest29249-21ssh19:49:233
541499895,25cyclictest1419-21runrttasks20:25:233
541499894,33cyclictest0-21swapper/320:14:443
541499894,27cyclictest18046-21unixbench_multi18:34:483
541499894,22cyclictest0-21swapper/322:09:403
541499885,75cyclictest0-21swapper/320:29:393
541499884,33cyclictest0-21swapper/320:14:123
5414998830,10cyclictest22347-21cut21:14:233
5414998823,13cyclictest0-21swapper/318:04:173
5414998823,13cyclictest0-21swapper/318:04:173
5414998817,11cyclictest0-21swapper/322:19:273
5414998716,12cyclictest0-21swapper/321:34:203
541499867,21cyclictest0-21swapper/322:06:083
541499865,20cyclictest0-21swapper/320:44:273
541499865,20cyclictest0-21swapper/320:44:273
541499864,27cyclictest0-21swapper/321:26:263
541499864,27cyclictest0-21swapper/321:26:263
541499864,27cyclictest0-21swapper/319:20:213
541499864,27cyclictest0-21swapper/319:20:213
541499864,22cyclictest8893-21munin-node20:04:463
541499864,22cyclictest8893-21munin-node20:04:463
541499864,17cyclictest0-21swapper/320:36:003
541499864,13cyclictest0-21swapper/318:29:443
541499863,30cyclictest21668-21kworker/3:021:29:233
5414998626,9cyclictest6160-21df_abs17:04:353
5414998621,13cyclictest31266-21missed_timers22:14:333
5414998617,13cyclictest0-21swapper/320:54:113
248599860,4rtkit-daemon2484-21rtkit-daemon22:25:440
248599860,4rtkit-daemon2484-21rtkit-daemon19:19:362
248599860,4rtkit-daemon2484-21rtkit-daemon19:19:362
541499855,33cyclictest0-21swapper/321:57:513
541499855,27cyclictest16217-21sh19:29:283
541499855,23cyclictest0-21swapper/322:00:103
541499854,34cyclictest0-21swapper/317:24:193
541499854,27cyclictest0-21swapper/317:29:403
541499854,13cyclictest0-21swapper/321:03:403
5414998525,10cyclictest29984-21unixbench_multi18:59:483
5414998515,12cyclictest0-21swapper/319:35:213
5412998514,62cyclictest0-21swapper/219:49:292
541499844,31cyclictest0-21swapper/322:29:203
541499844,29cyclictest0-21swapper/318:44:443
541499844,28cyclictest0-21swapper/318:24:373
541499844,27cyclictest0-21swapper/318:54:353
541499844,22cyclictest0-21swapper/319:09:573
541499844,12cyclictest0-21swapper/319:44:423
5414998431,45cyclictest7976-21needreboot18:14:413
5414998422,9cyclictest28831-21unixbench_multi17:49:503
5414998419,11cyclictest0-21swapper/320:01:503
5414998419,11cyclictest0-21swapper/320:01:503
541499835,13cyclictest0-21swapper/322:28:403
541499834,13cyclictest0-21swapper/321:48:483
541499833,31cyclictest0-21swapper/317:59:173
5414998326,11cyclictest23190-21gltestperf17:39:383
5412998321,55cyclictest0-21swapper/221:59:262
326582830,3sleep121-21ksoftirqd/122:17:121
541499825,33cyclictest0-21swapper/318:14:173
541499824,33cyclictest0-21swapper/320:43:363
541499824,33cyclictest0-21swapper/320:43:363
541499824,19cyclictest17164-21sshd21:04:533
5412998217,57cyclictest0-21swapper/219:14:262
5412998216,58cyclictest0-21swapper/221:09:402
541499815,12cyclictest0-21swapper/321:19:473
541499814,32cyclictest0-21swapper/319:09:153
541499814,10cyclictest1128-21crond19:29:133
541499813,22cyclictest23511-21ssh19:39:353
5414998122,10cyclictest19394-21fschecks_time18:39:343
5414998122,10cyclictest19394-21fschecks_time18:39:343
5414998121,11cyclictest10020-21gltestperf18:19:353
541499804,26cyclictest0-21swapper/318:49:273
5412997921,49cyclictest0-21swapper/220:06:242
5412997921,49cyclictest0-21swapper/220:06:242
5412997828,42cyclictest1419-21runrttasks21:34:332
5412997811,58cyclictest0-21swapper/219:39:422
5412997722,48cyclictest25933-21aten2.4-expect18:54:272
541499764,21cyclictest0-21swapper/317:14:333
541499764,21cyclictest0-21swapper/317:14:333
5412997619,49cyclictest0-21swapper/219:44:472
5412997614,55cyclictest0-21swapper/217:49:292
541499754,21cyclictest0-21swapper/318:04:293
5412997523,44cyclictest0-21swapper/219:59:362
5412997523,44cyclictest0-21swapper/219:59:362
5412997520,47cyclictest4838-21cpuspeed_turbos22:24:212
5412997518,51cyclictest0-21swapper/221:15:142
541499743,28cyclictest16026-21tail17:24:383
5412997427,39cyclictest12557-21munin-run17:19:192
5412997427,39cyclictest12557-21munin-run17:19:192
5412997424,17cyclictest0-21swapper/220:44:392
5412997424,17cyclictest0-21swapper/220:44:392
5412997423,43cyclictest0-21swapper/221:39:312
5412997421,46cyclictest31123-21df_abs20:39:272
5412997421,46cyclictest31123-21df_abs20:39:272
5412997419,38cyclictest121850irq/46-eth019:10:082
5412997414,52cyclictest0-21swapper/222:29:302
5412997411,55cyclictest0-21swapper/219:32:322
541499739,21cyclictest0-21swapper/317:14:203
5412997325,41cyclictest28473-21date21:24:092
5412997323,32cyclictest13931-21chrt21:00:252
5412997322,43cyclictest0-21swapper/220:34:422
5412997320,46cyclictest0-21swapper/217:22:512
5412997319,30cyclictest0-21swapper/219:35:172
5412997227,27cyclictest13832-21df_inode21:49:242
5412997225,33cyclictest10202-21kernelversion18:19:392
5412997224,42cyclictest0-21swapper/221:04:372
5412997224,31cyclictest0-21swapper/221:56:232
5412997214,52cyclictest0-21swapper/217:31:232
5412997124,41cyclictest0-21swapper/221:24:352
5412997124,41cyclictest0-21swapper/221:24:352
5412997121,44cyclictest0-21swapper/220:13:392
5412997120,44cyclictest0-21swapper/222:05:152
5412997119,36cyclictest0-21swapper/220:49:232
5412997118,47cyclictest21805-21needreboot20:24:372
5412997117,47cyclictest0-21swapper/222:14:232
5412997116,49cyclictest0-21swapper/221:30:592
5412997115,49cyclictest0-21swapper/220:22:102
5412997114,51cyclictest0-21swapper/220:54:132
5412997020,43cyclictest30527-21kernelversion17:54:432
5412997018,45cyclictest0-21swapper/219:24:372
5412997014,48cyclictest0-21swapper/219:58:352
540799703,59cyclictest12356-21chrt20:09:510
5412996923,40cyclictest28399-21timerwakeupswit22:09:402
5412996920,34cyclictest0-21swapper/219:04:392
5412996917,45cyclictest11193-21awk21:44:352
5412996915,46cyclictest0-21swapper/222:19:172
540799695,55cyclictest0-21swapper/020:44:140
540799695,55cyclictest0-21swapper/020:44:140
5412996818,43cyclictest0-21swapper/217:49:172
541299679,52cyclictest0-21swapper/218:04:332
5412996719,41cyclictest0-21swapper/220:14:292
5412996712,48cyclictest0-21swapper/220:29:282
5407996747,11cyclictest21840-21grep21:59:430
540799674,56cyclictest0-21swapper/019:39:140
540799674,55cyclictest0-21swapper/019:59:370
540799674,55cyclictest0-21swapper/019:59:370
5407996731,19cyclictest0-21swapper/021:38:550
248599670,5rtkit-daemon2484-21rtkit-daemon17:04:193
5412996624,35cyclictest7785-21munin-run17:09:192
5412996622,30cyclictest0-21swapper/217:24:422
5412996620,40cyclictest0-21swapper/218:59:362
5412996620,40cyclictest0-21swapper/217:39:522
5412996616,42cyclictest0-21swapper/218:39:332
5412996616,42cyclictest0-21swapper/218:39:332
5412996610,50cyclictest0-21swapper/218:34:362
5407996649,11cyclictest31552-21grep20:39:310
5407996649,11cyclictest31552-21grep20:39:310
5412996521,37cyclictest9206-21needreboot17:09:452
5412996520,38cyclictest0-21swapper/218:26:382
5407996546,13cyclictest21885-21seq20:24:390
540799654,55cyclictest0-21swapper/022:09:380
540799654,53cyclictest0-21swapper/019:44:450
540799654,52cyclictest0-21swapper/021:51:030
133802655,8sleep113398-21iostat_ios19:24:381
5412996418,39cyclictest23479-21yum-updatesd-he18:49:282
5407996445,12cyclictest7745-21ssh20:04:300
5407996445,12cyclictest7745-21ssh20:04:300
540799644,33cyclictest0-21swapper/019:14:400
540799635,51cyclictest0-21swapper/019:19:290
540799635,51cyclictest0-21swapper/019:19:290
5407996346,11cyclictest15569-21grep20:14:460
5407996345,12cyclictest472-21cut21:29:280
5407996341,15cyclictest30252-21rm21:24:420
5407996341,15cyclictest30252-21rm21:24:420
540799634,13cyclictest0-21swapper/017:44:310
540799633,54cyclictest0-21swapper/021:46:490
540799633,52cyclictest0-21swapper/021:39:370
5407996244,12cyclictest25652-21grep20:29:450
5407996244,12cyclictest23766-21grep18:49:290
540799624,41cyclictest0-21swapper/017:14:320
540799624,41cyclictest0-21swapper/017:14:320
5407996218,22cyclictest0-21swapper/021:54:260
248599620,7rtkit-daemon0-21swapper/121:10:020
5412996117,38cyclictest19947-21munin-node17:34:512
5410996143,11cyclictest22029-21aten_r1power_en21:14:211
540799615,49cyclictest0-21swapper/019:09:380
5407996144,11cyclictest1287-21snmpd19:05:410
540799614,49cyclictest0-21swapper/022:29:260
540799614,49cyclictest0-21swapper/022:19:180
5412996038,16cyclictest7330-21df_abs18:14:322
5412996024,29cyclictest0-21swapper/217:04:192
5412996011,41cyclictest0-21swapper/218:29:252
540799609,33cyclictest0-21swapper/019:51:360
540799604,50cyclictest0-21swapper/019:54:490
540799604,49cyclictest0-21swapper/021:22:400
540799604,14cyclictest0-21swapper/020:49:340
5407996039,15cyclictest0-21swapper/020:19:270
5407996019,10cyclictest31777-21timerwakeupswit22:14:410
5407996010,33cyclictest0-21swapper/021:04:320
326632603,49sleep10-21swapper/120:40:131
326632603,49sleep10-21swapper/120:40:131
540799599,32cyclictest0-21swapper/020:58:390
540799595,38cyclictest0-21swapper/018:24:160
5407995943,11cyclictest21737-21vmstat17:34:520
5407995942,11cyclictest29131-21grep20:34:460
540799594,26cyclictest0-21swapper/021:00:220
5407995923,30cyclictest0-21swapper/019:39:270
5407995918,26cyclictest18554-21sh19:33:040
242602593,12sleep10-21swapper/118:49:351
5412995826,24cyclictest4409-21aten_r1power_cu18:09:272
540799584,48cyclictest0-21swapper/021:15:500
540799584,47cyclictest0-21swapper/017:09:370
5412995729,22cyclictest1419-21runrttasks18:48:562
5412995724,27cyclictest0-21swapper/217:59:362
5412995724,27cyclictest0-21swapper/217:59:362
541099574,35cyclictest0-21swapper/121:46:481
5410995728,9cyclictest3173-21aten_r1power_en21:34:201
540799574,45cyclictest0-21swapper/019:27:460
540799574,35cyclictest2881-21kworker/0:022:04:260
5407995736,15cyclictest0-21swapper/018:59:160
5407995736,15cyclictest0-21swapper/017:39:310
5407995635,15cyclictest0-21swapper/018:34:330
540799563,47cyclictest0-21swapper/018:29:360
84162552,45sleep10-21swapper/121:39:521
5410995538,10cyclictest17467-21gltestperf21:54:281
5410995513,27cyclictest0-21swapper/120:32:581
540799555,14cyclictest0-21swapper/018:44:440
540799554,33cyclictest0-21swapper/017:24:300
541099544,31cyclictest0-21swapper/122:04:331
540799544,36cyclictest0-21swapper/017:55:000
540799544,31cyclictest0-21swapper/017:04:190
541099534,27cyclictest0-21swapper/121:09:211
5410995335,11cyclictest27647-21unixbench_singl18:54:491
540799535,29cyclictest0-21swapper/017:49:310
540799534,34cyclictest0-21swapper/018:40:520
540799534,34cyclictest0-21swapper/018:40:520
540799534,25cyclictest0-21swapper/018:14:280
5407995333,14cyclictest0-21swapper/018:24:340
76492524,40sleep10-21swapper/120:04:291
76492524,40sleep10-21swapper/120:04:291
541099525,28cyclictest0-21swapper/119:49:221
541099524,30cyclictest0-21swapper/117:39:461
5410995235,10cyclictest18993-21grep20:19:461
5410995226,12cyclictest0-21swapper/121:21:231
5410995211,24cyclictest21-21ksoftirqd/120:54:101
540799525,27cyclictest0-21swapper/017:19:390
540799524,33cyclictest0-21swapper/017:31:200
540799524,32cyclictest0-21swapper/018:00:060
540799524,32cyclictest0-21swapper/018:00:060
540799524,28cyclictest0-21swapper/018:04:290
540799524,28cyclictest0-21swapper/017:04:340
52572523,7sleep15262-21ssh19:14:181
541099514,41cyclictest0-21swapper/122:09:541
541099514,30cyclictest0-21swapper/119:39:431
541099514,29cyclictest0-21swapper/121:04:271
541099514,27cyclictest0-21swapper/120:29:121
5410995132,12cyclictest0-21swapper/121:24:231
5410995132,12cyclictest0-21swapper/121:24:231
5410995121,12cyclictest0-21swapper/119:54:331
41822512,41sleep10-21swapper/120:46:501
41822512,41sleep10-21swapper/120:46:501
220232512,42sleep10-21swapper/117:38:251
70762503,41sleep17172-21timerandwakeup17:04:511
541099505,29cyclictest0-21swapper/117:29:451
541099504,40cyclictest0-21swapper/120:59:441
541099504,40cyclictest0-21swapper/117:19:491
541099504,29cyclictest0-21swapper/122:24:201
541099504,26cyclictest0-21swapper/118:17:001
5410995032,13cyclictest0-21swapper/121:51:361
5410995032,12cyclictest0-21swapper/121:59:181
541099503,18cyclictest0-21swapper/119:08:311
5410995022,12cyclictest0-21swapper/119:09:341
5410995018,12cyclictest0-21swapper/119:00:571
540799503,32cyclictest0-21swapper/019:02:030
300712503,41sleep10-21swapper/120:38:031
205822502,42sleep10-21swapper/118:40:441
205822502,42sleep10-21swapper/118:40:441
18762502,10sleep10-21swapper/121:31:011
541499494,27cyclictest0-21swapper/317:34:493
541099495,27cyclictest0-21swapper/120:14:451
541099494,28cyclictest0-21swapper/120:09:311
5410994929,13cyclictest0-21swapper/119:44:431
5410994921,12cyclictest0-21swapper/118:34:431
5410994921,12cyclictest0-21swapper/117:59:501
5410994921,12cyclictest0-21swapper/117:59:501
5410994920,12cyclictest0-21swapper/119:36:131
5410994919,12cyclictest0-21swapper/120:04:131
5410994915,28cyclictest111582sleep119:21:241
5410994915,28cyclictest111582sleep119:21:241
187562493,39sleep10-21swapper/119:33:491
122382493,40sleep10-21swapper/117:15:191
122382493,40sleep10-21swapper/117:15:191
104272492,39sleep10-21swapper/122:32:041
541099484,27cyclictest0-21swapper/122:19:181
541099484,27cyclictest0-21swapper/120:57:201
541099484,27cyclictest0-21swapper/118:24:351
541099484,26cyclictest0-21swapper/120:02:171
541099484,26cyclictest0-21swapper/118:44:271
541099484,26cyclictest0-21swapper/117:49:281
541099483,27cyclictest0-21swapper/117:04:201
541099474,27cyclictest0-21swapper/118:19:501
541099473,28cyclictest0-21swapper/118:09:281
158962473,38sleep10-21swapper/118:31:491
541099464,26cyclictest0-21swapper/117:54:461
541099464,26cyclictest0-21swapper/117:10:351
38642452,36sleep10-21swapper/118:05:381
164422442,35sleep10-21swapper/117:24:461
541099433,34cyclictest0-21swapper/117:46:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional