You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 22:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Jul 04, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239769910013,23cyclictest0-21swapper/009:15:580
23976999826,10cyclictest107550irq/46-eth008:50:360
23976999826,10cyclictest107550irq/46-eth008:50:360
23976999821,13cyclictest0-21swapper/011:25:440
2397699965,27cyclictest0-21swapper/009:23:490
2397699965,27cyclictest0-21swapper/006:45:550
2397699955,27cyclictest0-21swapper/008:03:350
2397699954,9cyclictest27641-21grep12:00:480
2397699947,14cyclictest3516-21munin-node10:36:060
2397699945,13cyclictest0-21swapper/009:35:480
2397699944,41cyclictest0-21swapper/010:15:300
2397699944,41cyclictest0-21swapper/010:15:300
2397699944,27cyclictest0-21swapper/010:15:480
2397899933,20cyclictest0-21swapper/109:36:471
2397699935,26cyclictest0-21swapper/011:58:210
2397699935,23cyclictest374-21perl11:20:500
2397699934,13cyclictest0-21swapper/011:31:020
23978999228,44cyclictest277281rm11:13:041
2397699929,25cyclictest0-21swapper/008:24:390
2397699925,27cyclictest0-21swapper/010:35:280
2397699925,27cyclictest0-21swapper/006:36:140
2397699925,27cyclictest0-21swapper/006:36:140
2397699925,25cyclictest0-21swapper/009:13:170
2397699924,27cyclictest0-21swapper/011:50:450
23978999120,7cyclictest167121diskmemload09:45:321
2397899912,71cyclictest26538-21latency_hist12:00:291
2397699916,24cyclictest23788-21munin-node10:20:570
2397699914,26cyclictest0-21swapper/010:29:110
2397699914,25cyclictest0-21swapper/008:00:390
2397699914,12cyclictest0-21swapper/011:41:340
2397699914,12cyclictest0-21swapper/010:05:540
2397699914,12cyclictest0-21swapper/010:05:540
23976999120,13cyclictest0-21swapper/011:48:190
144522910,6sleep20-21swapper/207:21:042
144522910,6sleep20-21swapper/207:21:042
23978999023,50cyclictest0-21swapper/111:37:491
23978999023,50cyclictest0-21swapper/111:37:491
23978999020,9cyclictest3126-21runrttasks11:25:361
2397699905,27cyclictest0-21swapper/008:55:470
2397699904,26cyclictest0-21swapper/010:53:090
2397699904,26cyclictest0-21swapper/010:53:090
2397699903,9cyclictest107550irq/46-eth010:49:540
2397899894,25cyclictest0-21swapper/111:30:491
2397899893,26cyclictest0-21swapper/108:00:521
23978998926,41cyclictest12686-21expr10:50:511
23978998926,41cyclictest12686-21expr10:50:511
23978998917,8cyclictest20529-21aten2.4-expect10:15:441
2397699898,25cyclictest0-21swapper/009:26:540
2397699898,25cyclictest0-21swapper/009:26:540
2397699896,11cyclictest23987-21unixbench-2d09:31:080
2397699895,26cyclictest0-21swapper/011:16:130
2397699895,26cyclictest0-21swapper/008:41:350
2397699895,26cyclictest0-21swapper/008:38:410
2397699895,26cyclictest0-21swapper/007:28:300
2397699895,25cyclictest0-21swapper/011:01:230
2397699885,28cyclictest0-21swapper/010:43:120
2397699885,27cyclictest0-21swapper/011:10:570
2397699885,27cyclictest0-21swapper/009:46:230
2397699884,28cyclictest0-21swapper/007:20:520
2397699884,28cyclictest0-21swapper/007:20:520
2397699884,28cyclictest0-21swapper/007:08:260
2397899874,76cyclictest0-21swapper/109:10:291
23978998720,8cyclictest32262-21timerwakeupswit10:31:051
23978998716,11cyclictest0-21swapper/107:40:381
2397699875,26cyclictest0-21swapper/009:50:460
2397699874,27cyclictest0-21swapper/010:02:260
2397699874,26cyclictest11129-21aten2.4-expect07:15:510
2397699874,26cyclictest0-21swapper/008:35:370
219499870,6rtkit-daemon0-21swapper/106:35:551
219499870,6rtkit-daemon0-21swapper/106:35:551
23978998618,9cyclictest1124-21snmpd09:18:481
23978998618,12cyclictest0-21swapper/109:25:201
23978998617,11cyclictest0-21swapper/108:36:241
2397699865,26cyclictest0-21swapper/007:13:270
23976998618,14cyclictest0-21swapper/009:07:520
23978998531,47cyclictest12482-21cut08:25:511
23978998529,37cyclictest16712-21diskmemload11:44:451
23978998525,45cyclictest23081-21ssh11:05:551
2397899844,73cyclictest0-21swapper/107:45:381
2397899844,72cyclictest29928-21munin-run12:05:281
2397899843,9cyclictest6713-21tail08:11:111
2397899843,73cyclictest0-21swapper/110:13:161
2397899843,73cyclictest0-21swapper/110:13:161
23978998424,7cyclictest16712-21diskmemload08:44:001
2397899842,75cyclictest11878-21gltestperf07:15:581
2397699846,26cyclictest0-21swapper/011:39:140
2397699846,26cyclictest0-21swapper/011:39:140
23978998326,51cyclictest7223-21cpuspeed_turbos09:55:471
23978998326,37cyclictest18462-21cat11:00:321
23978998324,44cyclictest4271-21ssh09:02:551
23978998313,64cyclictest26527-21ssh10:24:131
2397699835,28cyclictest0-21swapper/010:58:400
2397699834,28cyclictest0-21swapper/009:40:550
2397699834,28cyclictest0-21swapper/009:02:240
2397699834,26cyclictest0-21swapper/008:52:320
219499830,4rtkit-daemon2193-21rtkit-daemon10:09:022
219499830,4rtkit-daemon2193-21rtkit-daemon10:09:022
2397899824,20cyclictest0-21swapper/109:11:081
2397899823,12cyclictest0-21swapper/106:50:421
23978998226,36cyclictest5575-21ssh09:51:531
23978998226,32cyclictest224501ssh11:52:551
23978998224,52cyclictest29073-21wc07:51:061
23978998222,9cyclictest3904-21open_inodes08:06:051
23978998222,9cyclictest3904-21open_inodes08:06:051
2397899814,69cyclictest6543-21python10:41:031
23978998126,47cyclictest18139-21fgrep11:45:581
23978998121,9cyclictest13763-21telnet10:05:471
23978998121,9cyclictest13763-21telnet10:05:471
23978998121,52cyclictest0-21swapper/108:25:361
23978998119,10cyclictest0-21swapper/111:20:451
23978998117,10cyclictest0-21swapper/106:51:041
2397699815,26cyclictest0-21swapper/011:06:100
2397699814,27cyclictest0-21swapper/008:20:390
2397899804,69cyclictest0-21swapper/109:29:331
2397899804,69cyclictest0-21swapper/109:29:331
2397899804,68cyclictest0-21swapper/109:32:551
2397899803,8cyclictest11571-21ssh10:01:011
2397899803,24cyclictest0-21swapper/108:34:141
2397899803,11cyclictest0-21swapper/108:52:361
23978998027,41cyclictest3118-21ssh10:36:011
23978998026,36cyclictest11469-21rm10:50:181
23978998020,8cyclictest1124-21snmpd07:58:341
2397899793,68cyclictest16351-21diskstats07:25:561
23978997923,49cyclictest1460-21sensors_temp09:46:031
2397899784,12cyclictest0-21swapper/108:16:091
2397899783,25cyclictest0-21swapper/107:50:171
23978997824,8cyclictest26416-21rm08:48:321
23978997824,8cyclictest26416-21rm08:48:321
23978997823,40cyclictest0-21swapper/111:00:581
2397899772,67cyclictest29982-21rm10:29:271
23978997719,9cyclictest1227-21runrttasks06:59:511
23978997712,11cyclictest0-21swapper/111:15:491
23978997621,10cyclictest7921-21unixbench_multi07:06:131
2397899762,31cyclictest1124-21snmpd07:22:221
2397899762,31cyclictest1124-21snmpd07:22:221
23978997616,10cyclictest0-21swapper/108:55:451
23978997520,9cyclictest8887-21cpuspeed_turbos07:10:541
53902740,15sleep32398099cyclictest10:40:473
23978997420,8cyclictest28202-21timerwakeupswit06:41:141
23978997420,8cyclictest19867-21unixbench_multi07:31:121
23978997417,10cyclictest1227-21runrttasks07:04:381
23978997211,12cyclictest0-21swapper/106:35:421
219499700,5rtkit-daemon2193-21rtkit-daemon10:14:392
219499700,5rtkit-daemon2193-21rtkit-daemon10:14:392
764826814,7sleep37731-21missed_timers11:30:543
219499650,5rtkit-daemon2193-21rtkit-daemon08:46:052
219499650,5rtkit-daemon2193-21rtkit-daemon08:46:052
23979996432,14cyclictest0-21swapper/211:45:452
23979996334,13cyclictest0-21swapper/209:40:542
2398099616,48cyclictest0-21swapper/308:35:483
23979996133,14cyclictest0-21swapper/211:09:062
23979996032,12cyclictest0-21swapper/207:46:032
23979996029,24cyclictest2711-21chrt10:35:542
219499600,5rtkit-daemon2193-21rtkit-daemon12:03:272
219499600,5rtkit-daemon2193-21rtkit-daemon10:45:152
2398099594,48cyclictest0-21swapper/311:10:583
2398099585,46cyclictest0-21swapper/308:31:113
2398099584,48cyclictest0-21swapper/310:56:593
2398099584,48cyclictest0-21swapper/310:04:103
2398099584,48cyclictest0-21swapper/307:25:533
2398099584,47cyclictest0-21swapper/307:16:103
23979995831,13cyclictest0-21swapper/209:01:212
219499580,6rtkit-daemon2193-21rtkit-daemon10:51:532
219499580,6rtkit-daemon2193-21rtkit-daemon10:51:532
219499580,5rtkit-daemon2193-21rtkit-daemon07:25:532
142902584,12sleep30-21swapper/309:17:253
2398099575,46cyclictest0-21swapper/309:05:543
2398099575,45cyclictest0-21swapper/311:50:493
2398099574,47cyclictest19433-21awk07:31:053
2398099574,47cyclictest0-21swapper/311:45:443
2398099574,46cyclictest0-21swapper/311:40:323
2398099574,46cyclictest0-21swapper/311:20:523
2398099574,46cyclictest0-21swapper/307:55:593
2398099574,46cyclictest0-21swapper/306:56:023
2398099573,48cyclictest0-21swapper/308:42:203
23979995732,11cyclictest0-21swapper/208:57:352
23979995730,12cyclictest0-21swapper/210:49:032
2397999573,12cyclictest0-21swapper/209:20:472
23979995729,12cyclictest0-21swapper/210:01:232
23979995729,12cyclictest0-21swapper/209:50:162
23979995729,12cyclictest0-21swapper/209:33:472
2397999572,26cyclictest0-21swapper/211:20:462
219499570,6rtkit-daemon2193-21rtkit-daemon11:15:222
293832562,10sleep30-21swapper/312:03:353
2398099565,46cyclictest0-21swapper/308:58:453
2398099565,45cyclictest0-21swapper/311:00:563
2398099565,45cyclictest0-21swapper/309:46:033
2398099564,46cyclictest0-21swapper/311:28:203
2398099564,46cyclictest0-21swapper/310:50:493
2398099564,46cyclictest0-21swapper/310:50:493
2398099564,46cyclictest0-21swapper/308:45:523
2398099564,46cyclictest0-21swapper/308:45:523
2398099564,45cyclictest0-21swapper/311:15:483
2398099564,45cyclictest0-21swapper/311:06:403
2398099564,45cyclictest0-21swapper/310:45:523
2398099564,45cyclictest0-21swapper/310:15:383
2398099564,45cyclictest0-21swapper/309:40:553
2398099564,45cyclictest0-21swapper/308:21:113
2398099564,45cyclictest0-21swapper/307:05:563
23979995632,10cyclictest19216-21fschecks_count11:00:492
23979995630,12cyclictest0-21swapper/210:58:022
23979995629,13cyclictest0-21swapper/208:50:522
23979995629,12cyclictest0-21swapper/211:51:042
23979995629,12cyclictest0-21swapper/209:56:042
23979995629,12cyclictest0-21swapper/208:40:042
23979995629,12cyclictest0-21swapper/207:30:532
2398099555,44cyclictest0-21swapper/311:36:383
2398099555,44cyclictest0-21swapper/311:36:383
2398099555,43cyclictest0-21swapper/310:10:343
2398099555,43cyclictest0-21swapper/310:10:343
2398099554,46cyclictest0-21swapper/309:04:263
2398099554,45cyclictest0-21swapper/310:21:053
2398099554,45cyclictest0-21swapper/309:58:183
2398099554,44cyclictest0-21swapper/309:36:003
2398099554,44cyclictest0-21swapper/309:30:473
2398099554,44cyclictest0-21swapper/309:25:373
2398099554,44cyclictest0-21swapper/309:25:373
2398099553,46cyclictest0-21swapper/308:51:073
23979995530,9cyclictest20396-21munin-node10:15:432
23979995511,37cyclictest0-21swapper/208:31:092
219499550,6rtkit-daemon2193-21rtkit-daemon10:25:542
219499550,6rtkit-daemon2193-21rtkit-daemon09:35:562
219499550,6rtkit-daemon2193-21rtkit-daemon07:05:542
2398099544,45cyclictest0-21swapper/308:27:503
2398099544,45cyclictest0-21swapper/307:11:093
2398099544,44cyclictest0-21swapper/310:25:493
2398099544,44cyclictest0-21swapper/310:10:303
2398099544,44cyclictest0-21swapper/310:10:303
2398099543,44cyclictest0-21swapper/309:50:393
2398099542,46cyclictest0-21swapper/306:46:073
2397999543,47cyclictest0-21swapper/208:41:502
219499540,6rtkit-daemon2193-21rtkit-daemon11:55:582
219499540,6rtkit-daemon2193-21rtkit-daemon11:15:522
219499540,6rtkit-daemon2193-21rtkit-daemon09:26:112
219499540,6rtkit-daemon2193-21rtkit-daemon09:26:112
219499540,5rtkit-daemon2193-21rtkit-daemon09:05:572
219499540,5rtkit-daemon2193-21rtkit-daemon08:00:522
219499540,5rtkit-daemon2193-21rtkit-daemon07:56:002
219499540,5rtkit-daemon2193-21rtkit-daemon07:51:002
2398099535,42cyclictest0-21swapper/310:36:443
2398099534,43cyclictest25306-21rm11:56:033
2398099533,44cyclictest31725-21memory10:30:573
2398099533,44cyclictest0-21swapper/309:22:173
23979995326,12cyclictest0-21swapper/210:25:052
219499530,6rtkit-daemon2193-21rtkit-daemon07:42:532
219499530,5rtkit-daemon2193-21rtkit-daemon11:40:432
219499530,5rtkit-daemon2193-21rtkit-daemon11:36:512
219499530,5rtkit-daemon2193-21rtkit-daemon11:36:512
219499530,5rtkit-daemon2193-21rtkit-daemon09:50:552
219499530,5rtkit-daemon2193-21rtkit-daemon08:05:522
219499530,5rtkit-daemon2193-21rtkit-daemon08:05:522
219499530,5rtkit-daemon2193-21rtkit-daemon06:46:022
140722533,9sleep20-21swapper/208:27:262
2398099523,43cyclictest0-21swapper/309:10:553
2397999523,34cyclictest2897-21python06:56:102
23976995222,12cyclictest0-21swapper/009:56:310
23976995221,13cyclictest0-21swapper/007:48:320
219499520,6rtkit-daemon2193-21rtkit-daemon07:15:542
219499520,5rtkit-daemon2193-21rtkit-daemon09:16:342
219499520,5rtkit-daemon2193-21rtkit-daemon08:20:592
70942513,42sleep00-21swapper/008:15:020
2398099514,40cyclictest31379-21telnet06:50:523
2397999514,32cyclictest0-21swapper/211:31:302
23976995120,13cyclictest0-21swapper/008:05:540
23976995120,13cyclictest0-21swapper/008:05:540
23976995120,13cyclictest0-21swapper/007:36:110
219499510,6rtkit-daemon2193-21rtkit-daemon06:31:032
219499510,5rtkit-daemon2193-21rtkit-daemon11:29:062
219499510,5rtkit-daemon2193-21rtkit-daemon10:30:532
219499510,5rtkit-daemon2193-21rtkit-daemon09:12:572
2398099504,39cyclictest0-21swapper/307:50:493
2397699505,28cyclictest0-21swapper/008:25:590
2397699505,28cyclictest0-21swapper/007:51:060
2397699505,26cyclictest0-21swapper/006:50:590
219499500,5rtkit-daemon2193-21rtkit-daemon08:13:362
219499500,4rtkit-daemon2193-21rtkit-daemon06:41:102
35292493,40sleep00-21swapper/006:59:470
2398099493,40cyclictest0-21swapper/307:45:523
2398099493,29cyclictest0-21swapper/307:43:313
23980994921,12cyclictest0-21swapper/307:38:313
23980994919,24cyclictest0-21swapper/307:01:083
2397699494,28cyclictest0-21swapper/007:30:510
2397699494,27cyclictest0-21swapper/006:45:420
2398099485,27cyclictest0-21swapper/308:08:363
2398099485,27cyclictest0-21swapper/308:08:363
2398099485,27cyclictest0-21swapper/306:43:203
2398099484,28cyclictest0-21swapper/308:03:353
2397999483,40cyclictest0-21swapper/207:01:072
2397699486,25cyclictest0-21swapper/007:41:000
23976994819,12cyclictest0-21swapper/007:03:230
224332483,36sleep30-21swapper/306:30:583
260932472,10sleep30-21swapper/306:37:293
260932472,10sleep30-21swapper/306:37:293
2398099474,24cyclictest7512-21taskset08:15:503
23980994718,11cyclictest0-21swapper/307:20:593
23980994718,11cyclictest0-21swapper/307:20:593
2397999473,40cyclictest0-21swapper/206:51:092
23979994632,9cyclictest8067-21cut08:15:552
23979994632,8cyclictest258562sleep206:36:152
23979994632,8cyclictest258562sleep206:36:152
237482464,6sleep00-21swapper/006:33:120
23980994525,15cyclictest0-21swapper/308:11:013
2397999454,35cyclictest0-21swapper/207:11:122
23979994529,11cyclictest22281-21grep07:36:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional