You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 23:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Mar 19, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2737121100,3sleep2281ktimersoftd/206:34:472
2485991090,6rtkit-daemon0-21swapper/107:55:341
2485991070,8rtkit-daemon0-21swapper/107:49:571
1523921060,5sleep1201ktimersoftd/106:09:461
248599970,8rtkit-daemon0-21swapper/105:59:161
32378999614,12cyclictest0-21swapper/010:14:300
32378999614,12cyclictest0-21swapper/010:14:300
248599960,6rtkit-daemon18-21rcuc/108:19:481
3237899923,26cyclictest0-21swapper/009:46:290
248599920,6rtkit-daemon0-21swapper/105:53:461
248599910,5rtkit-daemon20213-21latency_hist08:19:251
3237899904,22cyclictest18362-21sshd09:50:050
3237899894,78cyclictest0-21swapper/010:39:460
3237899894,77cyclictest0-21swapper/010:49:390
3237899893,79cyclictest0-21swapper/011:04:430
32378998919,11cyclictest1961-21tune2fs06:49:440
3237899884,77cyclictest0-21swapper/009:54:360
3237899884,77cyclictest0-21swapper/008:34:440
3237899884,77cyclictest0-21swapper/008:30:150
3237899884,76cyclictest0-21swapper/010:59:460
3237899884,76cyclictest0-21swapper/010:59:460
3237899884,24cyclictest0-21swapper/009:21:160
3237899884,23cyclictest0-21swapper/010:32:340
3237899883,13cyclictest0-21swapper/010:24:320
32378998828,53cyclictest0-21swapper/008:54:360
3237899874,24cyclictest0-21swapper/009:18:180
32378998725,56cyclictest0-21swapper/007:13:050
3237899864,75cyclictest0-21swapper/007:59:370
3237899864,73cyclictest0-21swapper/007:14:430
32378998633,47cyclictest29720-21grep06:39:460
32378998633,47cyclictest22439-21chrt10:44:450
3237899863,75cyclictest0-21swapper/008:19:470
32378998622,57cyclictest0-21swapper/007:43:300
32378998619,9cyclictest23857-21aten2.4-expect08:24:340
32378998618,12cyclictest0-21swapper/009:59:320
32378998616,13cyclictest0-21swapper/010:54:470
3237899854,73cyclictest0-21swapper/007:54:450
3237899854,72cyclictest0-21swapper/008:14:360
3237899853,23cyclictest0-21swapper/009:41:280
32378998525,52cyclictest27261-21grep10:04:370
3237899843,74cyclictest0-21swapper/010:24:200
3237899843,74cyclictest0-21swapper/007:53:500
32378998424,53cyclictest0-21swapper/008:49:350
32378998424,53cyclictest0-21swapper/008:49:350
32378998422,9cyclictest25112-21diskmemload08:49:230
32381998331,31cyclictest0-21swapper/209:24:512
3237899834,72cyclictest0-21swapper/008:44:240
3237899834,72cyclictest0-21swapper/008:04:470
3237899833,24cyclictest0-21swapper/008:09:280
3237899833,24cyclictest0-21swapper/008:09:280
3237899824,23cyclictest0-21swapper/009:30:360
3237899824,23cyclictest0-21swapper/009:30:360
3237899824,21cyclictest0-21swapper/007:44:490
3237899823,71cyclictest0-21swapper/010:11:430
32378998219,55cyclictest0-21swapper/009:34:390
32381998131,32cyclictest17437-21cpuspeed_turbos08:14:392
32381998116,54cyclictest0-21swapper/208:04:442
3237899814,71cyclictest0-21swapper/008:59:490
3237899814,70cyclictest0-21swapper/009:07:380
32378998130,44cyclictest11562-21unixbench_multi06:00:010
32378998130,44cyclictest11562-21unixbench_multi06:00:010
3237899813,71cyclictest0-21swapper/009:25:200
32378998112,9cyclictest0-21swapper/010:36:420
32381998028,44cyclictest14889-21cut08:59:232
32381998028,34cyclictest0-21swapper/207:59:262
32381998027,46cyclictest0-21swapper/208:39:532
32381998025,48cyclictest0-21swapper/210:19:212
32381998021,51cyclictest0-21swapper/209:14:562
3237899803,70cyclictest0-21swapper/005:40:040
3237899803,35cyclictest0-21swapper/007:19:390
3237899803,29cyclictest22607-21grep06:24:470
3237899803,11cyclictest1287-21snmpd07:34:570
32378998014,6cyclictest0-21swapper/009:09:480
3237899793,68cyclictest19178-21latency_hist06:19:300
32378997923,50cyclictest0-21swapper/005:49:430
32381997833,38cyclictest30921-21cpuspeed_turbos08:34:372
32381997829,31cyclictest35601ssh09:29:372
32381997829,31cyclictest35601ssh09:29:372
32381997828,32cyclictest0-21swapper/209:23:002
32381997828,29cyclictest16174-21unixbench_multi10:34:512
32381997827,43cyclictest0-21swapper/209:34:322
32381997825,35cyclictest0-21swapper/211:03:012
32381997825,35cyclictest0-21swapper/211:03:012
32381997818,40cyclictest0-21swapper/205:54:522
3237899784,24cyclictest1287-21snmpd07:27:200
3237899784,23cyclictest0-21swapper/006:09:590
3237899783,68cyclictest0-21swapper/007:09:270
32378997822,7cyclictest1419-21runrttasks07:33:070
32378997822,7cyclictest1419-21runrttasks07:33:070
248599780,4rtkit-daemon2484-21rtkit-daemon08:17:413
32381997729,41cyclictest20453-21taskset08:19:292
32381997728,42cyclictest5475-21memory10:19:432
32381997728,30cyclictest0-21swapper/208:49:392
32381997728,30cyclictest0-21swapper/208:49:392
32378997730,41cyclictest13124-21cut06:04:490
3237899773,24cyclictest1287-21snmpd06:59:120
32378997724,8cyclictest9140-21grep05:55:030
32378997721,8cyclictest1419-21runrttasks07:02:480
32378997713,12cyclictest0-21swapper/006:29:460
32381997627,33cyclictest0-21swapper/210:54:452
32381997626,42cyclictest0-21swapper/207:39:572
32381997625,44cyclictest0-21swapper/207:33:522
32381997625,44cyclictest0-21swapper/207:33:522
32381997623,45cyclictest0-21swapper/210:14:202
32381997621,48cyclictest0-21swapper/210:18:202
32378997619,8cyclictest1419-21runrttasks06:19:570
248599760,9rtkit-daemon0-21swapper/106:00:382
248599760,9rtkit-daemon0-21swapper/106:00:382
32381997531,26cyclictest121850irq/46-eth009:39:342
32381997530,38cyclictest8255-21ssh07:59:522
32381997528,29cyclictest1243-21lldpd10:27:292
32381997525,43cyclictest23151-21ssh09:09:482
32381997524,33cyclictest5008-21munin-node08:44:482
32381997523,33cyclictest0-21swapper/209:49:492
32381997522,33cyclictest0-21swapper/207:34:562
3237899753,64cyclictest0-21swapper/005:44:520
32381997427,30cyclictest14487-21ssh08:09:432
32381997427,30cyclictest14487-21ssh08:09:432
32381997425,42cyclictest0-21swapper/207:24:582
3237899745,17cyclictest0-21swapper/005:39:300
3237899743,63cyclictest0-21swapper/006:44:550
3237899743,63cyclictest0-21swapper/006:44:550
32381997333,21cyclictest17796-21basename10:39:292
32381997325,40cyclictest314031ssh07:47:342
32381997322,44cyclictest0-21swapper/209:02:262
32381997228,38cyclictest0-21swapper/210:51:332
32381997224,31cyclictest0-21swapper/206:24:442
32381997222,32cyclictest0-21swapper/211:09:182
32381997222,21cyclictest0-21swapper/210:04:432
32381997220,45cyclictest0-21swapper/208:33:152
32381997219,30cyclictest0-21swapper/209:46:512
3237899723,22cyclictest0-21swapper/006:34:440
32381997127,29cyclictest21585-21ssh09:54:542
32381997124,39cyclictest4602-21taskset05:46:222
32381997124,28cyclictest0-21swapper/209:59:492
32381997122,41cyclictest23893-21ssh10:48:132
32381997120,44cyclictest0-21swapper/209:06:362
32381997031,32cyclictest32705-21wc06:44:552
32381997031,32cyclictest32705-21wc06:44:552
32381997027,28cyclictest11016-21rm10:29:302
32381997026,29cyclictest0-21swapper/206:04:562
32381997025,26cyclictest3845-21munin-node06:54:482
32381997022,41cyclictest0-21swapper/207:50:152
32381996929,16cyclictest24677-21grep08:24:422
32381996918,16cyclictest0-21swapper/205:39:492
32381996846,16cyclictest1419-21runrttasks06:43:352
32381996823,28cyclictest2059-21fschecks_time06:49:442
32381996722,37cyclictest0-21swapper/207:14:412
32381996722,28cyclictest0-21swapper/207:22:192
32381996648,12cyclictest15308-21fschecks_count06:09:472
32381996521,37cyclictest0-21swapper/205:49:502
32381996519,28cyclictest0-21swapper/206:29:582
32381996432,24cyclictest0-21swapper/206:23:132
32381996429,28cyclictest0-21swapper/207:06:532
32381996415,43cyclictest0-21swapper/207:14:032
32381996314,41cyclictest0-21swapper/207:04:282
3238099614,40cyclictest0-21swapper/109:28:101
248599610,20rtkit-daemon2484-21rtkit-daemon11:02:271
248599610,20rtkit-daemon2484-21rtkit-daemon11:02:271
32381996037,16cyclictest1419-21runrttasks06:17:102
3238099604,38cyclictest0-21swapper/108:09:431
3238099604,38cyclictest0-21swapper/108:09:431
32380996029,13cyclictest21822-21munin-node09:09:471
248599600,5rtkit-daemon2484-21rtkit-daemon10:59:121
32382995913,36cyclictest0-21swapper/310:39:293
32381995931,22cyclictest0-21swapper/205:39:302
32380995914,27cyclictest0-21swapper/108:54:491
271062593,48sleep10-21swapper/109:15:061
248599590,5rtkit-daemon2484-21rtkit-daemon09:53:141
248599590,4rtkit-daemon2484-21rtkit-daemon10:42:351
89852583,11sleep10-21swapper/109:37:441
32382995815,26cyclictest22259-21latency10:44:423
3238099584,26cyclictest10700-21cpuspeed_turbos08:04:381
32380995812,28cyclictest0-21swapper/107:04:281
3238099574,36cyclictest0-21swapper/109:00:071
32380995737,13cyclictest32566-21needreboot06:44:521
32380995737,13cyclictest32566-21needreboot06:44:521
32380995723,11cyclictest1892-21iostat_ios10:14:421
32380995723,11cyclictest1892-21iostat_ios10:14:421
32380995715,22cyclictest0-21swapper/109:07:451
32380995713,26cyclictest0-21swapper/110:31:471
32382995637,11cyclictest18475-21grep07:24:423
32382995619,30cyclictest1697-21gltestperf10:14:393
32382995619,30cyclictest1697-21gltestperf10:14:393
32380995618,21cyclictest23902-21aten_r1power_en08:24:341
32380995611,26cyclictest0-21swapper/110:52:551
223682563,44sleep30-21swapper/306:24:453
3238299554,42cyclictest0-21swapper/309:44:413
248599550,5rtkit-daemon2484-21rtkit-daemon10:23:061
3238299544,36cyclictest0-21swapper/310:06:503
32382995423,13cyclictest0-21swapper/307:19:373
3238099545,29cyclictest0-21swapper/106:17:101
3238099545,23cyclictest0-21swapper/110:26:301
3238099545,23cyclictest0-21swapper/108:50:071
3238099545,23cyclictest0-21swapper/108:50:071
3238099544,41cyclictest0-21swapper/108:29:481
3238099544,30cyclictest0-21swapper/107:45:021
3238099544,28cyclictest0-21swapper/111:04:331
32380995434,12cyclictest2511-21gltestperf08:39:411
32380995423,10cyclictest23158-21munin-node09:59:411
248599540,6rtkit-daemon2484-21rtkit-daemon10:09:291
127732543,11sleep10-21swapper/109:44:171
3238299534,30cyclictest0-21swapper/309:24:213
3238299534,29cyclictest0-21swapper/310:09:333
3238299534,28cyclictest0-21swapper/308:59:413
32382995321,14cyclictest0-21swapper/305:39:303
32382995320,13cyclictest0-21swapper/306:44:513
32382995320,13cyclictest0-21swapper/306:44:513
3238099536,26cyclictest0-21swapper/108:34:391
3238099535,27cyclictest0-21swapper/107:39:391
3238099534,31cyclictest0-21swapper/110:09:191
3238099534,29cyclictest0-21swapper/110:44:391
3238099534,28cyclictest0-21swapper/109:29:441
3238099534,28cyclictest0-21swapper/109:29:441
32380995320,14cyclictest0-21swapper/110:37:231
32380995317,10cyclictest25112-21diskmemload09:19:341
272382533,10sleep10-21swapper/106:34:471
262042533,44sleep10-21swapper/106:32:411
248599530,5rtkit-daemon2484-21rtkit-daemon09:54:371
3238299525,13cyclictest1419-21runrttasks10:32:393
3238299524,41cyclictest0-21swapper/308:19:353
3238299524,29cyclictest0-21swapper/308:34:593
3238299524,27cyclictest0-21swapper/308:46:023
3238299524,26cyclictest0-21swapper/309:51:343
3238299523,34cyclictest0-21swapper/310:53:253
3238099525,28cyclictest0-21swapper/108:46:301
3238099525,27cyclictest0-21swapper/107:24:391
3238099525,25cyclictest0-21swapper/108:04:201
3238099524,29cyclictest0-21swapper/107:09:401
3238099523,34cyclictest0-21swapper/106:23:481
32380995221,12cyclictest0-21swapper/107:37:221
248599520,5rtkit-daemon2484-21rtkit-daemon09:44:521
108282524,12sleep30-21swapper/305:59:503
108282524,12sleep30-21swapper/305:59:503
3238299514,29cyclictest0-21swapper/309:04:413
3238299514,29cyclictest0-21swapper/308:39:503
3238299514,28cyclictest0-21swapper/307:39:383
3238299514,26cyclictest0-21swapper/308:06:153
32382995133,11cyclictest9484-21gltestperf07:04:473
32382995133,11cyclictest23630-21unixbench_singl09:09:543
32382995133,11cyclictest23326-21cpuspeed_turbos07:34:413
3238099515,27cyclictest0-21swapper/105:44:471
3238099514,28cyclictest0-21swapper/107:19:491
3238099514,28cyclictest0-21swapper/107:15:021
32380995119,13cyclictest0-21swapper/106:24:471
32380995116,12cyclictest0-21swapper/107:05:031
32380995115,13cyclictest0-21swapper/106:00:001
32380995115,13cyclictest0-21swapper/106:00:001
35952502,9sleep30-21swapper/306:54:203
3238299505,10cyclictest0-21swapper/308:24:393
3238299504,40cyclictest0-21swapper/306:34:523
3238299504,28cyclictest0-21swapper/308:54:403
3238299504,28cyclictest0-21swapper/307:44:543
3238299504,27cyclictest0-21swapper/310:34:513
3238299504,27cyclictest0-21swapper/310:29:213
3238299504,27cyclictest0-21swapper/309:14:513
3238299504,27cyclictest0-21swapper/307:59:383
3238299504,12cyclictest0-21swapper/311:02:573
3238299504,12cyclictest0-21swapper/311:02:573
32382995034,10cyclictest7245-21gltestperf09:34:403
32382995031,13cyclictest0-21swapper/307:56:083
3238299503,42cyclictest0-21swapper/307:53:153
3238299503,41cyclictest0-21swapper/308:33:263
32382995019,13cyclictest0-21swapper/306:19:543
3238099504,27cyclictest0-21swapper/107:29:511
3238099504,27cyclictest0-21swapper/107:29:511
3238099504,26cyclictest0-21swapper/106:04:401
3238099504,25cyclictest0-21swapper/106:49:471
3238099504,25cyclictest0-21swapper/106:39:571
3238099504,24cyclictest5105-21awk06:54:531
197712502,9sleep30-21swapper/309:54:263
3238299494,39cyclictest0-21swapper/309:40:153
3238299494,28cyclictest0-21swapper/310:19:373
3238299494,27cyclictest0-21swapper/310:54:493
3238299494,27cyclictest0-21swapper/308:10:003
3238299494,27cyclictest0-21swapper/308:10:003
3238299494,27cyclictest0-21swapper/306:29:393
3238299494,27cyclictest0-21swapper/306:14:573
3238299494,26cyclictest0-21swapper/306:59:293
32382994931,11cyclictest15289-21fschecks_count06:09:473
3238299493,28cyclictest0-21swapper/308:49:543
3238299493,28cyclictest0-21swapper/308:49:543
32382994919,12cyclictest0-21swapper/311:09:183
32382994918,13cyclictest0-21swapper/305:40:073
32382994916,17cyclictest12-21rcu_preempt09:29:333
32382994916,17cyclictest12-21rcu_preempt09:29:333
3238299484,27cyclictest0-21swapper/306:39:523
3238299484,27cyclictest0-21swapper/305:55:063
3238299484,26cyclictest32694-21fschecks_time09:24:403
3238299483,24cyclictest0-21swapper/310:02:353
68982473,37sleep30-21swapper/305:50:103
3238299473,27cyclictest0-21swapper/306:59:433
23282473,11sleep10-21swapper/105:43:191
32382994628,11cyclictest13110-21cut06:04:493
3238299454,22cyclictest0-21swapper/305:44:423
32382994516,12cyclictest0-21swapper/307:29:493
32382994516,12cyclictest0-21swapper/307:29:493
3238299444,24cyclictest0-21swapper/307:09:383
32382994427,10cyclictest14594-21needreboot07:14:513
3238099433,31cyclictest0-21swapper/105:39:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional