You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 21:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jun 14, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3047021480,40sleep130469-21basename07:29:501
12608991014,89cyclictest0-21swapper/211:19:492
12608991014,89cyclictest0-21swapper/211:19:492
12608991004,88cyclictest12530-21ls10:39:332
12608991004,88cyclictest12530-21ls10:39:332
12608991003,89cyclictest23378-21fschecks_count09:19:412
12608991003,89cyclictest23378-21fschecks_count09:19:412
1260899993,89cyclictest0-21swapper/209:24:392
1260899974,86cyclictest0-21swapper/211:39:342
1260899973,87cyclictest0-21swapper/210:24:402
1260899973,86cyclictest0-21swapper/208:59:572
12607999634,54cyclictest32709-21cpuspeed_turbos11:09:341
1260899953,23cyclictest7445-21telnet09:44:352
1260899943,83cyclictest14329-21fschecks_time11:29:382
12607999412,13cyclictest0-21swapper/111:04:331
1260899934,36cyclictest0-21swapper/211:14:332
1260899933,82cyclictest0-21swapper/210:59:482
1260899924,81cyclictest0-21swapper/211:54:282
1260899924,13cyclictest0-21swapper/210:39:212
1260899923,27cyclictest0-21swapper/210:54:482
12608999215,11cyclictest0-21swapper/210:02:152
12608999215,11cyclictest0-21swapper/210:02:152
1260899914,24cyclictest12489-21grep09:50:002
1260899913,80cyclictest0-21swapper/212:17:172
12607999114,14cyclictest0-21swapper/109:54:341
1260899903,80cyclictest0-21swapper/210:09:512
1260899903,79cyclictest0-21swapper/211:04:342
1260899903,24cyclictest0-21swapper/209:33:522
1260899903,13cyclictest0-21swapper/210:14:462
12608999021,9cyclictest27053-21munin-node11:49:482
12608999013,12cyclictest0-21swapper/211:25:002
1260799904,12cyclictest0-21swapper/111:59:471
1260799904,12cyclictest0-21swapper/111:59:471
1260799904,12cyclictest0-21swapper/111:24:281
1260799903,35cyclictest5233-21tr12:04:311
1260799903,17cyclictest7287-21df_abs11:19:341
1260799903,17cyclictest7287-21df_abs11:19:341
12607999010,11cyclictest25695-21sshd10:09:551
12607998941,42cyclictest0-21swapper/110:57:101
1260899883,24cyclictest0-21swapper/209:55:102
1260799889,13cyclictest0-21swapper/109:32:111
1260799885,74cyclictest0-21swapper/108:19:561
12607998841,40cyclictest0-21swapper/110:17:491
1260799884,76cyclictest0-21swapper/112:18:271
1260799884,76cyclictest0-21swapper/107:20:021
1260799884,38cyclictest0-21swapper/110:39:561
1260799884,38cyclictest0-21swapper/110:39:561
1260799884,33cyclictest0-21swapper/110:53:331
1260799883,35cyclictest16765-21needreboot10:44:451
12607998816,11cyclictest19267-21head09:59:571
12607998816,11cyclictest19267-21head09:59:571
1260899874,76cyclictest0-21swapper/209:15:182
1260899874,26cyclictest0-21swapper/210:54:032
1260899874,26cyclictest0-21swapper/210:20:512
1260899873,37cyclictest0-21swapper/212:02:572
1260899873,37cyclictest0-21swapper/212:02:572
1260899873,27cyclictest0-21swapper/211:09:352
1260899873,27cyclictest0-21swapper/210:32:502
1260899873,13cyclictest0-21swapper/207:35:042
1260799875,36cyclictest0-21swapper/109:24:491
1260799875,24cyclictest0-21swapper/109:14:361
1260799874,9cyclictest13610-21needreboot09:04:501
1260799874,31cyclictest12563-21unixbench_singl09:50:011
1260799874,23cyclictest0-21swapper/110:26:261
1260799874,22cyclictest0-21swapper/110:34:391
1260799873,19cyclictest30593-21cpu11:54:301
12607998722,14cyclictest0-21swapper/110:59:311
1260899864,40cyclictest0-21swapper/207:24:472
1260899864,26cyclictest0-21swapper/208:56:492
1260899863,75cyclictest0-21swapper/207:30:012
1260899863,27cyclictest0-21swapper/208:09:582
12608998620,8cyclictest5338-21diskmemload11:44:512
12608998617,8cyclictest21350-21ssh10:04:372
12608998617,8cyclictest21350-21ssh10:04:372
12608998611,20cyclictest107550irq/46-eth012:09:462
1260799865,25cyclictest0-21swapper/111:42:301
1260799865,22cyclictest0-21swapper/112:10:371
1260799864,28cyclictest0-21swapper/107:29:281
1260799864,13cyclictest0-21swapper/109:20:571
1260799864,13cyclictest0-21swapper/109:20:571
1260799864,12cyclictest0-21swapper/112:20:131
1260799863,22cyclictest0-21swapper/109:39:491
12607998624,9cyclictest31552-21gltestperf08:39:431
1260899854,12cyclictest0-21swapper/209:37:092
12607998528,11cyclictest23818-21cpuspeed_turbos08:24:391
12607998523,13cyclictest0-21swapper/111:46:451
12607998515,11cyclictest0-21swapper/111:29:431
1260899845,24cyclictest0-21swapper/209:41:522
1260899843,27cyclictest0-21swapper/210:44:522
1260899843,12cyclictest0-21swapper/211:34:492
1260799845,33cyclictest0-21swapper/108:57:151
1260799845,23cyclictest0-21swapper/110:21:131
1260799844,33cyclictest0-21swapper/107:44:551
1260799844,30cyclictest0-21swapper/107:11:021
1260799844,27cyclictest0-21swapper/111:34:471
1260799844,12cyclictest0-21swapper/111:14:531
1260799844,12cyclictest0-21swapper/108:44:511
1260799844,12cyclictest0-21swapper/108:44:511
1260799843,21cyclictest9039-21sh08:59:381
12607998424,10cyclictest5717-21cpuspeed_turbos10:29:351
1260899834,21cyclictest13210-21ssh09:04:442
1260899833,28cyclictest0-21swapper/207:19:462
1260899833,14cyclictest0-21swapper/212:19:332
12608998314,12cyclictest0-21swapper/209:10:082
1260799838,21cyclictest0-21swapper/111:54:191
1260799834,32cyclictest0-21swapper/109:09:381
12607998322,10cyclictest10892-21unixbench_multi07:55:011
1260799825,13cyclictest0-21swapper/109:45:251
1260799824,32cyclictest0-21swapper/107:14:471
1260799824,32cyclictest0-21swapper/107:14:471
1260799824,13cyclictest0-21swapper/109:37:451
12607998222,9cyclictest21884-21ssh10:04:451
12607998222,9cyclictest21884-21ssh10:04:451
1260899813,24cyclictest0-21swapper/208:04:492
1260799814,35cyclictest0-21swapper/107:34:451
12607998125,9cyclictest7634-21gltestperf07:49:491
12607998123,10cyclictest2356-21cpuspeed_turbos07:39:431
1260899803,43cyclictest19749-21latency_hist07:09:302
1260899803,42cyclictest0-21swapper/212:05:182
12608998010,18cyclictest0-21swapper/208:29:372
12607998025,10cyclictest14528-21unixbench_multi06:55:011
1260899793,36cyclictest0-21swapper/206:54:562
1260899793,23cyclictest0-21swapper/208:24:372
12608997922,10cyclictest22367-21munin-node07:14:532
12608997922,10cyclictest22367-21munin-node07:14:532
12608997822,20cyclictest12508-21hwlatdetect07:59:472
12608997822,20cyclictest12508-21hwlatdetect07:59:472
1260799783,21cyclictest19761-21awk07:09:291
12607997822,9cyclictest16483-21aten_r1power_po08:09:401
12607997818,13cyclictest0-21swapper/107:59:421
12607997818,13cyclictest0-21swapper/107:59:421
1260899772,42cyclictest0-21swapper/206:54:292
1260799776,17cyclictest0-21swapper/106:54:301
12607997726,10cyclictest3860-21cut08:49:431
1260899763,26cyclictest0-21swapper/207:09:572
1260799764,32cyclictest0-21swapper/108:15:001
12607997613,12cyclictest0-21swapper/108:34:441
271422750,3sleep3361ktimersoftd/311:49:293
1260799743,22cyclictest0-21swapper/108:04:381
12607997422,10cyclictest15824-21fschecks_count06:59:471
1260899712,10cyclictest0-21swapper/207:54:562
1260399674,12cyclictest0-21swapper/009:24:520
57442663,12sleep30-21swapper/311:16:243
1260999634,27cyclictest0-21swapper/310:29:393
12609996328,16cyclictest29207-21timerwakeupswit10:14:523
219499620,8rtkit-daemon2193-21rtkit-daemon12:01:283
219499620,8rtkit-daemon2193-21rtkit-daemon12:01:283
1260999614,40cyclictest0-21swapper/306:58:573
1260399617,48cyclictest0-21swapper/007:04:530
111972613,11sleep00-21swapper/009:01:280
219499600,4rtkit-daemon2193-21rtkit-daemon09:07:433
1260999606,48cyclictest0-21swapper/309:51:523
12609996029,11cyclictest1002-21sshd11:09:383
267692593,11sleep00-21swapper/010:12:310
219499590,6rtkit-daemon2193-21rtkit-daemon10:45:543
219499590,4rtkit-daemon2193-21rtkit-daemon11:01:163
219499590,4rtkit-daemon2193-21rtkit-daemon10:42:393
219499590,4rtkit-daemon2193-21rtkit-daemon10:42:393
219499590,4rtkit-daemon2193-21rtkit-daemon07:35:463
219499590,4rtkit-daemon2193-21rtkit-daemon07:14:253
219499590,18rtkit-daemon2193-21rtkit-daemon07:22:323
144392593,12sleep00-21swapper/012:18:180
1260999595,35cyclictest0-21swapper/309:03:313
8812583,11sleep00-21swapper/007:34:580
1260999584,32cyclictest0-21swapper/310:36:403
1260999584,22cyclictest0-21swapper/312:18:013
1260399587,46cyclictest3469-21kworker/0:111:36:430
1260399584,46cyclictest0-21swapper/009:14:440
1260999574,35cyclictest0-21swapper/311:36:123
1260999574,31cyclictest0-21swapper/311:28:353
1260999573,25cyclictest0-21swapper/311:54:353
12609995718,14cyclictest3058-21iostat_ios10:24:453
1260899574,45cyclictest0-21swapper/208:39:352
96762563,46sleep39775-21diskstats07:54:443
255172564,10sleep00-21swapper/008:27:340
166582564,46sleep00-21swapper/010:44:450
1260999565,30cyclictest0-21swapper/309:29:493
1260999565,26cyclictest0-21swapper/310:05:573
1260999565,26cyclictest0-21swapper/310:05:573
1260999564,35cyclictest0-21swapper/311:45:453
1260999564,24cyclictest0-21swapper/311:31:453
1260999563,37cyclictest8235-21munin-node12:09:443
12609995622,11cyclictest27284-21latency_hist10:14:233
1260899563,14cyclictest0-21swapper/208:49:452
1260399568,30cyclictest0-21swapper/011:09:560
12603995638,12cyclictest22708-21tr07:14:430
12603995638,12cyclictest22708-21tr07:14:430
12603995635,14cyclictest0-21swapper/010:14:460
65842552,13sleep00-21swapper/009:42:440
256872554,11sleep00-21swapper/011:45:200
219499550,6rtkit-daemon2193-21rtkit-daemon07:52:382
219499550,5rtkit-daemon2193-21rtkit-daemon08:44:592
219499550,5rtkit-daemon2193-21rtkit-daemon08:44:592
211672553,44sleep00-21swapper/010:51:220
145992554,11sleep00-21swapper/009:06:120
13982553,11sleep00-21swapper/010:23:400
130932553,45sleep00-21swapper/010:39:410
130932553,45sleep00-21swapper/010:39:410
1260999555,29cyclictest0-21swapper/311:04:383
1260999555,27cyclictest0-21swapper/309:43:173
1260999555,26cyclictest0-21swapper/310:54:263
1260999555,26cyclictest0-21swapper/309:13:463
1260999554,30cyclictest0-21swapper/309:34:523
1260999554,26cyclictest0-21swapper/309:56:373
1260999554,26cyclictest0-21swapper/307:08:583
1260999553,25cyclictest0-21swapper/309:44:553
12609995522,14cyclictest0-21swapper/308:14:533
12609995521,14cyclictest0-21swapper/308:29:493
12609995519,10cyclictest19623-21fschecks_time10:49:393
12609995517,13cyclictest0-21swapper/308:34:433
1260899553,25cyclictest0-21swapper/207:41:582
103072553,11sleep00-21swapper/012:10:320
255702542,10sleep30-21swapper/309:23:243
255702542,10sleep30-21swapper/309:23:243
1260999545,27cyclictest0-21swapper/310:19:313
1260999544,29cyclictest0-21swapper/307:14:413
1260999544,29cyclictest0-21swapper/307:14:413
1260999544,27cyclictest0-21swapper/312:19:503
1260999544,27cyclictest0-21swapper/312:04:483
1260999544,27cyclictest0-21swapper/311:41:023
1260999544,27cyclictest0-21swapper/309:59:553
1260999544,27cyclictest0-21swapper/309:59:553
1260999544,26cyclictest0-21swapper/308:55:283
1260999544,26cyclictest0-21swapper/307:29:493
1260999544,26cyclictest0-21swapper/307:29:013
1260999544,25cyclictest0-21swapper/309:24:343
1260999543,26cyclictest0-21swapper/311:19:403
1260999543,26cyclictest0-21swapper/311:19:403
12609995423,12cyclictest0-21swapper/309:14:503
12609995419,13cyclictest0-21swapper/306:59:423
12609995418,13cyclictest0-21swapper/308:19:583
1260399545,29cyclictest0-21swapper/010:24:510
12603995435,11cyclictest18101-21systemd-cgroups12:24:160
12603995418,13cyclictest0-21swapper/008:14:270
102852542,46sleep010394-21timerandwakeup10:34:530
28192533,10sleep00-21swapper/008:47:540
28192533,10sleep00-21swapper/008:47:540
219499530,4rtkit-daemon2193-21rtkit-daemon08:34:442
172842533,11sleep00-21swapper/007:03:370
135082533,44sleep00-21swapper/009:53:210
1260999535,25cyclictest0-21swapper/308:07:593
1260999534,29cyclictest0-21swapper/308:24:523
1260999534,26cyclictest0-21swapper/308:02:163
1260999534,26cyclictest0-21swapper/308:02:163
1260999534,26cyclictest0-21swapper/307:39:573
12609995321,13cyclictest0-21swapper/308:09:443
1260399535,28cyclictest0-21swapper/011:08:420
1260399534,43cyclictest0-21swapper/009:33:220
1260399534,41cyclictest0-21swapper/007:20:020
1260399533,42cyclictest0-21swapper/009:44:240
116952533,11sleep00-21swapper/011:24:520
1260999526,26cyclictest0-21swapper/308:54:173
1260999525,26cyclictest0-21swapper/308:44:153
1260999524,28cyclictest0-21swapper/307:44:463
1260399528,38cyclictest15-21rcuc/011:19:520
1260399528,38cyclictest15-21rcuc/011:19:520
1260399527,39cyclictest0-21swapper/011:29:390
1260399525,27cyclictest0-21swapper/009:59:380
1260399525,27cyclictest0-21swapper/009:59:380
1260399524,42cyclictest0-21swapper/010:04:560
1260399524,42cyclictest0-21swapper/010:04:560
12603995236,10cyclictest27576-21df07:24:440
1260399523,43cyclictest0-21swapper/009:34:450
76652514,10sleep00-21swapper/008:56:160
75442513,42sleep00-21swapper/012:07:460
306732513,40sleep00-21swapper/008:39:350
1260999514,28cyclictest0-21swapper/308:44:513
1260999514,28cyclictest0-21swapper/308:44:513
1260999514,26cyclictest0-21swapper/306:54:303
1260799514,30cyclictest0-21swapper/108:29:431
1260399516,40cyclictest0-21swapper/010:56:580
1260399515,14cyclictest0-21swapper/011:39:430
1260399514,41cyclictest0-21swapper/011:54:450
12603995121,13cyclictest0-21swapper/010:29:440
286362503,10sleep00-21swapper/011:04:000
278912503,41sleep00-21swapper/008:32:260
25442503,40sleep00-21swapper/007:39:450
1260399505,27cyclictest0-21swapper/007:29:580
1260399504,39cyclictest0-21swapper/011:53:490
1260399504,39cyclictest0-21swapper/009:09:440
1260399504,28cyclictest0-21swapper/011:14:360
1260399504,26cyclictest0-21swapper/011:59:360
1260399504,26cyclictest0-21swapper/011:59:360
122512504,6sleep00-21swapper/006:50:210
113192503,40sleep00-21swapper/007:59:080
88492493,39sleep00-21swapper/007:53:030
1260399494,39cyclictest0-21swapper/009:23:220
1260399494,39cyclictest0-21swapper/009:23:220
1260399494,27cyclictest0-21swapper/008:34:370
1260399494,25cyclictest0-21swapper/009:54:350
52422484,37sleep00-21swapper/008:53:180
159412483,11sleep00-21swapper/008:07:060
1260899484,37cyclictest15331-21aten2.4-expect06:59:422
62822473,10sleep00-21swapper/007:45:420
219272474,10sleep00-21swapper/007:11:560
207722473,37sleep00-21swapper/008:17:540
148132464,36sleep00-21swapper/006:57:290
135372463,36sleep00-21swapper/008:01:540
135372463,36sleep00-21swapper/008:01:540
1260999464,10cyclictest8965-21sh07:54:273
12603994629,11cyclictest21940-21gltestperf08:19:450
1260899453,12cyclictest0-21swapper/208:14:542
12608994514,12cyclictest0-21swapper/208:19:382
1260899443,24cyclictest0-21swapper/207:45:072
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional