You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 08:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue Aug 04, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35229911241,14cyclictest0-21swapper/120:01:571
3524991053,52cyclictest0-21swapper/322:07:083
35229910432,13cyclictest0-21swapper/121:57:211
3524991003,50cyclictest0-21swapper/318:47:333
35229910015,33cyclictest0-21swapper/120:07:181
3524999740,10cyclictest14136-21gltestperf18:27:193
352499953,51cyclictest0-21swapper/321:17:223
3524999325,10cyclictest17828-21crond18:37:003
352499895,50cyclictest32301-21yum-updatesd-he21:47:523
47412770,4sleep337-21ksoftirqd/323:33:353
118262730,3sleep2281ktimersoftd/219:31:572
3522997141,13cyclictest0-21swapper/123:22:061
352499673,58cyclictest0-21swapper/322:28:423
352499663,55cyclictest0-21swapper/322:21:513
352499654,54cyclictest0-21swapper/322:39:583
352399654,20cyclictest10387-21latency_hist21:16:552
352499645,51cyclictest0-21swapper/321:02:273
352499645,51cyclictest0-21swapper/321:02:273
352499644,41cyclictest0-21swapper/323:02:013
352499644,41cyclictest0-21swapper/323:02:013
351999644,51cyclictest0-21swapper/020:48:070
352499635,50cyclictest0-21swapper/320:57:073
352499634,51cyclictest0-21swapper/320:52:063
352499633,53cyclictest0-21swapper/321:57:083
352399632,53cyclictest0-21swapper/223:04:502
352399632,53cyclictest0-21swapper/223:04:502
3952623,52sleep2510-21sed20:12:172
352499624,50cyclictest0-21swapper/322:24:103
352499614,51cyclictest0-21swapper/320:30:423
352399613,12cyclictest0-21swapper/223:36:492
128662617,8sleep00-21swapper/022:07:250
352499604,50cyclictest0-21swapper/321:23:153
352399605,15cyclictest0-21swapper/223:25:142
352399604,38cyclictest0-21swapper/221:02:212
352399604,38cyclictest0-21swapper/221:02:212
352399604,37cyclictest0-21swapper/222:32:192
352299604,45cyclictest0-21swapper/121:36:531
8562598,7sleep10-21swapper/122:39:271
352499594,47cyclictest0-21swapper/321:32:243
3524995932,10cyclictest2896-21sort21:52:233
352499593,49cyclictest15370-21gltestperf22:12:123
352499593,49cyclictest0-21swapper/320:32:263
352499593,48cyclictest0-21swapper/320:42:163
352499593,48cyclictest0-21swapper/320:38:573
352399595,15cyclictest0-21swapper/222:27:092
3523995917,26cyclictest20366-21taskset22:20:122
134812593,48sleep20-21swapper/222:09:012
352499583,48cyclictest30072-21munin-run21:46:523
352499583,48cyclictest30072-21munin-run21:46:523
352499583,48cyclictest24832-21munin-node21:37:163
3523995826,10cyclictest1227-21runrttasks22:41:382
352299584,47cyclictest0-21swapper/122:22:441
3522995832,11cyclictest24429-21needreboot20:47:201
3519995838,12cyclictest31849-21wc22:37:090
3519995828,13cyclictest0-21swapper/020:57:290
100512580,4sleep310053-21ssh22:52:233
76302573,12sleep00-21swapper/020:22:190
76302573,12sleep00-21swapper/020:22:190
352499573,47cyclictest0-21swapper/319:57:173
352399576,33cyclictest0-21swapper/221:42:112
352399576,33cyclictest0-21swapper/221:42:112
352399574,13cyclictest1124-21snmpd22:06:332
352299574,46cyclictest0-21swapper/121:07:251
352299574,45cyclictest0-21swapper/120:30:151
3522995730,12cyclictest0-21swapper/122:52:471
3522995728,13cyclictest0-21swapper/123:02:131
3522995728,13cyclictest0-21swapper/123:02:131
3522995727,12cyclictest0-21swapper/123:18:041
351999573,46cyclictest0-21swapper/022:17:050
3519995712,27cyclictest0-21swapper/022:47:480
181202572,7sleep118126-21swap20:37:281
352499564,46cyclictest0-21swapper/318:07:173
352499563,46cyclictest6273-21iostat_ios22:47:123
352499563,46cyclictest28361-21perl22:32:103
3523995616,25cyclictest0-21swapper/220:44:092
352299564,44cyclictest0-21swapper/122:17:171
3522995629,13cyclictest0-21swapper/122:59:531
3522995628,13cyclictest0-21swapper/121:02:111
3522995628,13cyclictest0-21swapper/121:02:111
351999564,45cyclictest0-21swapper/023:36:490
351999564,14cyclictest0-21swapper/021:42:110
351999564,14cyclictest0-21swapper/021:42:110
325942564,45sleep00-21swapper/023:27:120
130052565,43sleep10-21swapper/122:07:261
79992553,7sleep38085-21rt-features20:22:263
79992553,7sleep38085-21rt-features20:22:263
47822553,45sleep20-21swapper/222:46:142
352499554,44cyclictest0-21swapper/321:07:413
352399559,28cyclictest0-21swapper/220:48:042
352399558,29cyclictest0-21swapper/220:17:192
352399555,34cyclictest0-21swapper/223:21:082
352299553,38cyclictest0-21swapper/120:32:171
3522995527,20cyclictest24367-21aten_r1power_cu22:27:021
3522995526,13cyclictest0-21swapper/121:54:261
351999554,25cyclictest0-21swapper/023:00:170
351999553,25cyclictest14262-21latency_hist19:36:580
3519995527,20cyclictest0-21swapper/018:47:170
313202553,9sleep00-21swapper/020:10:180
29852554,12sleep00-21swapper/022:42:170
234432550,7sleep00-21swapper/021:36:400
168512553,45sleep20-21swapper/222:14:212
6732543,7sleep1688-21iostat_ios20:12:201
352499545,43cyclictest0-21swapper/320:12:183
352499545,43cyclictest0-21swapper/319:32:223
352499544,44cyclictest0-21swapper/323:12:133
352499544,43cyclictest0-21swapper/318:12:243
352499543,45cyclictest4285-21munin-node20:17:193
352499543,45cyclictest19280-21hddtemp_smartct23:07:083
3524995429,7cyclictest30877-21ssh20:08:473
352399544,34cyclictest0-21swapper/221:26:402
352399544,28cyclictest0-21swapper/220:07:242
3523995418,32cyclictest0-21swapper/223:09:102
3523995416,22cyclictest22849-21ssh21:34:212
3523995413,27cyclictest0-21swapper/221:19:462
3523995412,13cyclictest0-21swapper/221:48:002
352299545,27cyclictest0-21swapper/120:23:151
352299545,27cyclictest0-21swapper/120:23:151
352299544,43cyclictest0-21swapper/121:28:351
3522995436,11cyclictest3379-21head23:32:071
3522995432,10cyclictest0-21swapper/121:37:091
3522995431,8cyclictest7188-21yum-updatesd-he22:47:581
3522995430,11cyclictest0-21swapper/123:12:381
3522995428,13cyclictest0-21swapper/122:42:421
3522995413,25cyclictest1084-21lldpd18:22:331
351999544,43cyclictest0-21swapper/023:25:080
3519995434,13cyclictest0-21swapper/020:41:100
351999543,43cyclictest10276-21unixbench_multi22:52:250
3519995415,15cyclictest4770-21telnet21:57:060
24972543,9sleep00-21swapper/019:12:090
165862543,9sleep00-21swapper/019:41:560
8092533,9sleep00-21swapper/021:51:330
352499535,42cyclictest0-21swapper/323:22:073
352499533,44cyclictest0-21swapper/322:45:493
3524995327,9cyclictest26287-21ntpdc23:17:173
352399539,25cyclictest0-21swapper/223:27:092
352399536,29cyclictest0-21swapper/222:47:012
352399536,28cyclictest0-21swapper/222:52:092
352399535,31cyclictest0-21swapper/222:00:352
352399535,31cyclictest0-21swapper/221:52:052
352399534,33cyclictest0-21swapper/220:24:582
352399534,33cyclictest0-21swapper/220:24:582
3523995322,13cyclictest0-21swapper/223:13:532
3523995321,15cyclictest0-21swapper/221:41:242
3523995320,15cyclictest0-21swapper/220:32:122
3523995320,15cyclictest0-21swapper/219:42:312
352299535,27cyclictest0-21swapper/118:22:001
352299534,29cyclictest0-21swapper/123:11:501
3522995325,13cyclictest0-21swapper/121:16:041
3522995325,13cyclictest0-21swapper/119:31:581
351999534,30cyclictest0-21swapper/023:17:190
351999534,30cyclictest0-21swapper/022:27:110
351999534,14cyclictest0-21swapper/020:27:140
3519995314,23cyclictest1522-21cpuspeed_turbos21:52:050
27702533,44sleep00-21swapper/021:02:590
27702533,44sleep00-21swapper/021:02:590
130232533,9sleep00-21swapper/018:26:420
352499524,42cyclictest0-21swapper/322:57:043
352499524,42cyclictest0-21swapper/318:57:113
352399525,29cyclictest0-21swapper/218:27:142
352399525,28cyclictest0-21swapper/222:22:232
352399525,28cyclictest0-21swapper/219:57:142
352399524,42cyclictest0-21swapper/218:57:002
352399524,33cyclictest0-21swapper/221:06:592
3523995222,13cyclictest0-21swapper/222:57:152
3523995222,13cyclictest0-21swapper/220:37:072
3523995222,11cyclictest19221-21munin-node19:47:352
3523995221,14cyclictest0-21swapper/218:57:312
3523995220,14cyclictest0-21swapper/218:32:322
3523995219,14cyclictest0-21swapper/220:53:232
352299526,28cyclictest0-21swapper/119:47:281
352299525,28cyclictest0-21swapper/118:07:021
352299524,42cyclictest0-21swapper/121:20:391
352299524,42cyclictest0-21swapper/118:32:101
3522995228,10cyclictest0-21swapper/121:22:081
3522995225,12cyclictest0-21swapper/120:57:091
3522995224,12cyclictest0-21swapper/123:28:031
351999524,29cyclictest0-21swapper/023:02:070
351999524,29cyclictest0-21swapper/023:02:070
351999524,28cyclictest7394-21munin-node21:12:050
351999524,26cyclictest22912-21sadc20:46:540
239792523,9sleep00-21swapper/022:26:320
156842523,43sleep00-21swapper/020:34:250
74022513,40sleep27506-21cpuspeed19:22:112
3524995122,13cyclictest0-21swapper/320:47:073
352399515,28cyclictest0-21swapper/218:07:162
352399514,28cyclictest0-21swapper/220:29:572
352399514,27cyclictest0-21swapper/218:12:372
3523995121,12cyclictest0-21swapper/218:17:282
3523995119,13cyclictest0-21swapper/220:57:072
352299516,28cyclictest0-21swapper/121:48:121
352299515,28cyclictest0-21swapper/122:32:111
352299515,28cyclictest0-21swapper/122:12:191
352299515,28cyclictest0-21swapper/119:42:351
352299515,28cyclictest0-21swapper/118:32:011
352299515,27cyclictest0-21swapper/121:43:211
352299515,27cyclictest0-21swapper/121:43:211
352299514,29cyclictest0-21swapper/119:32:221
352299514,29cyclictest0-21swapper/119:17:251
352299514,29cyclictest0-21swapper/118:47:301
3522995123,12cyclictest0-21swapper/122:03:121
3522995120,24cyclictest27915-21processes20:52:241
3522995118,14cyclictest0-21swapper/118:17:011
3522995110,25cyclictest0-21swapper/120:42:431
351999514,40cyclictest0-21swapper/021:23:120
351999514,28cyclictest0-21swapper/022:12:030
351999513,28cyclictest1124-21snmpd23:11:490
3519995129,15cyclictest0-21swapper/020:02:160
21632512,9sleep20-21swapper/219:11:182
200822513,9sleep00-21swapper/018:40:200
175492513,9sleep00-21swapper/018:33:270
130392513,42sleep00-21swapper/021:19:280
352499505,40cyclictest0-21swapper/319:37:033
352499504,40cyclictest0-21swapper/322:02:173
352499503,41cyclictest0-21swapper/321:12:143
3524995017,27cyclictest31998-21grep23:27:043
352399504,29cyclictest0-21swapper/218:37:182
352399504,28cyclictest0-21swapper/219:12:252
352399504,28cyclictest0-21swapper/219:02:262
352399504,28cyclictest0-21swapper/219:02:262
352399504,27cyclictest0-21swapper/219:19:062
3523995031,13cyclictest26419-21aten_r1power_cu20:02:082
352399503,28cyclictest0-21swapper/221:27:152
352299505,28cyclictest0-21swapper/118:37:261
352299505,27cyclictest0-21swapper/120:19:131
352299504,29cyclictest0-21swapper/119:22:281
352299504,27cyclictest0-21swapper/119:07:101
351999505,39cyclictest0-21swapper/020:55:000
351999505,27cyclictest0-21swapper/023:15:240
351999504,28cyclictest0-21swapper/020:12:110
351999504,28cyclictest0-21swapper/019:56:570
351999504,28cyclictest0-21swapper/019:02:150
351999504,28cyclictest0-21swapper/019:02:150
351999504,27cyclictest0-21swapper/018:27:220
351999503,31cyclictest0-21swapper/021:07:180
351999503,28cyclictest0-21swapper/021:37:130
351999503,27cyclictest3852-21grep20:17:150
3519995025,12cyclictest0-21swapper/021:29:430
3519995020,13cyclictest0-21swapper/022:35:140
157862503,39sleep20-21swapper/219:37:262
352499493,40cyclictest0-21swapper/321:27:093
352499493,40cyclictest0-21swapper/319:22:143
352399494,27cyclictest0-21swapper/219:56:582
3522994931,12cyclictest14716-21cpuspeed_turbos19:37:111
351999498,35cyclictest0-21swapper/019:43:070
351999494,38cyclictest0-21swapper/022:04:500
351999494,28cyclictest0-21swapper/018:57:220
351999494,27cyclictest0-21swapper/018:52:140
351999494,27cyclictest0-21swapper/018:12:180
3519994932,10cyclictest20967-21grep19:47:330
351999493,21cyclictest41ktimersoftd/019:07:220
3519994921,11cyclictest0-21swapper/018:11:570
3519994917,14cyclictest0-21swapper/019:22:150
179112492,9sleep30-21swapper/319:42:233
352499484,39cyclictest0-21swapper/320:06:563
352499484,39cyclictest0-21swapper/318:52:593
352499484,38cyclictest0-21swapper/319:17:153
352499484,21cyclictest0-21swapper/319:47:163
352499483,40cyclictest0-21swapper/319:27:253
352499483,39cyclictest0-21swapper/319:07:093
3523994834,8cyclictest22138-21unixbench-2d18:42:482
352399483,27cyclictest0-21swapper/218:47:312
3523994816,14cyclictest0-21swapper/219:32:172
352299485,27cyclictest0-21swapper/120:02:091
3522994824,8cyclictest22581-21if_eth019:52:191
351999484,27cyclictest0-21swapper/018:17:200
223742483,9sleep00-21swapper/018:44:070
352499474,38cyclictest0-21swapper/318:45:263
3524994731,10cyclictest9329-21gltestperf18:17:213
3524994723,18cyclictest18712-21cut18:37:203
352499472,39cyclictest0-21swapper/319:12:123
352399474,27cyclictest0-21swapper/218:22:122
352299476,35cyclictest0-21swapper/118:42:361
352299474,27cyclictest0-21swapper/119:16:591
352299473,36cyclictest5901-21munin-run18:12:001
3522994727,14cyclictest0-21swapper/119:02:281
3522994727,14cyclictest0-21swapper/119:02:281
351999473,26cyclictest0-21swapper/018:07:010
67302463,37sleep00-21swapper/019:17:530
352299464,36cyclictest0-21swapper/118:52:191
351999464,26cyclictest0-21swapper/019:27:310
3519994629,10cyclictest25335-21ps19:57:240
352499454,11cyclictest0-21swapper/318:07:013
3524994530,10cyclictest23328-21unixbench_multi19:52:313
352499453,36cyclictest0-21swapper/319:02:093
352499453,36cyclictest0-21swapper/319:02:093
3523994514,12cyclictest0-21swapper/218:07:012
352499442,37cyclictest0-21swapper/318:22:163
352299444,26cyclictest0-21swapper/118:57:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional