You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 17:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Mar 10, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
78919911138,10cyclictest0-21swapper/210:21:122
2485991110,6rtkit-daemon0-21swapper/309:34:383
7889991053,52cyclictest14635-21grep09:43:061
2485991050,5rtkit-daemon7740-21awk08:43:253
2485991050,5rtkit-daemon29206-21yum-updatesd-he06:31:153
78919910439,51cyclictest0-21swapper/208:06:012
7889991045,51cyclictest0-21swapper/109:07:501
2485991030,6rtkit-daemon0-21swapper/308:59:173
2485991030,4rtkit-daemon34-21rcuc/307:39:123
78919910236,12cyclictest0-21swapper/209:57:232
78919910236,12cyclictest0-21swapper/209:57:232
2485991020,5rtkit-daemon32457-21ssh09:22:313
78919910136,13cyclictest0-21swapper/210:33:412
78919910136,13cyclictest0-21swapper/210:33:412
78919910136,13cyclictest0-21swapper/208:00:022
7885991013,49cyclictest0-21swapper/009:03:140
78919910032,13cyclictest0-21swapper/208:36:522
7889991004,51cyclictest0-21swapper/108:48:131
7889991004,49cyclictest0-21swapper/110:24:391
7885991004,89cyclictest0-21swapper/010:58:050
2485991000,6rtkit-daemon0-21swapper/307:00:293
2485991000,6rtkit-daemon0-21swapper/306:54:593
2485991000,6rtkit-daemon0-21swapper/306:45:293
2485991000,6rtkit-daemon0-21swapper/306:42:293
7891999936,13cyclictest0-21swapper/211:03:542
7891999936,12cyclictest0-21swapper/209:04:192
7891999935,13cyclictest0-21swapper/208:31:442
7891999935,13cyclictest0-21swapper/208:31:442
788999996,50cyclictest0-21swapper/110:03:171
788999994,47cyclictest0-21swapper/110:53:341
788999985,50cyclictest0-21swapper/109:38:121
788999984,49cyclictest0-21swapper/110:17:481
788599985,47cyclictest0-21swapper/010:53:070
248599980,6rtkit-daemon0-21swapper/309:27:303
248599980,4rtkit-daemon12-21rcu_preempt06:16:453
789199974,28cyclictest0-21swapper/210:23:112
7891999737,13cyclictest0-21swapper/209:00:082
788999974,49cyclictest0-21swapper/108:05:241
788599973,49cyclictest0-21swapper/007:13:160
248599970,4rtkit-daemon12-21rcu_preempt07:23:203
789199963,29cyclictest0-21swapper/207:13:222
788999965,50cyclictest0-21swapper/110:58:201
788999965,48cyclictest0-21swapper/108:31:581
788999965,48cyclictest0-21swapper/108:31:581
788999965,47cyclictest0-21swapper/109:16:561
788999964,50cyclictest0-21swapper/109:09:491
788999964,50cyclictest0-21swapper/109:09:491
7891999536,13cyclictest0-21swapper/208:46:362
248599950,4rtkit-daemon441-21diskmemload08:12:183
788599945,43cyclictest0-21swapper/010:38:000
788599944,83cyclictest0-21swapper/008:31:180
788599944,83cyclictest0-21swapper/008:31:180
788599944,43cyclictest0-21swapper/010:48:220
789199934,26cyclictest0-21swapper/209:58:092
788599936,39cyclictest0-21swapper/008:08:250
788599933,47cyclictest0-21swapper/010:15:000
788599933,43cyclictest16557-21head10:33:100
788599933,43cyclictest16557-21head10:33:100
789199924,29cyclictest0-21swapper/207:48:142
789199924,29cyclictest0-21swapper/207:18:292
789199924,28cyclictest0-21swapper/210:58:152
7891999234,10cyclictest0-21swapper/209:30:032
7891999220,15cyclictest0-21swapper/210:32:232
788599925,81cyclictest0-21swapper/009:36:070
788599925,46cyclictest0-21swapper/008:06:310
788599925,45cyclictest0-21swapper/010:26:250
788599925,14cyclictest0-21swapper/007:57:540
788599923,44cyclictest0-21swapper/011:03:080
248599920,5rtkit-daemon9890-21uptime05:48:313
248599920,28rtkit-daemon22874-21ssh09:08:013
248599920,28rtkit-daemon22874-21ssh09:08:013
789199914,36cyclictest0-21swapper/209:47:412
7891999121,13cyclictest0-21swapper/209:48:092
788999914,51cyclictest0-21swapper/110:09:431
788999914,50cyclictest0-21swapper/107:47:541
788999914,50cyclictest0-21swapper/107:47:541
788599914,43cyclictest0-21swapper/009:13:180
788599913,44cyclictest0-21swapper/008:02:210
788599913,42cyclictest14178-21sensors_temp08:53:190
789199905,28cyclictest0-21swapper/210:13:432
789199904,39cyclictest0-21swapper/210:43:132
789199904,38cyclictest0-21swapper/209:38:252
788599906,44cyclictest0-21swapper/010:02:090
788599904,49cyclictest0-21swapper/008:45:500
788599895,46cyclictest0-21swapper/009:48:010
788599895,43cyclictest0-21swapper/006:21:470
788599895,43cyclictest0-21swapper/006:21:470
788599893,47cyclictest0-21swapper/010:28:100
248599890,30rtkit-daemon11101-21tail08:48:243
789199885,42cyclictest0-21swapper/208:23:092
789199884,39cyclictest0-21swapper/208:40:232
789199884,38cyclictest1419-21runrttasks06:13:232
789199884,28cyclictest0-21swapper/207:23:072
789199884,27cyclictest0-21swapper/209:33:232
789199883,41cyclictest0-21swapper/207:53:222
7891998817,14cyclictest0-21swapper/209:13:532
788599884,45cyclictest0-21swapper/009:18:050
248599880,24rtkit-daemon32412-21gltestperf08:33:103
789199875,39cyclictest0-21swapper/206:03:112
789199874,29cyclictest0-21swapper/210:03:212
789199874,28cyclictest0-21swapper/206:53:172
789199874,27cyclictest0-21swapper/209:20:532
788999874,51cyclictest0-21swapper/107:59:121
248599870,27rtkit-daemon0-21swapper/207:33:123
789199864,35cyclictest0-21swapper/210:39:152
789199864,29cyclictest0-21swapper/210:53:092
789199864,28cyclictest0-21swapper/208:52:342
7891998618,14cyclictest0-21swapper/209:25:132
7891998616,15cyclictest0-21swapper/208:09:532
788599865,44cyclictest0-21swapper/010:43:000
788599865,13cyclictest0-21swapper/006:23:150
13052860,3sleep041ktimersoftd/008:34:400
789199854,29cyclictest0-21swapper/210:12:052
789199854,28cyclictest0-21swapper/208:13:122
788599855,44cyclictest0-21swapper/006:01:350
7885998532,12cyclictest0-21swapper/008:14:380
789199845,28cyclictest0-21swapper/211:13:142
789199844,30cyclictest0-21swapper/208:18:162
788599845,12cyclictest0-21swapper/011:14:370
248599840,26rtkit-daemon30817-21sh08:31:183
248599840,26rtkit-daemon30817-21sh08:31:183
789199833,29cyclictest0-21swapper/206:58:192
7891998315,15cyclictest0-21swapper/210:50:282
788599836,40cyclictest0-21swapper/009:43:000
788599835,44cyclictest0-21swapper/008:25:490
248599830,19rtkit-daemon13626-21wc08:53:093
789199826,39cyclictest0-21swapper/211:12:452
789199824,28cyclictest0-21swapper/207:03:132
789199824,28cyclictest0-21swapper/207:03:132
788599824,44cyclictest0-21swapper/008:51:530
248599820,26rtkit-daemon0-21swapper/206:03:233
7891998120,14cyclictest0-21swapper/206:23:332
248599810,25rtkit-daemon0-21swapper/209:13:013
789199803,34cyclictest0-21swapper/207:47:542
789199803,34cyclictest0-21swapper/207:47:542
248599800,26rtkit-daemon0-21swapper/208:13:263
248599800,25rtkit-daemon9477-21sed07:58:263
7891997431,9cyclictest0-21swapper/205:51:032
248599740,6rtkit-daemon0-21swapper/306:42:592
248599740,6rtkit-daemon0-21swapper/305:56:392
789199684,46cyclictest0-21swapper/206:19:552
789199684,46cyclictest0-21swapper/206:19:552
788999674,56cyclictest0-21swapper/110:27:591
789299664,36cyclictest0-21swapper/310:35:243
789299664,36cyclictest0-21swapper/310:35:243
788999664,54cyclictest6078-21aten_r1power_po08:43:031
788999654,54cyclictest0-21swapper/109:57:491
788999654,54cyclictest0-21swapper/109:57:491
788999645,51cyclictest0-21swapper/108:58:001
788999644,52cyclictest0-21swapper/107:31:121
248599640,5rtkit-daemon0-21swapper/207:12:513
7891996335,13cyclictest0-21swapper/209:08:122
7891996335,13cyclictest0-21swapper/209:08:122
7891996335,13cyclictest0-21swapper/208:54:162
788999634,52cyclictest22331-21gltestperf08:18:121
788599635,52cyclictest0-21swapper/010:21:080
788599633,52cyclictest0-21swapper/011:08:200
29932630,3sleep3361ktimersoftd/307:49:323
7892996243,10cyclictest7468-21gltestperf11:08:063
788999626,49cyclictest0-21swapper/107:52:011
788999625,50cyclictest0-21swapper/108:53:141
788999625,50cyclictest0-21swapper/108:38:121
788999624,51cyclictest0-21swapper/106:07:571
788999615,49cyclictest27254-21ssh10:48:201
788999615,47cyclictest0-21swapper/109:48:001
788999614,51cyclictest0-21swapper/108:15:531
788999614,50cyclictest0-21swapper/111:16:341
788999614,50cyclictest0-21swapper/109:33:201
788999613,11cyclictest6152-21which10:18:071
788599615,50cyclictest0-21swapper/010:09:340
788599613,51cyclictest0-21swapper/009:28:040
248599610,6rtkit-daemon0-21swapper/307:32:202
248599610,6rtkit-daemon0-21swapper/306:50:372
248599610,6rtkit-daemon0-21swapper/306:34:072
248599610,6rtkit-daemon0-21swapper/306:29:302
7892996016,26cyclictest11675-21crond10:27:473
788999605,49cyclictest0-21swapper/109:21:411
788999605,49cyclictest0-21swapper/107:55:451
788999605,49cyclictest0-21swapper/106:28:201
788999605,48cyclictest7460-21sed11:08:061
788999605,48cyclictest0-21swapper/108:08:001
788999605,47cyclictest0-21swapper/109:23:021
788999604,50cyclictest22635-21df_inode10:43:031
788999604,49cyclictest0-21swapper/110:38:021
788999604,49cyclictest0-21swapper/107:17:551
788999603,50cyclictest0-21swapper/109:28:071
788599605,50cyclictest0-21swapper/007:50:010
788599603,51cyclictest0-21swapper/006:13:230
248599600,6rtkit-daemon0-21swapper/307:37:572
248599600,6rtkit-daemon0-21swapper/307:32:572
248599600,6rtkit-daemon0-21swapper/307:09:282
248599600,6rtkit-daemon0-21swapper/306:38:002
248599600,6rtkit-daemon0-21swapper/305:59:312
788999596,47cyclictest0-21swapper/110:35:331
788999596,47cyclictest0-21swapper/110:35:331
788999596,46cyclictest0-21swapper/107:03:221
788999596,46cyclictest0-21swapper/107:03:221
788999595,47cyclictest0-21swapper/108:27:141
788599594,49cyclictest0-21swapper/010:06:010
7885995933,12cyclictest0-21swapper/005:48:290
788999584,48cyclictest0-21swapper/111:03:191
788999583,48cyclictest839-21unixbench_multi08:33:251
788599586,46cyclictest0-21swapper/009:40:330
788599586,46cyclictest0-21swapper/008:18:050
788599585,47cyclictest0-21swapper/009:08:560
788599585,47cyclictest0-21swapper/009:08:560
788599584,47cyclictest0-21swapper/007:23:060
789299575,15cyclictest0-21swapper/308:04:333
7892995722,29cyclictest2142-21cstates10:13:023
7892995712,27cyclictest0-21swapper/309:39:093
788999574,46cyclictest0-21swapper/106:23:141
788599573,48cyclictest0-21swapper/009:53:470
788599573,48cyclictest0-21swapper/009:53:470
788599573,47cyclictest0-21swapper/008:38:020
789299565,26cyclictest0-21swapper/310:21:293
789299565,25cyclictest11665-21aten2.4-expect07:03:073
789299565,25cyclictest11665-21aten2.4-expect07:03:073
789299564,27cyclictest0-21swapper/309:52:593
789299564,27cyclictest0-21swapper/309:52:593
788999563,11cyclictest23442-21munin-node06:18:171
788999563,11cyclictest23442-21munin-node06:18:171
788599565,46cyclictest0-21swapper/006:08:120
788599564,47cyclictest0-21swapper/009:23:090
788599563,45cyclictest0-21swapper/007:38:100
789299555,31cyclictest0-21swapper/310:43:173
789299554,36cyclictest0-21swapper/310:07:163
789299554,13cyclictest0-21swapper/311:12:553
7892995527,12cyclictest0-21swapper/310:52:503
788599556,43cyclictest0-21swapper/006:03:080
788599555,44cyclictest0-21swapper/007:33:130
788599554,43cyclictest0-21swapper/008:58:010
788599553,44cyclictest0-21swapper/007:43:040
788599553,44cyclictest0-21swapper/007:43:040
146842553,8sleep314685-21yum05:58:323
789299545,14cyclictest0-21swapper/309:29:443
789299545,12cyclictest17797-21df09:48:033
789299544,29cyclictest0-21swapper/310:08:273
788999544,44cyclictest26120-21aten2.4-expect07:33:071
788999544,28cyclictest0-21swapper/109:59:061
788999543,12cyclictest0-21swapper/107:18:141
788599544,45cyclictest0-21swapper/006:43:150
789299535,25cyclictest4261-21iostat_ios11:03:073
789299534,34cyclictest0-21swapper/310:40:593
788999535,28cyclictest0-21swapper/107:38:131
788999534,28cyclictest0-21swapper/106:13:151
788999533,9cyclictest4238-21crond06:47:551
788999533,44cyclictest0-21swapper/106:53:531
788999533,11cyclictest0-21swapper/106:58:081
788599535,42cyclictest0-21swapper/007:22:100
788599534,43cyclictest0-21swapper/007:08:180
7822533,42sleep00-21swapper/006:38:240
306832533,42sleep130755-21ls06:33:211
789299525,29cyclictest0-21swapper/310:48:083
789299525,14cyclictest0-21swapper/309:07:453
789299524,31cyclictest0-21swapper/309:43:143
789299524,30cyclictest0-21swapper/308:38:183
789299524,28cyclictest0-21swapper/307:32:543
789299523,26cyclictest0-21swapper/307:17:123
788999523,11cyclictest0-21swapper/106:08:171
788599524,41cyclictest0-21swapper/006:53:120
789299515,27cyclictest0-21swapper/306:23:183
789299514,28cyclictest0-21swapper/306:48:293
7892995133,11cyclictest24068-21munin-node09:58:113
789299513,25cyclictest25868-21kernelversion08:23:133
789299513,25cyclictest0-21swapper/307:44:113
789299513,25cyclictest0-21swapper/307:44:113
7892995122,12cyclictest0-21swapper/305:53:303
7892995120,14cyclictest0-21swapper/307:53:113
788999513,11cyclictest0-21swapper/105:48:221
321032512,9sleep30-21swapper/310:57:563
789299504,28cyclictest0-21swapper/308:18:133
789299504,28cyclictest0-21swapper/306:33:143
789299504,27cyclictest0-21swapper/306:12:573
789299503,40cyclictest7427-21kworker/3:110:27:553
788999503,13cyclictest0-21swapper/107:08:041
788999503,11cyclictest0-21swapper/105:58:191
788599505,39cyclictest0-21swapper/006:48:080
788599505,37cyclictest0-21swapper/007:02:560
76752503,6sleep00-21swapper/005:45:390
789299494,27cyclictest0-21swapper/305:47:593
789199495,26cyclictest0-21swapper/206:08:152
788999493,11cyclictest0-21swapper/106:41:491
788599493,40cyclictest0-21swapper/005:53:230
228472493,9sleep30-21swapper/306:18:113
228472493,9sleep30-21swapper/306:18:113
788599485,37cyclictest0-21swapper/007:28:060
63082484,35sleep10-21swapper/105:43:151
116292484,38sleep00-21swapper/007:02:580
116292484,38sleep00-21swapper/007:02:580
788999473,12cyclictest0-21swapper/106:48:151
7889994714,11cyclictest12814-21cat05:57:581
788999463,12cyclictest0-21swapper/107:23:061
788599464,35cyclictest0-21swapper/006:28:250
788599455,34cyclictest0-21swapper/006:33:170
789299444,24cyclictest0-21swapper/307:18:163
78082414,30sleep20-21swapper/205:47:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional