You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 00:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Aug 27, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
261679910338,13cyclictest0-21swapper/209:52:412
261679910338,13cyclictest0-21swapper/209:52:412
2613521020,4sleep226-21rcuc/207:55:042
2613521020,4sleep226-21rcuc/207:55:042
26167991004,56cyclictest1227-21runrttasks10:26:202
2616399783,56cyclictest29679-21latency_hist06:59:530
26167997443,13cyclictest0-21swapper/210:35:032
2616399743,65cyclictest0-21swapper/008:14:160
2616399734,9cyclictest20142-21grep10:10:190
2616399734,62cyclictest0-21swapper/007:45:260
2616899723,61cyclictest0-21swapper/309:00:193
2616399723,63cyclictest0-21swapper/010:39:510
26168997115,48cyclictest24239-21grep07:50:253
26168997115,48cyclictest24239-21grep07:50:253
2616899695,57cyclictest0-21swapper/306:30:053
2616899695,57cyclictest0-21swapper/306:30:053
2616899695,55cyclictest1124-21snmpd10:34:433
2616899695,55cyclictest1124-21snmpd10:34:433
2616799693,49cyclictest30920-21latency_hist05:54:562
2616799693,49cyclictest30920-21latency_hist05:54:562
69422686,12sleep10-21swapper/107:19:531
69422686,12sleep10-21swapper/107:19:531
53262683,10sleep00-21swapper/010:38:590
2616899687,53cyclictest3468-21timerandwakeup09:45:183
2616899684,57cyclictest0-21swapper/311:10:033
2616899684,57cyclictest0-21swapper/311:10:033
2616799683,58cyclictest0-21swapper/208:45:182
2616899677,53cyclictest0-21swapper/309:26:133
2616899675,54cyclictest10497-21processes10:45:113
2616899674,56cyclictest0-21swapper/310:12:243
2616899674,55cyclictest18671-21munin-plugin-st10:59:433
2616899667,53cyclictest0-21swapper/308:38:513
2616899667,53cyclictest0-21swapper/308:38:513
2616899665,53cyclictest0-21swapper/307:59:513
2616899665,53cyclictest0-21swapper/307:59:513
2616899664,54cyclictest23534-21awk11:05:103
2616899664,54cyclictest0-21swapper/310:50:163
2616899664,54cyclictest0-21swapper/308:26:503
26167996640,13cyclictest0-21swapper/209:34:322
26167996640,12cyclictest0-21swapper/206:50:142
2616799664,55cyclictest0-21swapper/210:39:542
2616799664,55cyclictest0-21swapper/206:45:122
2616699663,43cyclictest17610-21cat09:19:481
2616699663,43cyclictest17610-21cat09:19:481
2616399668,51cyclictest0-21swapper/009:21:260
2616399666,53cyclictest0-21swapper/007:15:160
2616399666,53cyclictest0-21swapper/007:15:160
2616899656,52cyclictest0-21swapper/308:01:063
2616899655,54cyclictest18893-21diskmemload09:53:083
2616899655,54cyclictest18893-21diskmemload09:53:083
2616899654,54cyclictest10803-21munin-node06:20:233
2616899654,54cyclictest0-21swapper/310:41:153
2616899654,54cyclictest0-21swapper/310:38:113
2616899654,54cyclictest0-21swapper/309:17:493
2616899654,54cyclictest0-21swapper/309:17:493
2616899654,54cyclictest0-21swapper/309:07:313
2616899654,54cyclictest0-21swapper/308:42:303
2616899654,54cyclictest0-21swapper/307:44:513
2616799654,54cyclictest0-21swapper/209:57:302
2616799654,54cyclictest0-21swapper/208:33:302
2616799654,54cyclictest0-21swapper/208:20:152
2616799654,54cyclictest0-21swapper/208:16:142
2616799653,56cyclictest0-21swapper/210:32:002
2616799653,56cyclictest0-21swapper/210:32:002
2616799653,56cyclictest0-21swapper/209:06:392
2616799653,55cyclictest0-21swapper/208:26:572
26167996515,43cyclictest0-21swapper/209:25:222
26166996547,11cyclictest0-21swapper/105:55:281
26166996540,9cyclictest10613-21aten_r1power_po08:20:031
26166996535,13cyclictest0-21swapper/107:55:091
26166996535,13cyclictest0-21swapper/107:55:091
2616699653,56cyclictest0-21swapper/105:45:061
2616699653,54cyclictest0-21swapper/110:24:591
2616399655,52cyclictest0-21swapper/006:15:160
2616399654,53cyclictest0-21swapper/010:00:020
2616399654,16cyclictest0-21swapper/009:15:070
2616399654,16cyclictest0-21swapper/009:15:070
2616899649,48cyclictest21400-21kernelversion06:40:163
2616899645,52cyclictest3241-21ssh08:55:453
2616899645,52cyclictest0-21swapper/309:32:533
2616899644,53cyclictest16606-21sort10:05:173
2616899643,54cyclictest14173-21kworker/3:109:21:133
2616899643,12cyclictest0-21swapper/306:19:243
2616799645,51cyclictest0-21swapper/210:45:022
2616799645,51cyclictest0-21swapper/209:20:062
2616799644,53cyclictest0-21swapper/210:19:492
2616799644,53cyclictest0-21swapper/208:04:262
26167996437,13cyclictest0-21swapper/207:20:122
2616799643,54cyclictest0-21swapper/210:51:052
2616799643,54cyclictest0-21swapper/208:50:152
2616799643,53cyclictest0-21swapper/209:35:042
2616699644,53cyclictest0-21swapper/110:09:231
2616699644,53cyclictest0-21swapper/108:40:111
2616699643,54cyclictest0-21swapper/106:15:051
2616899634,53cyclictest18893-21diskmemload08:09:483
2616899634,52cyclictest4672-21iostat_ios06:05:163
2616899634,51cyclictest1124-21snmpd10:59:473
2616899633,53cyclictest9569-21munin-node07:25:223
2616899633,53cyclictest30687-21df08:50:033
2616899633,53cyclictest14682-21ssh10:04:263
2616799636,51cyclictest18893-21diskmemload09:47:252
2616799635,51cyclictest2207-21metacity11:07:412
2616799635,51cyclictest0-21swapper/209:15:012
2616799635,51cyclictest0-21swapper/209:15:012
2616799635,51cyclictest0-21swapper/208:35:232
2616799635,51cyclictest0-21swapper/208:35:232
2616799635,51cyclictest0-21swapper/207:50:252
2616799635,51cyclictest0-21swapper/207:50:252
2616799633,52cyclictest0-21swapper/207:10:182
2616799633,52cyclictest0-21swapper/207:10:182
2616699635,51cyclictest0-21swapper/106:32:481
2616699635,51cyclictest0-21swapper/106:32:481
2616699634,53cyclictest0-21swapper/108:15:381
26166996337,12cyclictest0-21swapper/111:04:581
26166996336,12cyclictest0-21swapper/108:30:081
26166996335,13cyclictest0-21swapper/108:25:021
2616699633,53cyclictest0-21swapper/110:50:291
2616699633,53cyclictest0-21swapper/105:50:101
2616699633,53cyclictest0-21swapper/105:50:101
2616699633,44cyclictest0-21swapper/110:55:041
2616399637,50cyclictest0-21swapper/009:14:480
2616399637,50cyclictest0-21swapper/009:14:480
2616399636,12cyclictest0-21swapper/009:44:590
309922623,53sleep00-21swapper/010:28:550
2616899627,48cyclictest27000-21hostname08:45:013
2616899625,50cyclictest0-21swapper/308:10:093
2616899624,52cyclictest8713-21python08:15:203
2616899624,52cyclictest25809-21smartctl10:20:063
2616899623,53cyclictest23352-21uniq06:45:083
2616899623,52cyclictest29831-21ssh09:36:483
2616899623,52cyclictest21209-21ssh07:46:373
2616899623,51cyclictest0-21swapper/310:24:583
2616799628,48cyclictest281ktimersoftd/207:40:092
2616799624,52cyclictest18893-21diskmemload08:41:362
2616799624,51cyclictest25513-21munin-node11:10:022
2616799624,51cyclictest25513-21munin-node11:10:022
2616799624,51cyclictest23762-21ssh10:16:262
2616799624,51cyclictest0-21swapper/210:00:042
2616799624,51cyclictest0-21swapper/206:00:132
2616799623,53cyclictest18893-21diskmemload10:58:362
2616799623,53cyclictest0-21swapper/206:15:162
2616799623,52cyclictest32725-21ssh08:04:552
2616799623,52cyclictest30852-21ssh09:39:562
2616799623,52cyclictest21911-21ssh11:04:332
2616799623,52cyclictest0-21swapper/208:55:012
2616799623,52cyclictest0-21swapper/207:15:192
2616799623,52cyclictest0-21swapper/207:15:192
2616799622,54cyclictest15172-21telnet10:04:582
2616799622,52cyclictest30933-21kworker/2:008:10:242
26166996236,13cyclictest0-21swapper/109:40:071
26166996235,13cyclictest0-21swapper/110:41:491
2616699623,53cyclictest0-21swapper/109:35:391
2616699623,53cyclictest0-21swapper/109:12:381
2616699623,53cyclictest0-21swapper/109:12:381
2616699623,53cyclictest0-21swapper/107:41:191
2616699623,52cyclictest0-21swapper/109:25:021
2616699623,51cyclictest0-21swapper/108:10:131
2616399625,51cyclictest0-21swapper/009:55:090
2616399625,51cyclictest0-21swapper/008:47:210
2616399625,14cyclictest14682-21grep07:35:050
2616399624,51cyclictest0-21swapper/007:03:460
2616399624,13cyclictest0-21swapper/005:50:130
2616399624,13cyclictest0-21swapper/005:50:130
2616899615,50cyclictest0-21swapper/309:56:463
2616899615,49cyclictest0-21swapper/309:41:143
2616899613,51cyclictest28768-21munin-node05:50:203
2616899613,51cyclictest28768-21munin-node05:50:203
2616899613,51cyclictest13039-21ssh09:10:313
2616899613,51cyclictest13039-21ssh09:10:313
2616899613,51cyclictest11956-21munin-node07:30:183
2616899613,51cyclictest10503-21ssh08:20:013
2616799615,48cyclictest281ktimersoftd/206:20:162
2616799613,52cyclictest13180-21ssh09:11:042
2616799613,52cyclictest13180-21ssh09:11:042
2616799613,51cyclictest32302-21munin-node07:05:062
2616799613,51cyclictest0-21swapper/206:34:542
2616799613,51cyclictest0-21swapper/206:34:542
2616799613,50cyclictest0-21swapper/210:09:592
2616699614,50cyclictest0-21swapper/110:18:051
26166996135,12cyclictest0-21swapper/109:58:271
2616699613,53cyclictest0-21swapper/107:00:191
2616699613,52cyclictest0-21swapper/110:22:451
2616699613,52cyclictest0-21swapper/107:46:531
2616699613,52cyclictest0-21swapper/107:10:271
2616699613,52cyclictest0-21swapper/107:10:271
2616699613,51cyclictest0-21swapper/110:38:361
2616699613,51cyclictest0-21swapper/108:00:041
2616699613,51cyclictest0-21swapper/107:05:141
2616699613,51cyclictest0-21swapper/106:50:121
2616699613,50cyclictest0-21swapper/106:29:551
2616699612,53cyclictest0-21swapper/110:04:471
26166996116,39cyclictest0-21swapper/109:45:461
2616399614,12cyclictest0-21swapper/009:00:220
26163996111,44cyclictest0-21swapper/010:52:460
2616899603,50cyclictest32179-21iostat_ios05:55:173
2616899603,50cyclictest22052-21munin-node10:15:003
2616899603,50cyclictest19472-21ssh08:32:253
2616799603,52cyclictest0-21swapper/206:05:052
2616799603,51cyclictest21326-21ssh07:46:592
2616799603,50cyclictest0-21swapper/207:25:192
2616799602,53cyclictest0-21swapper/209:00:022
2616799602,53cyclictest0-21swapper/207:35:192
2616699604,50cyclictest0-21swapper/109:31:321
2616699604,50cyclictest0-21swapper/109:02:441
2616699604,50cyclictest0-21swapper/108:53:301
2616699604,49cyclictest0-21swapper/110:45:171
2616699604,49cyclictest0-21swapper/106:38:431
2616699604,49cyclictest0-21swapper/106:10:081
2616699603,51cyclictest0-21swapper/109:08:081
2616699603,51cyclictest0-21swapper/107:35:211
2616399606,49cyclictest0-21swapper/009:53:460
2616399606,49cyclictest0-21swapper/009:53:460
2616399605,13cyclictest0-21swapper/006:39:540
2616399604,17cyclictest0-21swapper/009:09:030
2616399604,17cyclictest0-21swapper/008:15:220
2616399603,12cyclictest0-21swapper/011:04:550
219499600,6rtkit-daemon2193-21rtkit-daemon08:55:001
105072603,10sleep00-21swapper/008:20:020
2616899593,11cyclictest1836-21fschecks_time06:00:143
2616699595,49cyclictest0-21swapper/108:05:071
2616699595,48cyclictest0-21swapper/110:31:001
2616699595,48cyclictest0-21swapper/110:31:001
2616699594,49cyclictest0-21swapper/109:24:151
2616699594,49cyclictest0-21swapper/108:35:011
2616699594,49cyclictest0-21swapper/108:35:011
2616699594,49cyclictest0-21swapper/106:22:461
2616699594,49cyclictest0-21swapper/106:00:071
2616699594,48cyclictest0-21swapper/111:09:521
2616699594,48cyclictest0-21swapper/111:09:521
2616699594,48cyclictest0-21swapper/106:05:171
2616699593,51cyclictest0-21swapper/110:10:041
2616699593,50cyclictest0-21swapper/111:04:021
2616699593,50cyclictest0-21swapper/108:45:011
2616699593,50cyclictest0-21swapper/107:53:431
2616699593,50cyclictest0-21swapper/107:53:431
2616399597,15cyclictest0-21swapper/008:09:450
2616399595,15cyclictest0-21swapper/008:25:120
2616399594,13cyclictest0-21swapper/009:30:000
2616399593,15cyclictest0-21swapper/010:06:290
255372594,9sleep00-21swapper/008:40:260
2616899582,51cyclictest0-21swapper/307:05:083
2616799583,9cyclictest856-21crond05:59:552
2616799582,51cyclictest0-21swapper/206:37:492
2616699583,50cyclictest0-21swapper/109:54:431
2616699583,50cyclictest0-21swapper/109:54:431
2616699583,49cyclictest0-21swapper/106:45:021
2616399588,31cyclictest0-21swapper/009:26:460
2616399585,47cyclictest0-21swapper/008:49:590
2616399585,14cyclictest0-21swapper/007:20:050
2616399584,18cyclictest0-21swapper/010:32:250
2616399584,18cyclictest0-21swapper/010:32:250
2616399584,14cyclictest0-21swapper/007:09:530
2616399583,12cyclictest0-21swapper/007:25:270
26163995814,21cyclictest0-21swapper/008:55:000
2616899572,48cyclictest0-21swapper/305:45:153
2616799572,48cyclictest6034-21munin-node06:10:112
2616699575,46cyclictest0-21swapper/107:23:561
2616699574,47cyclictest0-21swapper/106:40:171
2616399576,15cyclictest0-21swapper/007:51:410
2616399576,15cyclictest0-21swapper/007:51:410
2616399575,29cyclictest0-21swapper/006:30:080
2616399575,29cyclictest0-21swapper/006:30:080
2616399575,14cyclictest0-21swapper/009:37:290
2616399574,17cyclictest0-21swapper/011:11:190
2616399574,17cyclictest0-21swapper/011:11:190
2616399574,16cyclictest0-21swapper/010:22:380
2616399574,14cyclictest0-21swapper/011:03:160
2616399574,14cyclictest0-21swapper/008:35:120
2616399574,14cyclictest0-21swapper/008:35:120
2616399573,14cyclictest0-21swapper/007:44:510
26163995710,9cyclictest18672-21crond10:59:430
2616899562,48cyclictest0-21swapper/307:15:223
2616899562,48cyclictest0-21swapper/307:15:223
2616899562,48cyclictest0-21swapper/307:10:123
2616899562,48cyclictest0-21swapper/307:10:123
2616799562,13cyclictest0-21swapper/206:40:162
2616699563,48cyclictest0-21swapper/106:55:441
2616399564,29cyclictest0-21swapper/007:55:170
2616399564,29cyclictest0-21swapper/007:55:170
2616399564,13cyclictest0-21swapper/010:44:550
2616399564,13cyclictest0-21swapper/006:20:110
2616399563,14cyclictest0-21swapper/008:02:440
2616399563,13cyclictest0-21swapper/009:44:080
2616399562,38cyclictest0-21swapper/006:40:040
2616899552,15cyclictest0-21swapper/307:20:153
2616799552,48cyclictest0-21swapper/207:02:052
2616699554,46cyclictest0-21swapper/107:25:181
2616699554,44cyclictest0-21swapper/107:30:041
2616399556,31cyclictest0-21swapper/010:15:100
2616399554,15cyclictest0-21swapper/008:30:530
2616399553,12cyclictest0-21swapper/006:45:070
2616899542,47cyclictest0-21swapper/306:10:283
2616399544,13cyclictest0-21swapper/006:50:200
2616799532,46cyclictest0-21swapper/207:34:202
2616799532,14cyclictest0-21swapper/206:55:102
2616399533,14cyclictest0-21swapper/006:09:380
2616399533,11cyclictest0-21swapper/006:03:070
2616899522,44cyclictest0-21swapper/307:00:583
2616899522,12cyclictest0-21swapper/306:50:063
2616399526,11cyclictest0-21swapper/007:10:020
2616399526,11cyclictest0-21swapper/007:10:020
2616399522,44cyclictest0-21swapper/006:27:470
26163995219,11cyclictest0-21swapper/005:57:030
26163995218,14cyclictest0-21swapper/005:47:400
2616899512,11cyclictest0-21swapper/306:28:593
2616799513,15cyclictest0-21swapper/205:49:552
2616399515,40cyclictest0-21swapper/005:44:560
151032512,9sleep30-21swapper/307:35:103
2616799502,14cyclictest0-21swapper/206:25:052
2616699504,41cyclictest0-21swapper/105:44:571
2616399503,8cyclictest8184-21latency_hist06:14:550
2616399503,11cyclictest0-21swapper/007:33:020
26168994933,9cyclictest28364-21grep06:55:123
26168994918,9cyclictest19042-21latency06:35:183
2616799445,24cyclictest26141-21latency_hist05:44:572
2616899402,23cyclictest0-21swapper/305:44:563
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional