You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 14:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri May 08, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
493021480,13sleep348499cyclictest07:56:123
484999939,8cyclictest25677-21diskmemload08:12:413
224342860,3sleep2281ktimersoftd/209:08:392
125092810,12sleep348499cyclictest06:22:513
125092810,12sleep348499cyclictest06:22:513
48099755,62cyclictest0-21swapper/206:23:062
48099755,62cyclictest0-21swapper/206:23:062
477997347,12cyclictest0-21swapper/109:17:351
477997344,13cyclictest0-21swapper/109:53:321
477997342,12cyclictest0-21swapper/107:21:171
480997229,26cyclictest15368-21grep09:47:372
472997243,13cyclictest0-21swapper/007:37:480
472997240,13cyclictest0-21swapper/008:02:560
472997142,8cyclictest14564-21rm07:22:420
477997044,11cyclictest29245-21munin-node07:42:591
477997044,11cyclictest29245-21munin-node07:42:591
477997041,14cyclictest0-21swapper/107:31:441
477997039,12cyclictest0-21swapper/108:39:211
472997037,13cyclictest0-21swapper/009:38:200
472997037,13cyclictest0-21swapper/009:38:200
47299703,60cyclictest0-21swapper/008:42:440
477996944,12cyclictest0-21swapper/110:17:521
477996941,12cyclictest0-21swapper/107:55:131
477996939,12cyclictest0-21swapper/110:16:261
477996938,13cyclictest0-21swapper/107:02:041
472996941,13cyclictest0-21swapper/007:57:550
472996939,14cyclictest0-21swapper/010:12:410
472996936,13cyclictest0-21swapper/007:10:490
48099684,14cyclictest0-21swapper/208:07:422
477996844,9cyclictest22923-21memory09:57:471
477996842,12cyclictest0-21swapper/106:42:471
472996843,9cyclictest25684-21awk06:52:300
472996836,13cyclictest0-21swapper/007:52:500
472996813,50cyclictest0-21swapper/006:57:170
484996732,22cyclictest23508-21kworker/3:106:57:393
477996742,12cyclictest0-21swapper/108:22:501
472996740,12cyclictest0-21swapper/007:17:430
47299674,56cyclictest0-21swapper/010:17:470
47299673,58cyclictest0-21swapper/010:07:380
47299673,58cyclictest0-21swapper/007:06:570
47299673,58cyclictest0-21swapper/007:06:570
48099665,13cyclictest0-21swapper/207:16:342
48099664,14cyclictest0-21swapper/208:06:522
48099664,13cyclictest0-21swapper/209:02:452
477996640,12cyclictest0-21swapper/107:13:551
472996643,8cyclictest4220-21kworker/0:208:27:390
472996643,8cyclictest4220-21kworker/0:208:27:390
472996638,22cyclictest20884-21latency_hist06:42:310
472996638,13cyclictest0-21swapper/008:12:520
472996636,12cyclictest0-21swapper/009:32:580
472996634,12cyclictest0-21swapper/007:29:210
47299663,57cyclictest0-21swapper/009:51:320
248599660,6rtkit-daemon0-21swapper/206:19:133
484996538,12cyclictest0-21swapper/309:38:063
484996538,12cyclictest0-21swapper/309:38:063
48499653,44cyclictest23609-21cat09:12:253
48099654,16cyclictest0-21swapper/209:01:172
48099653,15cyclictest0-21swapper/208:41:292
477996541,8cyclictest8727-21tail08:47:591
477996539,12cyclictest0-21swapper/108:36:521
47799653,56cyclictest0-21swapper/109:06:421
472996538,13cyclictest0-21swapper/008:34:540
472996537,13cyclictest0-21swapper/005:07:480
472996536,12cyclictest0-21swapper/008:17:550
472996534,13cyclictest0-21swapper/007:13:210
47299653,56cyclictest18582-21cpu09:52:330
47299653,56cyclictest0-21swapper/007:50:180
47299652,57cyclictest0-21swapper/005:52:430
48499643,43cyclictest16856-21cat09:02:253
48099645,15cyclictest0-21swapper/206:12:532
48099645,14cyclictest0-21swapper/207:23:372
48099644,13cyclictest0-21swapper/209:18:012
480996412,27cyclictest0-21swapper/209:12:422
47799645,53cyclictest0-21swapper/108:43:401
47799645,52cyclictest0-21swapper/107:22:471
472996441,8cyclictest4747-21sshd06:07:450
472996439,10cyclictest0-21swapper/005:42:340
472996439,10cyclictest0-21swapper/005:42:340
47299643,55cyclictest0-21swapper/010:06:160
47299643,55cyclictest0-21swapper/009:11:050
47299643,54cyclictest0-21swapper/009:46:420
47299643,54cyclictest0-21swapper/009:46:420
47299642,56cyclictest0-21swapper/008:10:500
48499634,52cyclictest25677-21diskmemload07:51:563
48099635,52cyclictest0-21swapper/208:27:382
48099635,52cyclictest0-21swapper/208:27:382
48099635,15cyclictest0-21swapper/207:37:432
48099635,12cyclictest0-21swapper/210:09:432
48099633,38cyclictest12157-21df_abs09:42:392
48099633,38cyclictest12157-21df_abs09:42:392
48099633,21cyclictest0-21swapper/208:19:412
477996344,13cyclictest0-21swapper/108:05:571
477996340,11cyclictest0-21swapper/107:48:021
477996338,11cyclictest0-21swapper/106:52:491
47799633,54cyclictest0-21swapper/109:32:441
47299634,52cyclictest0-21swapper/006:02:530
472996338,12cyclictest0-21swapper/006:59:110
472996334,13cyclictest0-21swapper/007:42:460
472996334,13cyclictest0-21swapper/007:42:460
47299633,54cyclictest0-21swapper/009:18:520
47299633,54cyclictest0-21swapper/009:13:120
47299633,54cyclictest0-21swapper/009:01:080
47299633,53cyclictest0-21swapper/006:12:460
47299633,51cyclictest23053-21ssh08:22:440
290502633,52sleep30-21swapper/310:07:393
202212633,52sleep30-21swapper/307:30:413
48499624,50cyclictest0-21swapper/308:27:273
48499623,52cyclictest32665-21cpu08:37:393
48499623,52cyclictest15194-21munin-node05:23:003
48499623,39cyclictest3194-21cat04:57:353
48499623,39cyclictest3194-21cat04:57:353
484996223,25cyclictest361ktimersoftd/308:52:533
48099625,14cyclictest0-21swapper/210:05:212
477996244,12cyclictest0-21swapper/108:11:051
477996243,12cyclictest0-21swapper/106:18:031
472996240,10cyclictest0-21swapper/005:48:020
472996238,10cyclictest0-21swapper/009:27:360
472996237,11cyclictest18186-21sort05:27:500
472996235,22cyclictest0-21swapper/005:06:520
47299623,53cyclictest0-21swapper/009:24:280
47299622,54cyclictest0-21swapper/008:53:090
48499614,51cyclictest25677-21diskmemload09:03:193
48499614,50cyclictest25677-21diskmemload07:44:313
48499614,50cyclictest25677-21diskmemload07:44:313
48499614,50cyclictest21796-21rm08:21:233
484996137,8cyclictest12692-21ssh07:18:033
48499613,50cyclictest8876-21ssh08:02:333
48099615,16cyclictest0-21swapper/209:57:372
48099615,15cyclictest0-21swapper/207:58:012
48099614,13cyclictest0-21swapper/209:52:362
48099612,25cyclictest0-21swapper/208:47:492
477996144,12cyclictest0-21swapper/108:30:151
477996144,12cyclictest0-21swapper/108:30:151
477996144,11cyclictest0-21swapper/108:14:201
47299612,53cyclictest0-21swapper/008:39:390
47299612,53cyclictest0-21swapper/006:22:530
47299612,53cyclictest0-21swapper/006:22:530
48499604,48cyclictest25677-21diskmemload08:08:433
484996039,7cyclictest11742-21kworker/3:109:47:363
48499603,51cyclictest25677-21diskmemload09:16:543
48499603,50cyclictest11641-21munin-node09:42:363
48499603,50cyclictest11641-21munin-node09:42:363
48099605,31cyclictest0-21swapper/205:37:332
48099605,15cyclictest0-21swapper/207:42:492
48099605,15cyclictest0-21swapper/207:42:492
48099605,15cyclictest0-21swapper/206:55:022
48099605,14cyclictest0-21swapper/206:07:572
48099605,13cyclictest0-21swapper/206:37:592
48099605,12cyclictest3801-21timerandwakeup07:52:592
48099604,15cyclictest0-21swapper/207:17:422
48099604,14cyclictest0-21swapper/208:32:482
48099604,13cyclictest0-21swapper/209:32:372
48099604,13cyclictest0-21swapper/209:23:042
48099604,13cyclictest0-21swapper/205:37:522
48099604,13cyclictest0-21swapper/205:37:522
48099603,41cyclictest0-21swapper/207:00:192
47799607,46cyclictest0-21swapper/108:20:101
47799604,49cyclictest0-21swapper/110:03:371
47799604,49cyclictest0-21swapper/107:37:441
477996037,10cyclictest9330-21iostat09:37:441
477996037,10cyclictest9330-21iostat09:37:441
47799603,50cyclictest0-21swapper/109:12:401
47799603,13cyclictest0-21swapper/108:02:281
472996035,12cyclictest0-21swapper/010:01:110
472996034,13cyclictest0-21swapper/007:33:420
47299603,51cyclictest0-21swapper/008:47:300
48499595,47cyclictest0-21swapper/309:37:173
48499594,48cyclictest9715-21ssh08:51:173
48499594,48cyclictest2611-21iostat_ios09:27:473
484995938,8cyclictest32416-21diskstats10:12:393
484995938,8cyclictest22047-21iostat_ios07:32:503
48499593,49cyclictest26803-21irqstats08:27:483
48499593,49cyclictest26803-21irqstats08:27:483
48099595,15cyclictest0-21swapper/209:28:582
48099595,14cyclictest1419-21runrttasks06:03:172
48099594,17cyclictest0-21swapper/207:05:102
48099594,17cyclictest0-21swapper/207:05:102
48099594,15cyclictest0-21swapper/208:13:442
48099594,12cyclictest10181-21yum-updatesd-he09:38:142
48099594,12cyclictest10181-21yum-updatesd-he09:38:142
480995925,12cyclictest0-21swapper/207:47:392
47799593,51cyclictest0-21swapper/107:07:141
47799593,51cyclictest0-21swapper/107:07:141
47799593,51cyclictest0-21swapper/106:02:591
47799593,49cyclictest0-21swapper/105:07:481
47799593,13cyclictest0-21swapper/107:09:371
47299593,50cyclictest0-21swapper/009:07:250
47299593,50cyclictest0-21swapper/005:57:590
47299592,50cyclictest0-21swapper/005:22:450
48499585,47cyclictest25677-21diskmemload06:56:423
48499584,48cyclictest25677-21diskmemload07:23:413
48499584,47cyclictest400-21ssh07:02:403
48499584,47cyclictest400-21ssh07:02:403
48499584,47cyclictest29125-21telnet08:32:363
48499584,47cyclictest25677-21diskmemload08:00:423
484995836,8cyclictest31504-21ssh09:22:453
484995835,9cyclictest26336-21ssh07:38:243
484995832,10cyclictest25111-21aten_r1power_cu10:02:323
48099585,14cyclictest0-21swapper/208:22:462
48099584,30cyclictest0-21swapper/205:52:532
48099584,18cyclictest0-21swapper/210:17:482
48099584,15cyclictest0-21swapper/207:10:092
48099584,14cyclictest0-21swapper/205:48:062
48099584,13cyclictest0-21swapper/207:27:452
47799585,47cyclictest0-21swapper/110:09:581
47799584,48cyclictest0-21swapper/109:26:291
47799584,14cyclictest0-21swapper/105:47:591
47299583,49cyclictest0-21swapper/005:42:490
68172570,8sleep348499cyclictest07:11:043
484995736,10cyclictest0-21swapper/310:17:323
484995730,12cyclictest0-21swapper/305:37:343
48499573,48cyclictest18094-21kworker/3:209:57:213
48499573,47cyclictest23383-21irqstats05:37:553
48499573,47cyclictest23383-21irqstats05:37:553
48499573,47cyclictest21724-21rm09:57:273
48499572,48cyclictest10423-21munin-node05:12:473
48099575,29cyclictest0-21swapper/210:12:422
48099575,13cyclictest0-21swapper/205:17:522
48099574,14cyclictest0-21swapper/208:52:382
480995721,11cyclictest25677-21diskmemload07:32:542
47799575,48cyclictest0-21swapper/109:11:431
47799575,45cyclictest0-21swapper/106:37:441
47799575,12cyclictest0-21swapper/105:36:471
47799573,17cyclictest0-21swapper/109:27:531
47299575,42cyclictest1460-21fschecks_time04:52:510
47299575,42cyclictest1460-21fschecks_time04:52:510
48499563,46cyclictest3721-21stty08:42:383
48499563,46cyclictest31919-21munin-node05:57:453
48499563,46cyclictest10156-21ssh07:15:533
480995642,8cyclictest8342-21cpuspeed_turbos05:07:482
48099564,29cyclictest0-21swapper/205:02:442
480995623,10cyclictest13951-21munin-node06:27:592
480995621,13cyclictest0-21swapper/205:12:532
480995621,12cyclictest0-21swapper/208:47:162
480995619,14cyclictest0-21swapper/204:52:542
480995619,14cyclictest0-21swapper/204:52:542
47799565,30cyclictest0-21swapper/109:42:391
47799565,30cyclictest0-21swapper/109:42:391
47799564,47cyclictest0-21swapper/109:47:261
47799564,46cyclictest0-21swapper/108:54:011
47799564,30cyclictest0-21swapper/108:57:401
47799562,13cyclictest0-21swapper/107:34:151
472995632,12cyclictest0-21swapper/006:45:150
47299563,48cyclictest0-21swapper/005:17:460
47299563,47cyclictest0-21swapper/006:17:520
484995535,8cyclictest1287-21snmpd06:41:553
48499553,46cyclictest4411-21munin-node06:08:013
48099555,27cyclictest0-21swapper/204:58:072
48099554,28cyclictest0-21swapper/206:37:312
48099554,14cyclictest0-21swapper/205:22:442
480995521,12cyclictest0-21swapper/206:47:572
47799552,13cyclictest0-21swapper/105:17:581
47299553,46cyclictest0-21swapper/005:37:340
48499545,42cyclictest13385-21diskstats05:17:503
484995442,7cyclictest8573-21df_abs05:07:493
484995433,10cyclictest0-21swapper/306:17:313
48499543,45cyclictest29939-21ssh09:21:273
48499543,44cyclictest2381-21expr06:02:463
48499543,44cyclictest17546-21expr06:32:543
48099545,27cyclictest0-21swapper/206:42:402
48099545,26cyclictest0-21swapper/205:27:452
48099544,27cyclictest0-21swapper/205:42:452
47799544,45cyclictest0-21swapper/104:57:441
47799543,28cyclictest0-21swapper/105:53:011
472995432,11cyclictest0-21swapper/005:12:450
472995430,13cyclictest0-21swapper/004:58:020
47299543,45cyclictest41ktimersoftd/006:28:020
48499533,44cyclictest22568-21python06:43:013
48099534,27cyclictest0-21swapper/206:21:512
47799535,40cyclictest0-21swapper/106:27:481
47799533,28cyclictest0-21swapper/105:38:221
47799533,28cyclictest0-21swapper/105:38:221
47799533,28cyclictest0-21swapper/104:53:011
47799533,28cyclictest0-21swapper/104:53:011
47299533,44cyclictest41ktimersoftd/006:32:510
48499523,42cyclictest5743-21telnet05:02:453
48499522,43cyclictest29003-21sshd05:48:463
47799524,42cyclictest917-21python05:58:031
484995131,8cyclictest3388-21telnet04:57:453
48499513,41cyclictest14045-21telnet06:27:433
484995126,11cyclictest0-21swapper/306:49:403
484995116,16cyclictest0-21swapper/305:52:433
47799514,25cyclictest0-21swapper/105:02:461
47799513,9cyclictest19033-21taskset05:28:031
477995123,12cyclictest0-21swapper/106:11:501
477995121,12cyclictest0-21swapper/106:26:521
477995121,12cyclictest0-21swapper/106:26:521
48099505,24cyclictest0-21swapper/205:57:432
47799503,42cyclictest0-21swapper/105:22:531
47799502,8cyclictest12-21rcu_preempt05:42:531
47799485,38cyclictest0-21swapper/106:12:421
47799484,26cyclictest0-21swapper/106:52:301
477994820,12cyclictest0-21swapper/106:36:541
47799475,13cyclictest0-21swapper/105:12:551
194032472,9sleep30-21swapper/305:28:183
47799462,28cyclictest0-21swapper/104:52:351
484994523,10cyclictest0-21swapper/305:42:483
484994316,12cyclictest0-21swapper/304:52:363
305512434,29sleep20-21swapper/204:47:362
327472424,32sleep00-21swapper/004:50:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional