You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 14:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Mon May 18, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113499984,15cyclictest0-21swapper/009:36:330
113499984,12cyclictest0-21swapper/009:38:210
113499974,13cyclictest0-21swapper/009:57:270
113499964,68cyclictest0-21swapper/008:43:120
113499964,13cyclictest0-21swapper/007:51:470
113499954,76cyclictest0-21swapper/010:01:170
113499954,76cyclictest0-21swapper/010:01:170
113499954,75cyclictest0-21swapper/010:03:200
113499944,72cyclictest0-21swapper/008:03:520
113499944,69cyclictest0-21swapper/007:32:460
113499944,13cyclictest0-21swapper/007:33:280
248599930,5rtkit-daemon2484-21rtkit-daemon07:13:192
248599930,5rtkit-daemon2484-21rtkit-daemon07:13:192
113499939,12cyclictest0-21swapper/007:38:210
113499934,69cyclictest0-21swapper/005:04:080
113499934,69cyclictest0-21swapper/005:04:080
113499934,64cyclictest0-21swapper/009:48:280
113499933,19cyclictest0-21swapper/008:21:120
113499924,66cyclictest0-21swapper/007:47:240
113499924,13cyclictest0-21swapper/008:28:260
248599910,5rtkit-daemon3569-21cut07:43:181
113499914,65cyclictest0-21swapper/007:05:140
113499914,13cyclictest0-21swapper/008:08:270
113499914,12cyclictest0-21swapper/009:23:110
113499904,71cyclictest0-21swapper/008:58:270
113499904,68cyclictest0-21swapper/009:03:220
113499904,68cyclictest0-21swapper/006:55:570
113499903,68cyclictest0-21swapper/007:17:320
113499903,68cyclictest0-21swapper/007:17:320
113499894,64cyclictest0-21swapper/008:40:090
113499889,10cyclictest0-21swapper/006:44:070
113499884,68cyclictest0-21swapper/007:23:180
113499884,66cyclictest0-21swapper/008:33:340
113499884,22cyclictest26311-21diskmemload06:48:360
113499884,13cyclictest0-21swapper/008:13:190
113499884,13cyclictest0-21swapper/007:53:270
113499884,13cyclictest0-21swapper/007:53:270
113499874,68cyclictest0-21swapper/005:28:320
113499874,13cyclictest0-21swapper/010:12:390
113499873,68cyclictest0-21swapper/009:28:280
113499873,21cyclictest0-21swapper/005:35:570
1134998718,50cyclictest0-21swapper/006:38:320
1134998716,53cyclictest0-21swapper/007:11:230
113499869,10cyclictest0-21swapper/008:01:230
113499864,64cyclictest0-21swapper/009:12:250
113499864,12cyclictest0-21swapper/008:53:160
113499863,23cyclictest30194-21munin-node08:23:330
1134998618,50cyclictest0-21swapper/006:03:270
1134998610,60cyclictest0-21swapper/009:21:030
248599850,7rtkit-daemon0-21swapper/309:35:363
113499854,63cyclictest0-21swapper/007:20:070
113499854,13cyclictest0-21swapper/008:50:530
113499853,12cyclictest0-21swapper/006:58:390
113499845,65cyclictest0-21swapper/009:44:080
113499844,16cyclictest0-21swapper/006:23:310
1134998437,41cyclictest1419-21runrttasks05:48:160
1134998437,41cyclictest1419-21runrttasks05:48:160
1134998414,8cyclictest12197-21munin-node06:13:320
113499834,61cyclictest0-21swapper/006:18:370
113499833,64cyclictest0-21swapper/009:13:030
113499833,64cyclictest0-21swapper/009:13:030
113499824,17cyclictest0-21swapper/005:18:250
113499823,55cyclictest0-21swapper/005:58:210
113499814,68cyclictest0-21swapper/005:23:210
113499804,61cyclictest0-21swapper/005:38:350
113499804,13cyclictest1132-21awk04:43:100
113499794,13cyclictest0-21swapper/004:48:360
113499793,20cyclictest8660-21munin-node04:58:400
113499793,20cyclictest0-21swapper/006:28:200
1134997922,50cyclictest2977-21cpuspeed_turbos05:53:230
113499784,67cyclictest0-21swapper/005:12:570
113499784,65cyclictest0-21swapper/006:08:210
248599770,4rtkit-daemon2484-21rtkit-daemon06:22:292
1134997520,48cyclictest1463-21aten2.4-expect04:43:240
113499744,12cyclictest0-21swapper/005:43:430
113499743,19cyclictest15854-21aten2.4-expect05:13:210
1134997425,42cyclictest22674-21wc06:33:270
1134997425,42cyclictest22674-21wc06:33:270
1134997316,8cyclictest1419-21runrttasks04:57:320
248599710,4rtkit-daemon37-21ksoftirqd/310:08:053
248599680,5rtkit-daemon2484-21rtkit-daemon07:02:353
248599660,6rtkit-daemon0-21swapper/209:36:592
1138996615,30cyclictest26924-21head08:18:153
1138996512,34cyclictest0-21swapper/309:03:263
248599640,5rtkit-daemon20793-21ssh07:19:343
1138996428,29cyclictest782-21ssh08:27:493
1138996420,37cyclictest6776-21ssh07:48:163
113799643,36cyclictest0-21swapper/208:50:282
248599630,8rtkit-daemon0-21swapper/108:13:101
248599630,6rtkit-daemon0-21swapper/208:38:093
248599630,5rtkit-daemon31810-21ssh07:37:483
248599620,9rtkit-daemon0-21swapper/107:55:331
248599620,9rtkit-daemon0-21swapper/107:55:331
248599620,8rtkit-daemon0-21swapper/108:52:451
248599620,5rtkit-daemon22013-21ssh07:23:113
248599620,4rtkit-daemon2484-21rtkit-daemon08:12:321
248599620,3rtkit-daemon0-21swapper/109:17:371
248599620,3rtkit-daemon0-21swapper/109:17:371
248599620,3rtkit-daemon0-21swapper/108:54:381
248599620,3rtkit-daemon0-21swapper/107:42:561
248599620,13rtkit-daemon2484-21rtkit-daemon05:29:233
1138996242,13cyclictest604-21sed07:38:253
248599610,8rtkit-daemon0-21swapper/108:22:171
248599610,6rtkit-daemon0-21swapper/108:42:461
248599610,4rtkit-daemon16227-21ssh09:38:063
248599610,4rtkit-daemon0-21swapper/108:05:171
248599610,4rtkit-daemon0-21swapper/107:51:551
248599610,3rtkit-daemon0-21swapper/108:36:541
248599610,2rtkit-daemon0-21swapper/109:28:591
248599600,7rtkit-daemon0-21swapper/109:01:381
248599600,4rtkit-daemon0-21swapper/109:09:301
1138996042,11cyclictest2733-21processes08:28:363
1138996041,12cyclictest9397-21fschecks_time04:58:293
1138996041,12cyclictest6372-21ls08:33:353
248599590,7rtkit-daemon0-21swapper/305:56:453
248599590,4rtkit-daemon10751-21idleruntime06:08:293
1138995943,10cyclictest1011-21ssh06:53:063
1138995941,13cyclictest19896-21cpuspeed09:43:133
1138995941,12cyclictest16010-21fgrep06:18:373
113899594,34cyclictest0-21swapper/308:08:233
1138995914,37cyclictest12082-21fschecks_count08:43:193
113799594,13cyclictest0-21swapper/206:08:272
1138995840,11cyclictest4784-21http_loadtime04:48:313
1138995838,12cyclictest6117-21munin-node09:23:283
113899583,47cyclictest0-21swapper/307:06:163
113899583,35cyclictest0-21swapper/307:08:353
113899582,48cyclictest0-21swapper/307:59:593
56282574,11sleep20-21swapper/207:45:272
248599570,7rtkit-daemon0-21swapper/206:39:513
248599570,7rtkit-daemon0-21swapper/206:04:523
248599570,7rtkit-daemon0-21swapper/205:14:463
248599570,6rtkit-daemon0-21swapper/204:44:033
1138995739,11cyclictest26171-21fw_packets05:33:283
1138995734,16cyclictest0-21swapper/310:03:163
1137995738,10cyclictest4383-21unixbench_multi05:53:422
113799573,35cyclictest2657-21ssh08:28:342
248599560,7rtkit-daemon0-21swapper/210:00:133
248599560,7rtkit-daemon0-21swapper/210:00:133
248599560,7rtkit-daemon0-21swapper/206:30:513
248599560,7rtkit-daemon0-21swapper/205:59:223
248599560,6rtkit-daemon0-21swapper/206:43:433
113899563,45cyclictest0-21swapper/307:17:393
113899563,45cyclictest0-21swapper/307:17:393
1138995628,21cyclictest0-21swapper/309:29:173
1138995625,11cyclictest121850irq/46-eth008:53:163
113899562,36cyclictest0-21swapper/308:58:373
1138995616,21cyclictest0-21swapper/307:30:523
113799564,45cyclictest0-21swapper/208:18:352
113799564,35cyclictest0-21swapper/207:30:502
1137995620,14cyclictest0-21swapper/208:33:152
113699563,10cyclictest0-21swapper/107:20:041
47892554,44sleep14798-21entropy10:08:171
248599550,7rtkit-daemon0-21swapper/206:34:133
248599550,7rtkit-daemon0-21swapper/206:34:133
248599550,6rtkit-daemon0-21swapper/205:05:023
248599550,6rtkit-daemon0-21swapper/205:05:023
113899554,44cyclictest0-21swapper/308:48:203
113899553,34cyclictest0-21swapper/306:53:213
113799555,42cyclictest1419-21runrttasks09:28:162
113799554,44cyclictest0-21swapper/208:38:262
113799553,43cyclictest0-21swapper/207:24:332
113799553,35cyclictest0-21swapper/208:57:592
1137995519,9cyclictest1419-21runrttasks09:23:312
113699558,38cyclictest0-21swapper/107:29:091
113699556,13cyclictest1558-21gltestperf10:03:181
113699554,43cyclictest5677-21gltestperf06:58:241
1136995536,13cyclictest0-21swapper/108:28:391
322292543,44sleep10-21swapper/108:24:081
163592543,44sleep10-21swapper/107:13:291
163592543,44sleep10-21swapper/107:13:291
113899543,33cyclictest0-21swapper/308:05:143
1138995414,20cyclictest0-21swapper/307:57:323
1138995414,20cyclictest0-21swapper/307:57:323
113899541,37cyclictest1017-21unixbench_singl09:13:323
113899541,37cyclictest1017-21unixbench_singl09:13:323
113799549,27cyclictest0-21swapper/207:38:042
113799544,34cyclictest0-21swapper/209:46:302
1136995433,14cyclictest0-21swapper/107:08:171
1136995427,13cyclictest0-21swapper/107:03:191
41752533,42sleep10-21swapper/106:56:521
248599530,6rtkit-daemon2484-21rtkit-daemon05:43:303
113899534,31cyclictest27710-21ntp_states09:53:293
1138995335,11cyclictest21447-21gltestperf05:23:293
113899533,42cyclictest0-21swapper/305:13:103
113899533,41cyclictest0-21swapper/306:18:083
113899533,29cyclictest30313-21ssh09:09:113
113899532,45cyclictest0-21swapper/309:18:223
113799535,13cyclictest0-21swapper/209:00:562
113799534,44cyclictest0-21swapper/208:12:182
113799534,27cyclictest28592-21cpuspeed_turbos09:08:152
1137995337,11cyclictest7514-21grep07:48:242
1137995336,12cyclictest0-21swapper/209:41:032
1137995321,13cyclictest0-21swapper/207:03:162
1137995316,23cyclictest1370-21munin-node04:43:412
113699535,15cyclictest0-21swapper/109:43:241
113699534,41cyclictest0-21swapper/109:23:201
113699534,31cyclictest0-21swapper/105:53:351
113699534,30cyclictest0-21swapper/107:38:041
1136995336,10cyclictest27368-21runrttasks09:05:441
1136995333,14cyclictest0-21swapper/108:43:241
1136995332,13cyclictest4370-21timerandwakeup09:18:321
297752523,9sleep10-21swapper/105:41:151
248599520,5rtkit-daemon2484-21rtkit-daemon09:48:133
248599520,4rtkit-daemon2484-21rtkit-daemon06:24:063
248599520,4rtkit-daemon2484-21rtkit-daemon04:54:253
213992523,41sleep10-21swapper/106:31:411
1138995234,12cyclictest23767-21cpuspeed_turbos08:13:173
113899523,41cyclictest0-21swapper/305:53:093
113899523,41cyclictest0-21swapper/305:53:093
113899523,30cyclictest0-21swapper/305:22:043
1138995214,21cyclictest4557-21netstat07:43:313
113799524,41cyclictest0-21swapper/207:08:202
113799524,10cyclictest2418-21timerandwakeup10:03:312
1137995236,9cyclictest5072-21grep10:08:192
1137995235,11cyclictest27221-21tail09:53:212
113799523,44cyclictest0-21swapper/209:59:272
113799523,44cyclictest0-21swapper/209:59:272
113799523,27cyclictest0-21swapper/206:03:202
1137995227,10cyclictest24632-21sort08:13:272
1137995214,23cyclictest2589-21ssh07:41:412
113699525,15cyclictest0-21swapper/107:27:151
113699524,42cyclictest0-21swapper/109:42:061
1136995232,14cyclictest0-21swapper/106:43:361
1136995215,11cyclictest23802-21cut09:48:181
105882523,43sleep10-21swapper/105:00:241
236192513,10sleep10-21swapper/106:34:151
236192513,10sleep10-21swapper/106:34:151
189492512,9sleep20-21swapper/208:04:542
113799514,40cyclictest0-21swapper/208:43:242
113799514,29cyclictest0-21swapper/208:25:152
113799514,28cyclictest0-21swapper/204:58:332
113799514,20cyclictest31656-21aten2.4-expect09:13:092
113799514,20cyclictest31656-21aten2.4-expect09:13:092
1137995132,10cyclictest25366-21cut06:38:322
1137995118,13cyclictest0-21swapper/207:58:152
1137995114,28cyclictest1108-21taskset06:53:072
113699515,28cyclictest0-21swapper/105:18:401
113699514,29cyclictest0-21swapper/107:58:171
113699514,29cyclictest0-21swapper/105:13:271
113699514,28cyclictest0-21swapper/104:43:111
1136995122,22cyclictest12243-21aten_r1power_en06:13:181
1136995118,12cyclictest13562-21ssh09:33:181
1136995114,30cyclictest24658-21unixbench-2d05:28:411
248599500,4rtkit-daemon2484-21rtkit-daemon05:39:533
22852503,12sleep10-21swapper/105:52:031
22852503,12sleep10-21swapper/105:52:031
165622502,42sleep10-21swapper/106:20:531
113899504,40cyclictest0-21swapper/304:43:113
113799504,28cyclictest0-21swapper/207:18:202
113799504,28cyclictest0-21swapper/205:58:312
113799504,27cyclictest0-21swapper/209:18:212
1137995032,11cyclictest22286-21df06:33:222
1137995032,11cyclictest22286-21df06:33:222
113799503,40cyclictest31139-21latency06:48:302
113799503,39cyclictest0-21swapper/209:03:082
113699506,26cyclictest0-21swapper/106:41:071
113699506,25cyclictest27442-21irqstats09:53:251
113699505,28cyclictest0-21swapper/105:03:261
113699505,28cyclictest0-21swapper/105:03:261
113699504,28cyclictest0-21swapper/105:58:411
1136995034,11cyclictest0-21swapper/109:58:211
1136995034,11cyclictest0-21swapper/109:58:211
177652492,9sleep20-21swapper/205:15:282
113799496,26cyclictest0-21swapper/205:08:252
113799494,27cyclictest0-21swapper/209:48:272
113799494,27cyclictest0-21swapper/207:53:262
113799494,27cyclictest0-21swapper/207:53:262
113799494,27cyclictest0-21swapper/206:43:382
1137994934,9cyclictest7141-21sed04:53:302
113799493,28cyclictest0-21swapper/206:58:202
1137994920,12cyclictest0-21swapper/205:33:342
1137994919,12cyclictest0-21swapper/205:43:272
113699496,27cyclictest0-21swapper/104:43:451
113699494,29cyclictest0-21swapper/106:51:081
83702483,38sleep10-21swapper/104:57:331
113799485,26cyclictest0-21swapper/205:23:412
113799484,36cyclictest0-21swapper/205:48:262
113799484,36cyclictest0-21swapper/205:48:262
113799484,25cyclictest0-21swapper/205:03:302
113799484,25cyclictest0-21swapper/205:03:302
113799483,27cyclictest0-21swapper/206:28:072
1137994820,10cyclictest4213-21tr04:48:252
113699484,27cyclictest0-21swapper/105:43:341
1136994818,13cyclictest0-21swapper/106:23:371
1136994817,13cyclictest0-21swapper/106:03:371
1136994816,15cyclictest0-21swapper/106:11:021
113799474,26cyclictest0-21swapper/205:40:582
113799474,26cyclictest0-21swapper/205:28:272
113799473,38cyclictest0-21swapper/206:31:502
113699474,27cyclictest0-21swapper/104:53:111
113699474,26cyclictest0-21swapper/105:13:081
113699464,13cyclictest0-21swapper/105:23:441
1136994628,11cyclictest26218-21grep05:33:281
113799454,35cyclictest0-21swapper/206:13:342
113799454,34cyclictest0-21swapper/205:18:382
113799454,33cyclictest0-21swapper/204:43:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional