You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 15:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Mar 14, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991010,6rtkit-daemon17926-21tail11:09:341
1392799964,85cyclictest0-21swapper/008:49:230
248599950,6rtkit-daemon0-21swapper/108:49:551
248599950,5rtkit-daemon18-21rcuc/111:02:351
248599950,5rtkit-daemon18-21rcuc/111:02:351
1393399955,72cyclictest0-21swapper/308:00:263
1393399954,70cyclictest1419-21runrttasks08:19:343
1393399944,70cyclictest0-21swapper/311:04:003
1393399944,70cyclictest0-21swapper/311:04:003
1393399944,67cyclictest0-21swapper/310:34:273
1392799944,83cyclictest0-21swapper/007:59:410
1393399935,19cyclictest22381-21munin-node08:04:383
1393399934,66cyclictest0-21swapper/306:19:123
1393399934,65cyclictest0-21swapper/309:49:063
13933999320,49cyclictest0-21swapper/308:14:273
1392799934,82cyclictest0-21swapper/009:14:170
1393399925,64cyclictest0-21swapper/308:59:173
1393399925,64cyclictest0-21swapper/308:59:173
13933999213,53cyclictest0-21swapper/308:27:303
1392799924,81cyclictest0-21swapper/009:23:100
1392799923,81cyclictest9180-21cpuspeed_turbos08:34:200
1392799923,24cyclictest0-21swapper/010:19:150
1392799923,24cyclictest0-21swapper/010:19:150
1392799923,18cyclictest0-21swapper/008:58:260
13927999225,60cyclictest0-21swapper/010:49:560
13933999118,9cyclictest4202-21cut09:14:213
1392799914,80cyclictest0-21swapper/010:40:310
1392799914,79cyclictest0-21swapper/007:49:220
1392799913,80cyclictest32339-21ssh08:19:320
1393399905,65cyclictest0-21swapper/309:48:583
1393399905,65cyclictest0-21swapper/309:48:583
1393399904,60cyclictest0-21swapper/306:29:433
13933999020,47cyclictest0-21swapper/308:11:533
1392799904,78cyclictest0-21swapper/008:29:060
1392799903,9cyclictest0-21swapper/011:12:130
1393399894,63cyclictest0-21swapper/310:56:133
1393399894,63cyclictest0-21swapper/309:20:453
1393399894,14cyclictest0-21swapper/310:13:563
13933998920,46cyclictest0-21swapper/308:32:063
1392799893,79cyclictest6666-21chrt10:04:480
1392799893,79cyclictest24311-21ssh08:09:200
1392799893,79cyclictest0-21swapper/007:54:210
13927998927,53cyclictest4544-21grep06:29:360
13927998919,8cyclictest22182-21ssh08:04:340
1393399885,24cyclictest0-21swapper/311:05:513
1393399884,63cyclictest0-21swapper/309:07:213
1393399884,63cyclictest0-21swapper/309:07:213
1393399884,62cyclictest0-21swapper/310:24:133
1393399884,62cyclictest0-21swapper/310:24:133
1393399884,14cyclictest0-21swapper/310:52:203
1393399884,14cyclictest0-21swapper/310:31:383
13933998813,13cyclictest0-21swapper/308:49:313
1392799884,77cyclictest0-21swapper/009:08:010
1392799884,77cyclictest0-21swapper/009:08:010
1392799884,76cyclictest0-21swapper/007:20:530
1392799884,10cyclictest0-21swapper/005:59:430
1392799883,78cyclictest0-21swapper/009:39:180
1392799883,78cyclictest0-21swapper/008:30:310
1392799883,77cyclictest19039-21ssh09:35:300
1393399878,17cyclictest27053-21kworker/3:010:39:133
1393399874,67cyclictest0-21swapper/309:39:053
1393399874,65cyclictest0-21swapper/305:44:333
1393399874,63cyclictest0-21swapper/311:14:003
1393399874,14cyclictest0-21swapper/308:42:523
13933998719,53cyclictest0-21swapper/309:32:513
1392799874,76cyclictest0-21swapper/010:54:480
1392799874,76cyclictest0-21swapper/009:29:240
1392799873,77cyclictest0-21swapper/009:24:380
13927998717,11cyclictest0-21swapper/009:57:150
1393399865,60cyclictest0-21swapper/309:54:513
1393399865,59cyclictest0-21swapper/309:12:123
1393399864,66cyclictest0-21swapper/310:48:083
1393399864,64cyclictest0-21swapper/310:19:233
1393399864,64cyclictest0-21swapper/310:19:233
1393399864,59cyclictest0-21swapper/308:54:113
1393399863,58cyclictest0-21swapper/306:49:233
1392799865,73cyclictest0-21swapper/008:44:170
1392799864,74cyclictest0-21swapper/009:52:330
1392799863,77cyclictest32597-21idleruntime10:44:210
1392799863,77cyclictest24709-21wc09:44:250
1392799863,77cyclictest24709-21wc09:44:250
1392799863,75cyclictest0-21swapper/010:24:220
1392799863,75cyclictest0-21swapper/010:24:220
1392799863,74cyclictest0-21swapper/009:03:310
1392799863,74cyclictest0-21swapper/009:03:310
1392799863,18cyclictest10252-21grep10:59:200
1392799863,18cyclictest10252-21grep10:59:200
1393399854,62cyclictest0-21swapper/309:34:383
1393399854,61cyclictest0-21swapper/306:59:293
1393399854,22cyclictest0-21swapper/309:59:303
13933998522,46cyclictest0-21swapper/309:25:393
1392799854,74cyclictest0-21swapper/011:06:250
1392799854,11cyclictest0-21swapper/010:16:100
1392799853,75cyclictest25911-21ssh10:34:240
1392799853,75cyclictest0-21swapper/010:32:160
1392799853,30cyclictest0-21swapper/008:15:210
1393399846,69cyclictest0-21swapper/306:39:323
1393399844,61cyclictest0-21swapper/307:44:273
1393399844,61cyclictest0-21swapper/307:44:273
1393399844,61cyclictest0-21swapper/307:09:223
1393399844,59cyclictest0-21swapper/310:15:033
1392799844,74cyclictest0-21swapper/009:59:180
1392799844,74cyclictest0-21swapper/006:14:300
1392799843,74cyclictest0-21swapper/009:11:360
1392799843,74cyclictest0-21swapper/006:34:210
1393399834,71cyclictest0-21swapper/308:34:233
1393399834,64cyclictest0-21swapper/307:33:233
1393399833,60cyclictest0-21swapper/308:44:173
1393399833,23cyclictest0-21swapper/307:55:513
1392799834,72cyclictest0-21swapper/007:09:390
1393399825,70cyclictest0-21swapper/305:49:253
1393399825,61cyclictest0-21swapper/310:08:203
1393399824,22cyclictest0-21swapper/307:04:233
1393399824,22cyclictest0-21swapper/307:04:233
1392799824,72cyclictest0-21swapper/008:41:380
1392799824,70cyclictest21079-21latency_hist05:59:120
13927998224,51cyclictest0-21swapper/010:09:170
13933998110,14cyclictest0-21swapper/307:49:413
1392799813,71cyclictest0-21swapper/007:45:320
1392799813,71cyclictest0-21swapper/007:45:320
1393399803,59cyclictest0-21swapper/305:54:313
13927998030,44cyclictest26438-21tr06:09:270
13927998021,8cyclictest1287-21snmpd06:57:590
1392799793,14cyclictest0-21swapper/006:19:420
1392799793,14cyclictest0-21swapper/006:19:420
13927997919,12cyclictest0-21swapper/007:29:400
1392799783,67cyclictest18476-21grep06:59:280
13933997721,49cyclictest10879-21grep06:44:233
13933997720,50cyclictest5349-21gltestperf07:39:283
13933997720,13cyclictest23696-21munin-node06:04:423
13927997721,8cyclictest1419-21runrttasks06:24:510
13927997718,8cyclictest24558-21sed06:04:300
1393399763,65cyclictest0-21swapper/306:24:373
13933997627,42cyclictest1676-21nscd07:19:093
13933997613,10cyclictest21650-21tr05:59:263
1392799764,12cyclictest0-21swapper/006:44:270
1392799764,12cyclictest0-21swapper/006:39:470
1392799763,13cyclictest0-21swapper/005:51:570
1393399755,13cyclictest0-21swapper/307:29:083
1393399754,21cyclictest0-21swapper/307:34:193
1393399753,37cyclictest1419-21runrttasks06:54:113
13933997526,42cyclictest26706-21fschecks_count06:09:303
13933997514,10cyclictest32607-21unixbench_singl06:19:443
13933997514,10cyclictest32607-21unixbench_singl06:19:443
1392799753,8cyclictest121850irq/46-eth007:14:280
1392799753,65cyclictest0-21swapper/007:24:270
1393399745,12cyclictest0-21swapper/307:19:203
1392799744,30cyclictest0-21swapper/005:44:230
13927997420,8cyclictest5186-21fschecks_time07:39:270
1393399735,61cyclictest0-21swapper/306:39:023
1392799736,12cyclictest0-21swapper/006:49:340
1392799734,23cyclictest0-21swapper/007:34:240
13927997322,7cyclictest21033-21if_err_eth007:04:310
13927997322,7cyclictest21033-21if_err_eth007:04:310
1393299694,57cyclictest0-21swapper/208:34:172
1393299694,57cyclictest0-21swapper/207:59:252
1393299694,56cyclictest0-21swapper/208:44:322
248599680,5rtkit-daemon2484-21rtkit-daemon08:04:422
248599680,2rtkit-daemon0-21swapper/209:38:082
1393299685,53cyclictest1509-21fschecks_time06:24:292
1393299684,57cyclictest0-21swapper/210:59:332
1393299684,57cyclictest0-21swapper/210:59:332
1393299684,56cyclictest0-21swapper/208:29:362
1393299684,56cyclictest0-21swapper/208:29:072
248599670,8rtkit-daemon0-21swapper/111:07:121
248599670,7rtkit-daemon0-21swapper/110:55:281
248599670,10rtkit-daemon0-21swapper/206:59:442
248599670,10rtkit-daemon0-21swapper/106:09:541
1393299674,52cyclictest30636-21ssh09:54:172
1393299674,27cyclictest0-21swapper/209:30:202
1393399665,13cyclictest0-21swapper/305:44:133
1393399665,13cyclictest0-21swapper/305:44:133
1393299664,40cyclictest0-21swapper/209:09:152
1393299664,39cyclictest0-21swapper/209:04:332
1393299664,39cyclictest0-21swapper/209:04:332
1393299664,38cyclictest0-21swapper/210:01:472
248599650,7rtkit-daemon0-21swapper/108:29:331
1393299655,51cyclictest0-21swapper/208:49:212
1393299654,53cyclictest0-21swapper/206:34:382
13932996522,26cyclictest25658-21munin-node08:59:222
13932996522,26cyclictest25658-21munin-node08:59:222
248599640,7rtkit-daemon0-21swapper/210:29:362
1393299644,53cyclictest0-21swapper/210:13:182
1393299644,53cyclictest0-21swapper/209:25:572
1393299643,52cyclictest0-21swapper/209:49:142
13932996415,26cyclictest11437-21munin-node10:14:342
13930996442,13cyclictest0-21swapper/105:59:301
248599630,9rtkit-daemon0-21swapper/210:46:352
248599630,11rtkit-daemon0-21swapper/210:35:062
248599630,11rtkit-daemon0-21swapper/206:21:082
248599630,11rtkit-daemon0-21swapper/206:21:082
1393299634,52cyclictest0-21swapper/209:14:332
1393299634,52cyclictest0-21swapper/207:29:402
1393299634,51cyclictest0-21swapper/207:54:412
1393099634,29cyclictest18216-21ssh09:34:321
248599620,9rtkit-daemon0-21swapper/206:32:002
248599620,7rtkit-daemon0-21swapper/207:25:212
248599620,11rtkit-daemon0-21swapper/210:08:372
248599620,11rtkit-daemon0-21swapper/208:16:192
248599620,11rtkit-daemon0-21swapper/207:49:272
248599620,11rtkit-daemon0-21swapper/206:57:292
248599620,11rtkit-daemon0-21swapper/206:45:522
248599620,10rtkit-daemon0-21swapper/210:43:502
248599620,10rtkit-daemon0-21swapper/209:22:312
248599620,10rtkit-daemon0-21swapper/208:23:412
248599620,10rtkit-daemon0-21swapper/207:40:502
248599620,10rtkit-daemon0-21swapper/207:35:052
248599620,10rtkit-daemon0-21swapper/206:42:002
1393299625,50cyclictest0-21swapper/210:49:282
1393299624,50cyclictest0-21swapper/208:54:202
13932996233,13cyclictest0-21swapper/208:09:122
1393299623,50cyclictest0-21swapper/209:44:232
1393299623,50cyclictest0-21swapper/209:44:232
1393299623,50cyclictest0-21swapper/207:09:102
13930996241,14cyclictest0-21swapper/107:39:211
248599610,9rtkit-daemon0-21swapper/207:04:142
248599610,8rtkit-daemon0-21swapper/210:28:062
248599610,8rtkit-daemon0-21swapper/210:28:062
248599610,8rtkit-daemon0-21swapper/209:39:532
248599610,10rtkit-daemon0-21swapper/207:20:062
1393299615,48cyclictest0-21swapper/211:05:452
1393299614,50cyclictest0-21swapper/210:55:352
13930996140,14cyclictest0-21swapper/110:14:031
248599600,10rtkit-daemon0-21swapper/210:19:062
248599600,10rtkit-daemon0-21swapper/210:19:062
1393299604,49cyclictest0-21swapper/211:12:282
13930996039,14cyclictest0-21swapper/107:53:561
1393299594,49cyclictest0-21swapper/208:39:222
13930995943,10cyclictest3602-21gltestperf10:49:181
13930995938,15cyclictest0-21swapper/108:04:101
13930995928,14cyclictest0-21swapper/109:51:111
13930995928,12cyclictest0-21swapper/109:27:241
166182583,47sleep20-21swapper/205:49:252
1393299584,38cyclictest0-21swapper/207:13:192
13930995841,11cyclictest0-21swapper/110:27:171
13930995841,11cyclictest0-21swapper/110:27:171
13930995840,12cyclictest0-21swapper/109:08:431
13930995840,12cyclictest0-21swapper/109:08:431
1393099584,47cyclictest0-21swapper/108:59:201
1393099584,47cyclictest0-21swapper/108:59:201
13930995836,15cyclictest0-21swapper/110:38:511
1393099583,49cyclictest0-21swapper/110:41:511
1393099583,49cyclictest0-21swapper/110:29:121
1393099583,49cyclictest0-21swapper/109:55:571
1393099583,48cyclictest0-21swapper/110:47:361
1393099583,48cyclictest0-21swapper/107:56:191
1393099583,27cyclictest0-21swapper/107:47:121
1393099583,27cyclictest0-21swapper/107:47:121
13930995823,11cyclictest3164-21irqstats08:24:281
1393299574,45cyclictest8238-21ssh07:44:352
1393299574,45cyclictest8238-21ssh07:44:352
13930995740,11cyclictest0-21swapper/109:39:281
13930995739,12cyclictest0-21swapper/109:19:341
1393099573,49cyclictest0-21swapper/108:43:311
1393099573,49cyclictest0-21swapper/108:19:051
1393099573,47cyclictest0-21swapper/110:16:551
1393099573,47cyclictest0-21swapper/110:03:161
1393099573,47cyclictest0-21swapper/109:29:151
13930995725,27cyclictest17367-21unixbench_multi08:44:371
13930995636,15cyclictest0-21swapper/110:21:351
13930995636,15cyclictest0-21swapper/110:21:351
1393099563,46cyclictest0-21swapper/108:10:001
1393299553,44cyclictest0-21swapper/206:06:062
1393299552,45cyclictest0-21swapper/205:46:592
1393099554,43cyclictest0-21swapper/109:44:261
1393099554,43cyclictest0-21swapper/109:44:261
1393099554,29cyclictest4727-21munin-node10:04:161
13930995536,12cyclictest0-21swapper/108:01:281
1393099552,47cyclictest0-21swapper/108:21:411
13930995513,23cyclictest0-21swapper/108:55:591
102462553,13sleep10-21swapper/106:43:501
1393099545,31cyclictest0-21swapper/105:44:451
1393099544,29cyclictest0-21swapper/108:34:411
1393099543,46cyclictest0-21swapper/109:10:281
3002533,10sleep10-21swapper/106:21:131
3002533,10sleep10-21swapper/106:21:131
1393299534,28cyclictest0-21swapper/205:59:292
1393299534,22cyclictest0-21swapper/207:14:252
1393099535,28cyclictest0-21swapper/106:54:101
1393099533,43cyclictest0-21swapper/109:14:151
13930995318,13cyclictest0-21swapper/106:29:331
28272523,11sleep10-21swapper/106:25:361
171112523,12sleep10-21swapper/106:54:461
1393299524,28cyclictest0-21swapper/206:49:262
1393099525,28cyclictest0-21swapper/107:24:351
1393099525,28cyclictest0-21swapper/106:34:311
1393099525,25cyclictest0-21swapper/107:33:231
1393099524,34cyclictest246252awk07:14:091
13930995235,10cyclictest18776-21cat05:54:131
13930995218,13cyclictest0-21swapper/107:08:011
13930995218,13cyclictest0-21swapper/107:08:011
135682524,6sleep00-21swapper/005:39:570
135682524,6sleep00-21swapper/005:39:570
118542523,42sleep10-21swapper/106:44:391
1393099515,26cyclictest0-21swapper/107:19:211
1393099513,40cyclictest0-21swapper/107:14:441
13930995120,11cyclictest0-21swapper/106:14:481
1393299504,29cyclictest0-21swapper/206:09:242
13932995020,13cyclictest0-21swapper/206:14:382
1393099505,36cyclictest0-21swapper/107:39:081
1393099505,26cyclictest0-21swapper/107:02:591
1393299494,37cyclictest0-21swapper/205:54:262
1393099494,26cyclictest0-21swapper/106:06:591
1393099473,37cyclictest0-21swapper/105:44:131
1393099473,37cyclictest0-21swapper/105:44:131
1393299454,34cyclictest0-21swapper/205:44:132
1393299454,34cyclictest0-21swapper/205:44:132
1393099453,34cyclictest0-21swapper/105:54:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional