You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 03:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jun 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219499980,5rtkit-daemon2193-21rtkit-daemon00:07:323
219499810,5rtkit-daemon2193-21rtkit-daemon22:19:362
219499810,5rtkit-daemon2193-21rtkit-daemon22:19:362
3260399744,61cyclictest0-21swapper/023:32:390
3261099722,61cyclictest0-21swapper/223:45:282
3261099718,56cyclictest0-21swapper/221:30:362
32603997111,52cyclictest0-21swapper/023:40:330
32603997111,52cyclictest0-21swapper/023:40:330
3260399704,16cyclictest0-21swapper/023:14:120
219499700,5rtkit-daemon2193-21rtkit-daemon19:14:063
219499700,4rtkit-daemon2193-21rtkit-daemon21:39:452
219499700,4rtkit-daemon2193-21rtkit-daemon21:39:452
3261099698,53cyclictest0-21swapper/200:01:572
3260399694,56cyclictest0-21swapper/021:00:410
32603996913,32cyclictest16197-21ssh22:10:280
3261099688,52cyclictest31364-21cat23:20:312
3261099687,53cyclictest0-21swapper/220:55:282
3261099687,53cyclictest0-21swapper/220:55:282
3261099683,58cyclictest0-21swapper/222:55:402
3260699685,55cyclictest0-21swapper/123:18:051
3260399689,51cyclictest0-21swapper/022:45:430
3261099674,55cyclictest0-21swapper/222:35:442
3261099664,54cyclictest0-21swapper/222:29:182
3261099664,53cyclictest0-21swapper/223:00:292
3261099664,53cyclictest0-21swapper/223:00:292
3260699664,54cyclictest0-21swapper/123:00:301
3260699664,54cyclictest0-21swapper/123:00:301
3260699664,54cyclictest0-21swapper/121:45:331
3260399667,50cyclictest0-21swapper/021:40:200
3260399667,42cyclictest0-21swapper/021:33:390
3260399667,37cyclictest0-21swapper/022:57:210
32603996615,44cyclictest0-21swapper/022:00:350
32603996614,43cyclictest22041-21munin-node22:20:300
32603996614,43cyclictest22041-21munin-node22:20:300
32603996614,15cyclictest0-21swapper/019:55:320
3261199657,51cyclictest32093-21crond21:00:113
3261199657,51cyclictest32093-21crond21:00:113
3261099658,51cyclictest0-21swapper/223:33:552
3261099654,53cyclictest0-21swapper/222:02:552
3261099654,52cyclictest0-21swapper/221:29:212
32610996514,34cyclictest0-21swapper/222:05:192
32610996512,46cyclictest1183-21taskset19:58:292
3260399656,53cyclictest0-21swapper/000:10:210
3260399654,53cyclictest0-21swapper/023:45:270
32603996515,42cyclictest303341ssh23:20:190
32603996510,48cyclictest0-21swapper/020:05:280
219499650,7rtkit-daemon0-21swapper/320:04:412
219499650,6rtkit-daemon2193-21rtkit-daemon22:45:283
3261099645,51cyclictest0-21swapper/223:50:212
3261099645,51cyclictest0-21swapper/223:05:232
3261099644,53cyclictest0-21swapper/222:12:172
3261099644,52cyclictest0-21swapper/200:18:262
32610996414,43cyclictest28978-21kworker/2:121:00:232
32610996412,30cyclictest23417-21ssh23:55:402
3260699644,52cyclictest0-21swapper/122:40:181
3260699644,52cyclictest0-21swapper/122:30:381
3260699644,52cyclictest0-21swapper/100:15:531
3260399645,52cyclictest0-21swapper/021:51:420
3260399644,53cyclictest0-21swapper/023:15:290
3260399644,52cyclictest0-21swapper/023:05:290
3260399644,38cyclictest107550irq/46-eth023:25:230
32603996414,27cyclictest23191-21munin-node20:45:350
32603996411,44cyclictest1761-21Xorg22:30:060
219499640,6rtkit-daemon0-21swapper/323:37:262
3261099634,51cyclictest0-21swapper/221:45:262
3261099634,51cyclictest0-21swapper/221:20:412
3261099632,55cyclictest0-21swapper/222:53:272
32610996312,41cyclictest1227-21runrttasks22:33:082
3260699634,53cyclictest0-21swapper/121:30:341
3260699634,51cyclictest0-21swapper/123:40:051
3260699633,51cyclictest2535-21fschecks_count21:50:271
32603996317,38cyclictest17016-21crond19:25:140
32603996316,40cyclictest4585-21grep21:05:330
32603996313,41cyclictest28441-21taskset00:05:170
219499630,8rtkit-daemon0-21swapper/320:24:112
219499630,7rtkit-daemon0-21swapper/321:50:302
219499630,7rtkit-daemon0-21swapper/320:45:472
3261099629,47cyclictest0-21swapper/200:12:512
3261099628,47cyclictest1124-21snmpd21:43:362
3261099624,51cyclictest0-21swapper/200:05:542
32610996232,13cyclictest0-21swapper/220:54:282
3261099623,52cyclictest0-21swapper/222:20:342
3261099623,52cyclictest0-21swapper/222:20:342
32610996226,15cyclictest107550irq/46-eth018:55:162
32610996226,15cyclictest107550irq/46-eth018:55:162
32610996214,30cyclictest4865-21ssh22:40:402
32610996213,32cyclictest1124-21snmpd22:45:272
3260699624,50cyclictest0-21swapper/123:28:211
3260699624,50cyclictest0-21swapper/122:10:491
3260699624,50cyclictest0-21swapper/100:00:301
3260399628,38cyclictest0-21swapper/023:55:190
3260399626,49cyclictest0-21swapper/019:50:250
3260399625,50cyclictest0-21swapper/023:01:070
3260399625,50cyclictest0-21swapper/023:01:070
32603996218,35cyclictest18910-21ssh23:50:220
32603996217,20cyclictest0-21swapper/019:30:370
32603996213,31cyclictest30229-21ssh20:55:400
32603996213,31cyclictest30229-21ssh20:55:400
32603996212,44cyclictest0-21swapper/021:57:360
32603996210,45cyclictest0-21swapper/018:52:520
32603996210,45cyclictest0-21swapper/018:52:520
219499620,7rtkit-daemon0-21swapper/320:16:032
219499620,7rtkit-daemon0-21swapper/320:16:032
3261199613,52cyclictest0-21swapper/321:54:273
3261099619,33cyclictest25345-21diskmemload23:11:262
32610996114,31cyclictest4812-21cat21:05:372
32606996119,24cyclictest15714-21gltestperf23:45:251
3260399617,48cyclictest0-21swapper/021:49:110
3260399617,46cyclictest0-21swapper/022:35:330
3260399614,50cyclictest0-21swapper/022:40:270
3260399614,50cyclictest0-21swapper/021:35:300
3260399614,50cyclictest0-21swapper/021:35:300
3260399614,49cyclictest0-21swapper/022:30:350
3260399614,38cyclictest0-21swapper/020:15:290
3260399614,38cyclictest0-21swapper/020:15:290
3260399613,52cyclictest0-21swapper/022:53:370
32603996114,40cyclictest121111ssh22:05:200
32603996114,39cyclictest25679-21tune2fs00:00:230
32603996112,42cyclictest0-21swapper/022:15:330
32603996112,42cyclictest0-21swapper/022:15:330
32603996112,32cyclictest0-21swapper/021:15:230
219499610,7rtkit-daemon0-21swapper/320:38:252
219499610,7rtkit-daemon0-21swapper/319:40:272
219499610,7rtkit-daemon0-21swapper/319:15:512
219499610,6rtkit-daemon0-21swapper/320:31:552
3261099608,35cyclictest0-21swapper/221:17:022
3261099606,36cyclictest0-21swapper/223:40:382
3261099606,36cyclictest0-21swapper/223:40:382
32606996043,10cyclictest24435-21aten_r1power_cu19:40:231
3260699603,51cyclictest0-21swapper/121:35:391
3260699603,51cyclictest0-21swapper/121:35:391
3260399606,48cyclictest0-21swapper/021:25:200
3260399604,38cyclictest0-21swapper/021:15:110
3260399602,40cyclictest0-21swapper/000:15:180
32603996011,32cyclictest0-21swapper/019:45:420
219499600,9rtkit-daemon0-21swapper/319:30:282
219499600,7rtkit-daemon0-21swapper/319:45:202
219499600,7rtkit-daemon0-21swapper/319:10:512
219499600,6rtkit-daemon0-21swapper/319:21:282
219499600,6rtkit-daemon0-21swapper/319:04:062
219499600,5rtkit-daemon2193-21rtkit-daemon22:21:213
219499600,5rtkit-daemon2193-21rtkit-daemon22:21:213
219499600,5rtkit-daemon2193-21rtkit-daemon21:32:533
163712602,50sleep30-21swapper/322:59:493
3261199593,50cyclictest0-21swapper/323:56:103
3261099595,35cyclictest0-21swapper/221:59:262
32610995915,27cyclictest8044-21grep19:05:292
3260699595,47cyclictest0-21swapper/100:09:581
3260699594,49cyclictest0-21swapper/122:15:221
3260699594,49cyclictest0-21swapper/122:15:221
3260699594,48cyclictest0-21swapper/122:00:301
3260399598,43cyclictest0-21swapper/020:40:120
32603995918,18cyclictest14556-21ssh21:20:270
32603995916,21cyclictest8670-21ssh23:35:230
32603995915,36cyclictest8633-21hwlatdetect19:05:350
32603995910,41cyclictest0-21swapper/019:36:180
32603995910,41cyclictest0-21swapper/019:36:180
219499590,7rtkit-daemon0-21swapper/320:12:112
219499590,7rtkit-daemon0-21swapper/319:54:272
219499590,7rtkit-daemon0-21swapper/319:25:282
219499590,6rtkit-daemon0-21swapper/320:40:552
219499590,6rtkit-daemon0-21swapper/320:26:032
219499590,5rtkit-daemon2193-21rtkit-daemon18:58:513
219499590,5rtkit-daemon2193-21rtkit-daemon18:58:513
32611995840,11cyclictest13361-21gltestperf19:15:373
3261199584,46cyclictest0-21swapper/322:42:503
3261199583,49cyclictest0-21swapper/300:15:363
3261199583,47cyclictest0-21swapper/322:25:293
3261199582,50cyclictest8229-21seq21:59:503
3261099584,21cyclictest0-21swapper/223:25:542
3260699584,48cyclictest0-21swapper/122:07:111
3260699584,46cyclictest0-21swapper/121:10:391
3260699583,12cyclictest0-21swapper/119:35:381
3260699583,12cyclictest0-21swapper/119:35:381
32606995821,11cyclictest1705-21sed21:00:441
32606995818,23cyclictest0-21swapper/121:17:231
32603995810,41cyclictest0-21swapper/020:50:230
219499580,7rtkit-daemon0-21swapper/321:11:542
219499580,6rtkit-daemon0-21swapper/320:06:562
219499580,6rtkit-daemon0-21swapper/319:37:352
219499580,6rtkit-daemon0-21swapper/319:37:352
219499580,5rtkit-daemon2193-21rtkit-daemon20:24:483
219499580,5rtkit-daemon2193-21rtkit-daemon20:17:333
219499580,5rtkit-daemon2193-21rtkit-daemon20:17:333
219499580,5rtkit-daemon2193-21rtkit-daemon19:38:273
219499580,5rtkit-daemon2193-21rtkit-daemon19:38:273
219499580,5rtkit-daemon2193-21rtkit-daemon19:01:363
219499580,5rtkit-daemon2193-21rtkit-daemon00:00:021
219499580,4rtkit-daemon2193-21rtkit-daemon21:12:463
3261199574,29cyclictest0-21swapper/323:35:343
3261199573,49cyclictest0-21swapper/323:20:193
3261199573,49cyclictest0-21swapper/321:23:243
3261099576,45cyclictest0-21swapper/223:19:202
3260699574,46cyclictest0-21swapper/123:08:171
3260699574,46cyclictest0-21swapper/121:55:241
3260699574,46cyclictest0-21swapper/120:40:241
3260699574,28cyclictest0-21swapper/122:35:241
3260399577,43cyclictest0-21swapper/020:10:260
32603995716,34cyclictest21561-21fschecks_time20:40:300
32603995712,37cyclictest11841-21sort20:20:280
219499570,5rtkit-daemon2193-21rtkit-daemon22:36:433
219499570,5rtkit-daemon2193-21rtkit-daemon21:26:163
219499570,5rtkit-daemon2193-21rtkit-daemon20:42:323
219499570,5rtkit-daemon2193-21rtkit-daemon19:48:573
219499570,5rtkit-daemon2193-21rtkit-daemon19:31:203
219499570,5rtkit-daemon2193-21rtkit-daemon19:27:133
219499570,5rtkit-daemon2193-21rtkit-daemon18:51:143
219499570,5rtkit-daemon2193-21rtkit-daemon18:51:143
219499570,4rtkit-daemon2193-21rtkit-daemon20:30:183
3261199564,45cyclictest0-21swapper/323:06:233
3260699564,45cyclictest0-21swapper/123:44:071
3260699564,45cyclictest0-21swapper/123:44:071
3260399568,40cyclictest0-21swapper/019:40:460
3260399567,31cyclictest0-21swapper/020:30:320
32603995612,36cyclictest1568-21munin-node20:00:300
219499560,6rtkit-daemon0-21swapper/318:56:592
219499560,6rtkit-daemon0-21swapper/318:56:592
219499560,5rtkit-daemon2193-21rtkit-daemon23:54:021
219499560,5rtkit-daemon2193-21rtkit-daemon21:40:303
219499560,5rtkit-daemon2193-21rtkit-daemon21:17:393
219499560,5rtkit-daemon2193-21rtkit-daemon20:25:263
219499560,4rtkit-daemon2193-21rtkit-daemon22:32:433
219499560,4rtkit-daemon2193-21rtkit-daemon21:48:523
219499560,4rtkit-daemon2193-21rtkit-daemon20:48:173
219499560,4rtkit-daemon2193-21rtkit-daemon20:10:563
219499560,4rtkit-daemon2193-21rtkit-daemon19:53:493
219499560,4rtkit-daemon2193-21rtkit-daemon19:06:293
16132562,43sleep30-21swapper/320:00:243
3261199553,46cyclictest0-21swapper/300:00:503
3261199553,38cyclictest26748-21load20:50:363
32606995541,8cyclictest30585-21processes19:50:411
3260699554,42cyclictest0-21swapper/121:40:231
3260699553,46cyclictest0-21swapper/123:10:201
32606995526,13cyclictest0-21swapper/122:46:011
3260399555,44cyclictest0-21swapper/018:50:160
32603995512,36cyclictest10095-21munin-node19:10:380
32603995511,38cyclictest0-21swapper/019:00:380
325952552,46sleep10-21swapper/100:10:231
219499550,5rtkit-daemon2193-21rtkit-daemon22:05:373
219499550,5rtkit-daemon2193-21rtkit-daemon21:36:153
219499550,5rtkit-daemon2193-21rtkit-daemon21:36:153
219499550,4rtkit-daemon2193-21rtkit-daemon20:38:103
219499550,4rtkit-daemon2193-21rtkit-daemon20:07:113
219499550,4rtkit-daemon2193-21rtkit-daemon19:58:423
219499550,4rtkit-daemon2193-21rtkit-daemon19:24:353
42092543,43sleep10-21swapper/121:05:291
219499540,5rtkit-daemon2193-21rtkit-daemon22:50:203
219499540,5rtkit-daemon2193-21rtkit-daemon22:15:213
219499540,5rtkit-daemon2193-21rtkit-daemon22:15:213
219499540,5rtkit-daemon2193-21rtkit-daemon22:02:223
219499540,4rtkit-daemon2193-21rtkit-daemon22:13:513
219499540,4rtkit-daemon2193-21rtkit-daemon21:01:173
219499540,4rtkit-daemon2193-21rtkit-daemon19:44:123
74492533,43sleep10-21swapper/123:33:541
3261199534,42cyclictest0-21swapper/323:25:293
3261199532,45cyclictest2560-21date00:15:033
3260699534,43cyclictest0-21swapper/122:22:241
3260699534,43cyclictest0-21swapper/122:22:241
3260699534,43cyclictest0-21swapper/120:57:211
3260699534,43cyclictest0-21swapper/120:57:211
3260699534,42cyclictest0-21swapper/120:52:471
3260699534,29cyclictest0-21swapper/121:29:111
32606995334,12cyclictest16621-21cut20:30:301
3260699533,44cyclictest0-21swapper/122:57:061
3260699533,10cyclictest0-21swapper/122:29:001
32606995321,13cyclictest0-21swapper/122:50:361
219499530,4rtkit-daemon2193-21rtkit-daemon21:08:393
140792533,10sleep30-21swapper/323:43:243
140792533,10sleep30-21swapper/323:43:243
3261199525,40cyclictest0-21swapper/323:15:323
3261199524,31cyclictest0-21swapper/323:45:223
3261199523,41cyclictest17370-21fschecks_count23:00:243
3261199523,41cyclictest17370-21fschecks_count23:00:243
3260699524,30cyclictest0-21swapper/119:30:461
3260699524,29cyclictest0-21swapper/123:21:001
3260699523,43cyclictest0-21swapper/120:00:441
32606995222,13cyclictest0-21swapper/121:20:231
3260399525,29cyclictest0-21swapper/020:25:290
3261199514,10cyclictest20048-21munin-node23:50:393
3260699515,12cyclictest0-21swapper/119:15:191
3260699514,39cyclictest0-21swapper/118:50:271
3260699514,39cyclictest0-21swapper/118:50:271
3260699514,29cyclictest0-21swapper/120:10:301
3260699514,29cyclictest0-21swapper/119:55:361
32606995131,12cyclictest24761-21taskset20:45:441
3260699513,42cyclictest0-21swapper/119:20:251
3260399513,42cyclictest0-21swapper/019:15:400
50312502,41sleep10-21swapper/118:59:381
50312502,41sleep10-21swapper/118:59:381
3261199504,28cyclictest0-21swapper/323:35:043
32611995015,28cyclictest24010-21df_abs23:10:213
3260699504,39cyclictest0-21swapper/120:25:311
3260699504,29cyclictest0-21swapper/119:10:471
3260699504,26cyclictest5199-21runrttasks20:05:361
32606995017,28cyclictest10934-21runrttasks20:19:221
32606995017,28cyclictest10934-21runrttasks20:19:221
3260399503,41cyclictest0-21swapper/019:25:210
3260699494,27cyclictest0-21swapper/120:20:341
3260699493,39cyclictest32717-21date18:50:161
3260399494,14cyclictest0-21swapper/018:55:310
3260399494,14cyclictest0-21swapper/018:55:310
3261099487,15cyclictest0-21swapper/218:50:162
3260699484,38cyclictest0-21swapper/119:30:151
3260699483,40cyclictest0-21swapper/119:07:311
32606994820,12cyclictest0-21swapper/120:40:121
3260699474,28cyclictest0-21swapper/119:45:431
32606994630,10cyclictest6982-21unixbench-2d19:00:471
3261199404,30cyclictest32693-21latency_hist18:50:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional