You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 03:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri May 08, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991150,6rtkit-daemon0-21swapper/321:09:403
23006991034,92cyclictest0-21swapper/119:57:561
2641121010,5chrt26413-21turbostat18:08:002
230029910116,10cyclictest0-21swapper/020:03:070
230029910116,10cyclictest0-21swapper/020:03:070
2300699984,86cyclictest0-21swapper/121:45:461
2300699984,86cyclictest0-21swapper/119:48:191
2300299984,27cyclictest0-21swapper/019:48:130
2300299974,28cyclictest0-21swapper/018:59:580
2300299965,84cyclictest0-21swapper/020:40:230
23002999631,55cyclictest5753-21cpuspeed_turbos21:48:040
23002999619,13cyclictest0-21swapper/019:14:300
2300299944,27cyclictest0-21swapper/022:19:560
2300299944,27cyclictest0-21swapper/022:03:100
23002999421,15cyclictest0-21swapper/021:45:390
2300699933,84cyclictest0-21swapper/122:22:451
2300699933,83cyclictest0-21swapper/120:44:371
2300699933,83cyclictest0-21swapper/120:44:371
2300299934,26cyclictest0-21swapper/021:38:430
2300299934,26cyclictest0-21swapper/019:25:360
2300299934,23cyclictest19552-21tune2fs22:08:080
23002999332,51cyclictest15552-21tune2fs17:43:180
23002999321,10cyclictest9626-21gltestperf21:53:110
2300699924,82cyclictest0-21swapper/121:18:051
2300699924,81cyclictest0-21swapper/120:41:251
2300699924,80cyclictest0-21swapper/120:06:331
2300699924,80cyclictest0-21swapper/120:06:331
2300699923,82cyclictest0-21swapper/120:54:111
2300299928,23cyclictest0-21swapper/020:47:590
2300299925,28cyclictest0-21swapper/016:56:080
2300299925,26cyclictest0-21swapper/019:58:110
2300299925,26cyclictest0-21swapper/019:58:110
2300299924,26cyclictest0-21swapper/021:23:130
23002999218,12cyclictest31229-21kworker/0:119:18:090
23002999218,12cyclictest31229-21kworker/0:119:18:090
2300899913,80cyclictest25964-21ntp_kernel_err19:53:243
2300699913,82cyclictest0-21swapper/121:11:331
2300299915,79cyclictest0-21swapper/020:33:120
2300299915,26cyclictest0-21swapper/020:53:590
2300299914,79cyclictest0-21swapper/020:22:540
2300299914,79cyclictest0-21swapper/019:03:150
2300299914,27cyclictest0-21swapper/021:58:030
2300299913,23cyclictest148961ssh20:25:110
23002999126,57cyclictest0-21swapper/019:47:510
23002999121,13cyclictest0-21swapper/017:14:370
23002999121,13cyclictest0-21swapper/017:14:370
2300899903,78cyclictest28756-21perl19:58:163
2300899903,78cyclictest28756-21perl19:58:163
2300699904,80cyclictest0-21swapper/119:27:061
2300699903,80cyclictest0-21swapper/121:37:521
2300699903,80cyclictest0-21swapper/118:25:131
2300699903,79cyclictest0-21swapper/118:38:211
2300699903,79cyclictest0-21swapper/118:38:211
2300299905,77cyclictest0-21swapper/021:32:160
2300699893,80cyclictest0-21swapper/119:28:431
2300699893,79cyclictest0-21swapper/120:35:131
2300299899,17cyclictest0-21swapper/020:09:150
2300299895,76cyclictest0-21swapper/019:36:180
2300299895,75cyclictest0-21swapper/019:08:200
2300299895,26cyclictest0-21swapper/018:34:540
2300299894,79cyclictest0-21swapper/017:33:150
2300299894,78cyclictest0-21swapper/018:55:100
2300299894,30cyclictest0-21swapper/019:32:440
2300299894,28cyclictest0-21swapper/022:17:260
2300299894,28cyclictest0-21swapper/022:17:260
2300299894,27cyclictest0-21swapper/021:03:570
2300299894,26cyclictest0-21swapper/021:12:410
2300299894,26cyclictest0-21swapper/020:13:150
2300299894,25cyclictest0-21swapper/021:01:140
2300299894,25cyclictest0-21swapper/017:38:130
2300899884,63cyclictest0-21swapper/317:53:303
2300899884,63cyclictest0-21swapper/317:53:303
2300899884,53cyclictest0-21swapper/321:31:393
2300699887,74cyclictest20788-21runrttasks22:08:251
2300699884,77cyclictest0-21swapper/119:33:281
2300699884,77cyclictest0-21swapper/119:13:181
2300699883,78cyclictest0-21swapper/120:20:111
2300699883,78cyclictest0-21swapper/117:53:301
2300699883,78cyclictest0-21swapper/117:53:301
2300699883,77cyclictest0-21swapper/121:27:331
2300699883,77cyclictest0-21swapper/117:48:111
2300299885,76cyclictest0-21swapper/017:48:320
2300299884,76cyclictest0-21swapper/018:43:180
2300299884,24cyclictest5378-21aten2.4-expect17:23:140
23002998818,11cyclictest15555-21ssh21:13:240
2300899874,68cyclictest0-21swapper/319:32:043
2300899874,66cyclictest0-21swapper/318:13:003
2300699874,77cyclictest0-21swapper/121:41:191
2300699874,76cyclictest0-21swapper/119:10:211
2300699874,75cyclictest0-21swapper/120:58:141
2300699873,78cyclictest0-21swapper/121:48:351
2300699873,77cyclictest0-21swapper/121:14:131
2300699873,62cyclictest0-21swapper/121:03:101
2300299875,26cyclictest0-21swapper/021:22:320
2300299875,25cyclictest0-21swapper/020:47:140
2300299875,25cyclictest0-21swapper/020:47:140
2300299874,75cyclictest0-21swapper/019:38:030
2300299874,28cyclictest0-21swapper/019:57:030
2300299874,27cyclictest0-21swapper/020:29:220
2300899864,74cyclictest16735-21perl20:28:133
2300899863,63cyclictest6704-21runrttasks21:01:473
2300699864,75cyclictest0-21swapper/122:03:051
2300699863,75cyclictest0-21swapper/119:20:391
2300699863,75cyclictest0-21swapper/119:20:391
2300699863,75cyclictest0-21swapper/119:05:261
2300299863,20cyclictest15617-21diskmemload21:36:440
2300899854,67cyclictest0-21swapper/317:43:003
2300899854,65cyclictest0-21swapper/321:50:043
2300899854,64cyclictest0-21swapper/319:46:483
2300899853,74cyclictest0-21swapper/321:38:043
2300899853,72cyclictest1419-21runrttasks20:03:253
2300899853,72cyclictest1419-21runrttasks20:03:253
23008998516,47cyclictest0-21swapper/321:44:373
2300699854,75cyclictest0-21swapper/119:38:531
2300699853,75cyclictest0-21swapper/120:28:441
2300699853,75cyclictest0-21swapper/116:58:561
2300699853,52cyclictest0-21swapper/120:17:251
2300699853,10cyclictest4004-21missed_timers17:18:261
2300299859,11cyclictest7250irq/45-ahci17:13:020
2300299855,73cyclictest0-21swapper/018:48:210
2300299855,73cyclictest0-21swapper/018:18:180
23002998524,53cyclictest0-21swapper/017:53:280
23002998524,53cyclictest0-21swapper/017:53:280
2300899844,73cyclictest0-21swapper/322:02:253
2300899844,73cyclictest0-21swapper/320:18:253
2300899844,72cyclictest0-21swapper/317:24:423
2300899843,73cyclictest31436-21sed19:13:313
2300899843,50cyclictest21425-21cut19:48:083
2300899842,61cyclictest27070-21if_err_eth020:43:153
2300899842,61cyclictest27070-21if_err_eth020:43:153
2300699844,71cyclictest0-21swapper/120:10:071
2300699843,9cyclictest4224-21cut18:28:131
2300699843,75cyclictest0-21swapper/120:49:101
2300699843,74cyclictest0-21swapper/119:44:071
2300699843,73cyclictest0-21swapper/121:54:451
2300299844,23cyclictest28056-21aten2.4-expect17:03:150
2300899834,72cyclictest18153-21sh18:55:073
2300899834,64cyclictest0-21swapper/321:37:363
2300899834,63cyclictest0-21swapper/317:49:473
2300899834,60cyclictest0-21swapper/317:43:113
2300899834,56cyclictest17428-21yum22:03:293
2300899834,46cyclictest24955-21fschecks_time18:03:173
2300899833,65cyclictest1323-21gltestperf20:53:143
2300699834,55cyclictest0-21swapper/122:14:071
2300699834,55cyclictest0-21swapper/122:14:071
2300699833,10cyclictest24420-21ls21:28:061
23002998322,12cyclictest0-21swapper/018:23:160
2300899824,70cyclictest0-21swapper/321:13:193
2300899824,64cyclictest0-21swapper/322:20:313
2300899824,63cyclictest0-21swapper/321:53:023
2300899824,63cyclictest0-21swapper/319:06:513
2300899824,61cyclictest0-21swapper/321:18:543
2300899824,60cyclictest0-21swapper/322:08:193
2300899824,60cyclictest0-21swapper/319:21:263
2300899824,60cyclictest0-21swapper/319:21:263
2300899823,71cyclictest20444-21munin-node20:33:193
2300899823,71cyclictest15112-21sh19:38:123
2300899823,58cyclictest6069-21egrep20:13:103
2300699824,73cyclictest0-21swapper/119:58:101
2300699824,73cyclictest0-21swapper/119:58:101
2300699824,71cyclictest0-21swapper/118:58:121
2300699823,73cyclictest0-21swapper/122:01:261
2300699823,73cyclictest0-21swapper/117:28:151
2300699823,72cyclictest0-21swapper/118:53:261
2300299825,27cyclictest24897-21cut18:03:170
2300299823,33cyclictest0-21swapper/017:18:210
2300899813,71cyclictest0-21swapper/322:13:273
2300899813,71cyclictest0-21swapper/322:13:273
2300899813,70cyclictest31844-21ssh20:50:153
2300899813,60cyclictest0-21swapper/319:35:143
2300899813,55cyclictest0-21swapper/318:58:303
2300699813,72cyclictest0-21swapper/118:08:111
2300699813,71cyclictest6270-21iostat17:23:231
23002998121,14cyclictest0-21swapper/018:28:240
23002998117,10cyclictest24020-21munin-run18:03:000
2300899804,69cyclictest3347-21gltestperf20:08:133
2300899804,69cyclictest0-21swapper/320:24:483
2300899804,68cyclictest0-21swapper/320:41:073
2300899804,54cyclictest0-21swapper/321:23:223
2300699804,69cyclictest0-21swapper/118:01:251
2300699803,71cyclictest0-21swapper/118:04:491
2300699803,70cyclictest0-21swapper/118:44:001
2300699803,70cyclictest0-21swapper/117:13:021
2300699803,70cyclictest0-21swapper/117:03:141
23002998023,12cyclictest0-21swapper/018:13:190
23002998023,10cyclictest27755-21crond17:03:020
23002998022,9cyclictest27460-21gltestperf18:08:190
23002998022,12cyclictest9203-21df18:38:140
23002998022,12cyclictest9203-21df18:38:140
2300899794,58cyclictest0-21swapper/318:13:213
2300899794,48cyclictest29928-21runrttasks17:05:143
2300899793,61cyclictest0-21swapper/321:03:453
2300699795,50cyclictest121850irq/46-eth018:18:111
2300699793,70cyclictest0-21swapper/118:52:221
2300699793,10cyclictest14116-21wc20:23:261
2300299793,16cyclictest0-21swapper/017:28:140
2300899787,54cyclictest10827-21munin-run18:42:593
2300899787,54cyclictest10827-21munin-run18:42:593
2300899784,67cyclictest0-21swapper/317:08:303
2300899784,61cyclictest0-21swapper/319:08:093
2300899784,60cyclictest0-21swapper/319:23:563
2300699783,56cyclictest0-21swapper/118:14:511
2300899774,58cyclictest0-21swapper/317:58:123
2300899773,67cyclictest0-21swapper/318:23:163
2300699773,68cyclictest0-21swapper/117:13:301
2300699773,68cyclictest0-21swapper/117:13:301
2300699773,67cyclictest0-21swapper/116:56:381
2300899769,46cyclictest0-21swapper/317:18:293
2300899764,65cyclictest0-21swapper/318:37:593
2300899763,65cyclictest10027-21munin-node17:33:143
2300899763,56cyclictest0-21swapper/317:03:023
2300899754,64cyclictest0-21swapper/317:18:033
2300899754,64cyclictest0-21swapper/317:18:033
2300899753,62cyclictest1287-21snmpd18:49:573
2300699754,66cyclictest0-21swapper/117:43:311
2300699753,8cyclictest8193-21taskset18:34:541
2300899743,64cyclictest31462-21cut18:18:103
2300699743,10cyclictest11214-21sed17:33:251
2300899734,55cyclictest0-21swapper/317:28:303
2300899734,46cyclictest0-21swapper/318:28:133
2300699734,63cyclictest0-21swapper/117:43:011
2300699723,63cyclictest0-21swapper/116:53:031
2300899703,48cyclictest11057-21munin-node18:43:133
2300899692,52cyclictest0-21swapper/316:53:143
2300899624,52cyclictest0-21swapper/316:53:033
23007996019,21cyclictest121850irq/46-eth020:22:542
237032595,13sleep20-21swapper/221:27:142
2300799585,45cyclictest0-21swapper/219:23:222
2300799584,46cyclictest0-21swapper/220:03:262
2300799584,46cyclictest0-21swapper/220:03:262
23007995818,23cyclictest0-21swapper/220:28:152
2300799575,34cyclictest0-21swapper/217:23:132
2300799575,32cyclictest0-21swapper/218:43:262
2300799574,37cyclictest0-21swapper/220:24:022
125602574,46sleep20-21swapper/219:33:262
4282562,47sleep20-21swapper/219:17:262
306092563,46sleep215617-21diskmemload20:01:082
306092563,46sleep215617-21diskmemload20:01:082
2300799566,28cyclictest0-21swapper/221:58:232
2300799564,45cyclictest0-21swapper/219:38:182
2300799564,43cyclictest0-21swapper/220:48:052
2300799564,35cyclictest0-21swapper/221:20:012
23007995619,12cyclictest0-21swapper/219:18:312
23007995619,12cyclictest0-21swapper/219:18:312
23007995618,21cyclictest0-21swapper/220:10:332
23007995616,27cyclictest0-21swapper/220:40:372
278292553,45sleep20-21swapper/222:19:312
2300799554,44cyclictest0-21swapper/221:33:062
2300799554,34cyclictest0-21swapper/221:30:052
2300799554,14cyclictest0-21swapper/219:43:072
2300799554,13cyclictest0-21swapper/220:13:302
2300799554,12cyclictest0-21swapper/221:08:372
23007995523,12cyclictest0-21swapper/219:53:252
2300799552,47cyclictest0-21swapper/221:48:182
23007995518,13cyclictest0-21swapper/217:53:002
23007995517,22cyclictest0-21swapper/219:01:512
63862542,12sleep20-21swapper/221:00:382
277912542,44sleep20-21swapper/217:03:042
2300799545,29cyclictest0-21swapper/217:18:022
2300799545,29cyclictest0-21swapper/217:18:022
2300799544,41cyclictest0-21swapper/219:08:112
23007995428,10cyclictest23234-21hwlatdetect22:13:112
23007995428,10cyclictest23234-21hwlatdetect22:13:112
23007995422,13cyclictest0-21swapper/218:53:272
23007995421,9cyclictest10894-21ssh21:54:152
23007995415,20cyclictest0-21swapper/216:58:172
163692542,10sleep20-21swapper/221:15:052
2300799536,39cyclictest0-21swapper/219:48:312
2300799534,26cyclictest0-21swapper/222:11:202
23007995314,22cyclictest0-21swapper/217:28:232
299822523,14sleep20-21swapper/218:13:212
2300799526,39cyclictest0-21swapper/220:33:172
2300799525,29cyclictest0-21swapper/221:38:302
2300799525,28cyclictest0-21swapper/221:04:032
2300799525,28cyclictest0-21swapper/220:56:162
2300799525,26cyclictest0-21swapper/220:42:592
2300799525,26cyclictest0-21swapper/220:42:592
2300799524,41cyclictest0-21swapper/222:03:062
2300799524,29cyclictest0-21swapper/221:43:162
2300799524,14cyclictest0-21swapper/219:06:402
23007995232,12cyclictest10769-21tune2fs17:33:192
2300799522,36cyclictest0-21swapper/219:28:362
237712513,40sleep20-21swapper/217:59:552
2300799515,27cyclictest0-21swapper/218:38:132
2300799515,27cyclictest0-21swapper/218:38:132
2300799505,27cyclictest0-21swapper/218:48:152
2300799505,27cyclictest0-21swapper/217:08:232
2300799505,27cyclictest0-21swapper/216:53:262
2300799505,25cyclictest0-21swapper/217:38:132
2300799504,28cyclictest0-21swapper/217:53:222
2300799504,28cyclictest0-21swapper/217:53:222
2300799504,27cyclictest0-21swapper/217:18:282
2300799503,26cyclictest0-21swapper/218:25:052
7712492,40sleep20-21swapper/218:18:492
266292492,39sleep20-21swapper/218:08:052
2300799494,27cyclictest0-21swapper/217:43:222
23007994918,13cyclictest0-21swapper/218:33:352
2300799454,33cyclictest0-21swapper/218:28:302
229722424,33sleep00-21swapper/016:53:020
248599390,4rtkit-daemon2484-21rtkit-daemon16:48:212
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional