You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 19:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed May 27, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3021223824,0sleep00-21swapper/006:52:480
304450350,0irq/25-eth10-21swapper/306:51:303
3032123425,0sleep10-21swapper/106:54:051
3020923324,0sleep20-21swapper/206:52:462
4160,0ktimersoftd/00-21swapper/007:59:360
339960,0migration/328325-21sh10:34:203
339960,0migration/327664-21sh09:30:233
339960,0migration/326902-21sh11:32:193
339960,0migration/311991-21sh09:42:163
304259960,0cyclictest0-21swapper/110:30:291
29725060,0irq/27-eth0-tx-7930-21munin-node08:14:390
29715060,0irq/26-eth0-rx-30025-21perl09:34:383
149960,0migration/026826-21munin-node09:09:470
149960,0migration/020075-21sh09:07:090
149960,0migration/011127-21sh09:00:250
339950,0migration/37648-21kthreadcore07:24:413
339950,0migration/34634-21aten_r1power_en10:19:353
339950,0migration/34321-21irqcore12:19:403
339950,0migration/332407-21kthreadcore06:54:413
339950,0migration/332402-21latency_hist07:44:253
339950,0migration/330977-21kthreadcore08:04:423
339950,0migration/330411-21munin-node07:14:443
339950,0migration/330406-21kthreadcore08:29:413
339950,0migration/328550-21hwlatdetect11:54:383
339950,0migration/328067-21sh09:11:473
339950,0migration/325962-21sendmail_mailst11:09:473
339950,0migration/321965-21kthreadcore12:09:413
339950,0migration/318517-21kthreadcore07:54:423
339950,0migration/318269-21taskset12:06:433
339950,0migration/316912-21kthreadcore10:24:413
339950,0migration/316784-21munin-node08:44:423
339950,0migration/315836-21kthreadcore09:44:413
339950,0migration/315130-21kthreadcore10:04:423
339950,0migration/314475-21kthreadcore11:24:403
339950,0migration/313982-21gltestperf09:24:373
339950,0migration/313357-21munin-node10:44:393
339950,0migration/312219-21taskset11:04:353
339950,0migration/311377-21kthreadcore08:14:433
304269955,0cyclictest0-21swapper/211:08:162
304269955,0cyclictest0-21swapper/211:04:002
304269955,0cyclictest0-21swapper/210:36:252
304269955,0cyclictest0-21swapper/210:11:302
304269955,0cyclictest0-21swapper/209:52:352
304269955,0cyclictest0-21swapper/209:36:582
304269955,0cyclictest0-21swapper/209:00:142
304269950,0cyclictest0-21swapper/211:30:292
304269950,0cyclictest0-21swapper/211:15:312
304269950,0cyclictest0-21swapper/210:21:172
304269950,0cyclictest0-21swapper/209:41:142
304259955,0cyclictest0-21swapper/112:08:521
304259955,0cyclictest0-21swapper/108:55:161
304259950,0cyclictest0-21swapper/112:22:441
304259950,0cyclictest0-21swapper/111:37:581
304259950,0cyclictest0-21swapper/110:41:501
304259950,0cyclictest0-21swapper/109:11:301
304249954,0cyclictest27256-21munin-run12:14:250
29725050,0irq/27-eth0-tx-5920-21munin-node07:24:380
29725050,0irq/27-eth0-tx-4900-21fschecks_time10:39:382
29725050,0irq/27-eth0-tx-24936-21munin-node07:14:460
29725050,0irq/27-eth0-tx-19738-21munin-node11:49:392
29725050,0irq/27-eth0-tx-1203-21munin-node08:09:390
29725050,0irq/27-eth0-tx-11629-21munin-node07:04:390
29725050,0irq/27-eth0-tx-0-21swapper/210:28:142
29725050,0irq/27-eth0-tx-0-21swapper/007:49:470
29715050,0irq/26-eth0-rx-9278-21tr11:39:443
29715050,0irq/26-eth0-rx-6466-21kthreadcore11:19:423
29715050,0irq/26-eth0-rx-5879-21cut09:59:403
29715050,0irq/26-eth0-rx-527-21diskstats07:44:383
29715050,0irq/26-eth0-rx-4996-21cpuspeed_turbos08:59:363
29715050,0irq/26-eth0-rx-3797-21ssh09:16:133
29715050,0irq/26-eth0-rx-31443-21kthreadcore08:54:433
29715050,0irq/26-eth0-rx-2594-21uptime10:14:463
29715050,0irq/26-eth0-rx-0-21swapper/311:44:433
29715050,0irq/26-eth0-rx-0-21swapper/311:14:403
29715050,0irq/26-eth0-rx-0-21swapper/311:02:393
29715050,0irq/26-eth0-rx-0-21swapper/310:49:453
29715050,0irq/26-eth0-rx-0-21swapper/310:39:393
29715050,0irq/26-eth0-rx-0-21swapper/310:12:393
29715050,0irq/26-eth0-rx-0-21swapper/309:56:193
29715050,0irq/26-eth0-rx-0-21swapper/309:50:553
29715050,0irq/26-eth0-rx-0-21swapper/309:07:363
29715050,0irq/26-eth0-rx-0-21swapper/308:34:423
29715050,0irq/26-eth0-rx-0-21swapper/307:49:373
259950,0migration/226393-21munin-node10:29:452
249950,0watchdog/24070-21if_err_eth112:19:392
249950,0watchdog/220685-21fschecks_count11:09:392
19150,0ktimersoftd/120193-21ssh10:29:021
179950,0migration/18213-21kthreadcore07:24:411
179950,0migration/15206-21kthreadcore11:19:411
179950,0migration/126845-21taskset11:32:091
179950,0migration/121378-21sh09:29:351
179950,0migration/11106-21munin-node08:29:461
179950,0migration/110124-21sh12:01:181
149950,0migration/0838-21kthreadcore09:54:400
149950,0migration/07878-21kthreadcore09:39:420
149950,0migration/07200-21kthreadcore09:59:410
149950,0migration/06946-21kthreadcore10:19:410
149950,0migration/05539-21kthreadcore11:19:410
149950,0migration/04347-21kthreadcore08:34:420
149950,0migration/04154-21sh10:19:010
149950,0migration/03321-21aten_r1power_vo12:19:360
149950,0migration/029749-21munin-node09:34:370
149950,0migration/029524-21irqcore10:54:400
149950,0migration/029421-21irqrtprio11:14:400
149950,0migration/028821-21latency_hist08:54:250
149950,0migration/023125-21kthreadcore09:29:410
149950,0migration/020961-21munin-node08:44:460
149950,0migration/019848-21sh09:26:020
149950,0migration/019510-21sh09:45:440
149950,0migration/01908-21latency_hist08:34:250
149950,0migration/01832-21sh11:35:160
149950,0migration/014756-21irqcore07:54:410
149950,0migration/014202-21kthreadcore11:44:400
149950,0migration/011595-21sh09:20:260
339940,0migration/36334-21kthreadcore11:59:403
339940,0migration/35591-21kthreadcore08:09:443
339940,0migration/321978-21hddtemp_smartct08:24:393
339940,0migration/320928-21kthreadcore07:34:423
339940,0migration/311846-21kthreadcore08:39:443
304269944,0cyclictest0-21swapper/208:09:282
304269943,0cyclictest8799-21awk08:14:402
304269943,0cyclictest4300-21awk11:59:382
304269943,0cyclictest3556-21lldpd11:54:372
304269943,0cyclictest3556-21lldpd11:44:362
304269943,0cyclictest3556-21lldpd08:54:352
304269943,0cyclictest3556-21lldpd07:09:342
304269943,0cyclictest3514-21snmpd08:04:312
304269943,0cyclictest3514-21snmpd08:01:312
304269943,0cyclictest3241-21irqbalance08:50:542
304269943,0cyclictest3241-21irqbalance08:39:542
304269943,0cyclictest3241-21irqbalance08:34:342
304269943,0cyclictest3241-21irqbalance08:19:442
304269943,0cyclictest3241-21irqbalance07:35:142
304269943,0cyclictest3241-21irqbalance07:29:342
304269943,0cyclictest3241-21irqbalance07:24:542
304269943,0cyclictest3241-21irqbalance07:23:342
304269943,0cyclictest3241-21irqbalance07:14:342
304269943,0cyclictest3241-21irqbalance06:56:142
304269943,0cyclictest28861-21awk08:29:402
304269943,0cyclictest22141-21awk08:24:402
304269943,0cyclictest16472-21awk08:44:412
304269941,0cyclictest0-21swapper/211:19:352
304259944,0cyclictest28611-21diskmemload09:59:541
304259943,0cyclictest3556-21lldpd08:59:351
304259943,0cyclictest3556-21lldpd07:07:341
304259943,0cyclictest3514-21snmpd11:41:021
304259943,0cyclictest3514-21snmpd11:14:471
304259943,0cyclictest3514-21snmpd11:04:321
304259943,0cyclictest3514-21snmpd11:00:021
304259943,0cyclictest3514-21snmpd10:48:011
304259943,0cyclictest3514-21snmpd09:45:161
304259943,0cyclictest3514-21snmpd09:18:011
304259943,0cyclictest3514-21snmpd09:06:161
304259943,0cyclictest3514-21snmpd08:22:011
304259943,0cyclictest3514-21snmpd08:11:011
304259943,0cyclictest3514-21snmpd07:45:011
304259943,0cyclictest3241-21irqbalance09:21:241
304259943,0cyclictest31590-21awk06:54:401
304259943,0cyclictest29961-21awk09:54:381
304259943,0cyclictest29756-21awk10:14:371
304259943,0cyclictest27912-21awk08:04:401
304259943,0cyclictest22048-21awk08:24:391
304259943,0cyclictest13469-21awk07:29:401
304259943,0cyclictest12763-21awk11:24:381
304249944,0cyclictest28157-21sh10:54:250
304249944,0cyclictest0-21swapper/012:06:400
304249944,0cyclictest0-21swapper/011:24:250
304249944,0cyclictest0-21swapper/007:42:070
304249943,0cyclictest9840-21awk08:39:420
304249943,0cyclictest798-21kworker/0:011:57:540
304249943,0cyclictest798-21kworker/0:011:33:240
304249943,0cyclictest3241-21irqbalance10:33:030
304249943,0cyclictest20625-21awk11:49:400
304249943,0cyclictest13783-21awk10:04:400
304249943,0cyclictest13285-21awk10:44:380
304249943,0cyclictest13073-21awk11:04:400
304249940,0cyclictest14585-21munin-node08:19:440
29725040,0irq/27-eth0-tx-31057-21kthreadcore11:34:412
29725040,0irq/27-eth0-tx-30894-21kthreadcore10:54:412
29725040,0irq/27-eth0-tx-25718-21ssh12:10:052
29725040,0irq/27-eth0-tx-18917-21sshd10:45:552
29725040,0irq/27-eth0-tx-13483-21cpu09:24:362
29725040,0irq/27-eth0-tx-11890-21munin-node11:24:352
29725040,0irq/27-eth0-tx-0-21swapper/211:39:322
29725040,0irq/27-eth0-tx-0-21swapper/210:06:292
29725040,0irq/27-eth0-tx-0-21swapper/210:00:022
29725040,0irq/27-eth0-tx-0-21swapper/209:44:382
29725040,0irq/27-eth0-tx-0-21swapper/209:31:232
29725040,0irq/27-eth0-tx-0-21swapper/209:19:362
29725040,0irq/27-eth0-tx-0-21swapper/209:14:422
29725040,0irq/27-eth0-tx-0-21swapper/209:09:462
29725040,0irq/27-eth0-tx-0-21swapper/007:02:040
29715040,0irq/26-eth0-rx-17772-21taskset07:06:173
29715040,0irq/26-eth0-rx-0-21swapper/312:14:413
29715040,0irq/26-eth0-rx-0-21swapper/311:38:003
29715040,0irq/26-eth0-rx-0-21swapper/310:54:413
29715040,0irq/26-eth0-rx-0-21swapper/310:35:253
29715040,0irq/26-eth0-rx-0-21swapper/309:20:273
29715040,0irq/26-eth0-rx-0-21swapper/307:09:403
259940,0migration/26958-21kthreadcore06:59:432
259940,0migration/26386-21runrttasks07:45:342
259940,0migration/229465-21df_abs09:54:352
259940,0migration/227819-21kthreadcore07:39:452
259940,0migration/227786-21cpuspeed_turbos12:14:362
259940,0migration/216088-21kthreadcore07:54:422
259940,0migration/215934-21kthreadcore07:04:422
259940,0migration/212973-21unixbench_singl07:49:492
259940,0migration/212767-21irqrtprio12:04:412
249940,0watchdog/228875-21ssh10:14:312
249940,0watchdog/20-21swapper/210:49:352
249940,0watchdog/20-21swapper/209:04:352
179940,0migration/18707-21kthreadcore09:39:431
179940,0migration/14861-21cpuspeed_turbos10:19:361
179940,0migration/132302-21fschecks_time07:19:391
179940,0migration/129410-21hddtemp_smartct10:34:361
179940,0migration/127814-21kthreadcore07:39:451
179940,0migration/124958-21sensors_fan07:34:471
179940,0migration/117988-21kthreadcore08:44:431
179940,0migration/115409-21kthreadcore10:04:421
179940,0migration/113806-21fschecks_count09:24:371
179940,0migration/11187-21kthreadcore10:54:421
179940,0migration/111050-21kthreadcore08:14:421
179940,0migration/110138-21kthreadcore06:59:441
169940,0watchdog/120805-21ssh10:49:351
169940,0watchdog/120683-21fschecks_count11:09:391
169940,0watchdog/10-21swapper/111:57:591
169940,0watchdog/10-21swapper/108:39:401
169940,0watchdog/10-21swapper/107:14:481
169940,0watchdog/10-21swapper/107:09:401
149940,0migration/05636-21kthreadcore11:59:400
149940,0migration/026921-21runrttasks08:04:270
149940,0migration/026006-21kthreadcore09:49:410
149940,0migration/020819-21fschecks_time11:09:390
149940,0migration/01517-21kthreadcore09:14:420
149940,0migration/01469-21kthreadcore07:19:420
149940,0migration/012586-21latency_hist07:29:250
339930,0migration/318882-21runrttasks07:32:153
304259933,0cyclictest3556-21lldpd08:49:351
304259932,0cyclictest3057-21awk08:34:401
304259932,0cyclictest28379-21awk12:14:381
304259932,0cyclictest21998-21awk09:49:391
304259932,0cyclictest19946-21grep12:09:371
304249933,0cyclictest798-21kworker/0:012:14:320
304249933,0cyclictest798-21kworker/0:011:39:420
304249933,0cyclictest798-21kworker/0:010:59:300
304249933,0cyclictest798-21kworker/0:010:39:280
304249933,0cyclictest798-21kworker/0:010:34:320
304249933,0cyclictest798-21kworker/0:010:24:260
304249933,0cyclictest798-21kworker/0:010:09:300
304249933,0cyclictest798-21kworker/0:008:24:270
304249933,0cyclictest798-21kworker/0:007:44:450
304249933,0cyclictest798-21kworker/0:007:34:370
304249933,0cyclictest798-21kworker/0:007:09:390
304249933,0cyclictest798-21kworker/0:006:54:330
304249930,0cyclictest22840-21perl08:49:380
29715030,0irq/26-eth0-rx-0-21swapper/311:49:263
29715030,0irq/26-eth0-rx-0-21swapper/307:59:363
29715030,0irq/26-eth0-rx-0-21swapper/307:21:203
29715030,0irq/26-eth0-rx-0-21swapper/306:59:383
179930,0migration/129946-21fschecks_time09:34:371
179930,0migration/113201-21runrttasks07:51:591
169930,0watchdog/128611-21diskmemload11:44:351
169930,0watchdog/10-21swapper/111:49:271
169930,0watchdog/10-21swapper/110:09:551
304259920,0cyclictest0-21swapper/107:59:251
304259920,0cyclictest0-21swapper/107:54:271
29715020,0irq/26-eth0-rx-0-21swapper/308:49:313
29715020,0irq/26-eth0-rx-0-21swapper/308:19:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional