You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 21:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue May 26, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
599923826,0sleep20-21swapper/206:52:072
304450350,0irq/25-eth10-21swapper/306:49:463
611423430,0sleep10-21swapper/106:53:301
583423127,0sleep00-21swapper/006:50:120
62869976,0cyclictest0-21swapper/107:54:551
62879960,0cyclictest188132sleep212:03:282
62869960,0cyclictest0-21swapper/111:06:471
339960,0migration/320468-21sh09:03:483
339960,0migration/319088-21sh10:00:263
339960,0migration/314727-21missed_timers08:09:493
29715060,0irq/26-eth0-rx-26432-21sh07:29:543
29715060,0irq/26-eth0-rx-0-21swapper/311:32:233
19160,0ktimersoftd/10-21swapper/111:41:191
19160,0ktimersoftd/10-21swapper/110:14:261
149960,0migration/025680-21needreboot11:04:490
149960,0migration/013970-21kthreadcore08:09:490
149960,0migration/010789-21munin-node09:14:530
62879955,0cyclictest0-21swapper/209:43:002
62879954,0cyclictest11328-21awk08:34:462
62879950,0cyclictest0-21swapper/211:48:392
62879950,0cyclictest0-21swapper/209:32:172
62869955,0cyclictest0-21swapper/111:23:201
62869955,0cyclictest0-21swapper/111:10:251
62869955,0cyclictest0-21swapper/110:24:321
62869950,0cyclictest0-21swapper/111:17:021
62869950,0cyclictest0-21swapper/110:03:431
62859954,0cyclictest5089-21awk10:34:450
62859954,0cyclictest3663-21munin-node11:34:460
62859954,0cyclictest3514-21snmpd10:45:540
62859953,0cyclictest21566-21kworker/0:010:24:460
339950,0migration/39499-21kthreadcore09:14:493
339950,0migration/3610-21kthreadcore09:49:493
339950,0migration/34885-21aten_r1power_cu09:34:403
339950,0migration/33252-21taskset10:11:543
339950,0migration/3320-21kthreadcore08:49:463
339950,0migration/330289-21irqcore09:29:463
339950,0migration/328511-21kthreadcore07:09:483
339950,0migration/328163-21fschecks_time12:09:413
339950,0migration/32793-21aten_r1power_vo08:04:403
339950,0migration/325900-21munin-node11:24:533
339950,0migration/325114-21kthreadcore09:04:483
339950,0migration/325114-21kthreadcore09:04:483
339950,0migration/323163-21kthreadcore07:54:493
339950,0migration/320234-21fschecks_count11:44:443
339950,0migration/319548-21aten_r1power_fr12:04:423
339950,0migration/319279-21taskset07:00:523
339950,0migration/31738-21kthreadcore08:24:493
339950,0migration/316195-21kthreadcore09:39:473
339950,0migration/313393-21kthreadcore12:19:483
339950,0migration/312423-21munin-node10:39:403
29725050,0irq/27-eth0-tx-7910-21cut11:14:472
29725050,0irq/27-eth0-tx-4301-21fschecks_time11:34:442
29725050,0irq/27-eth0-tx-22376-21kthreadcore09:04:472
29725050,0irq/27-eth0-tx-22376-21kthreadcore09:04:472
29725050,0irq/27-eth0-tx-0-21swapper/211:43:212
29725050,0irq/27-eth0-tx-0-21swapper/211:11:022
29725050,0irq/27-eth0-tx-0-21swapper/007:26:280
29725050,0irq/27-eth0-tx-0-21swapper/007:14:480
29715050,0irq/26-eth0-rx-4836-21iostat11:14:453
29715050,0irq/26-eth0-rx-25851-21proc_pri11:04:513
29715050,0irq/26-eth0-rx-24965-21cut09:24:483
29715050,0irq/26-eth0-rx-22232-21kernelversion09:44:473
29715050,0irq/26-eth0-rx-18555-40yum-updatesd-he11:41:493
29715050,0irq/26-eth0-rx-14449-21cut11:59:473
29715050,0irq/26-eth0-rx-0-21swapper/312:16:083
29715050,0irq/26-eth0-rx-0-21swapper/311:20:193
29715050,0irq/26-eth0-rx-0-21swapper/311:11:103
29715050,0irq/26-eth0-rx-0-21swapper/310:59:483
29715050,0irq/26-eth0-rx-0-21swapper/310:45:583
29715050,0irq/26-eth0-rx-0-21swapper/310:34:473
29715050,0irq/26-eth0-rx-0-21swapper/310:26:283
29715050,0irq/26-eth0-rx-0-21swapper/310:20:083
29715050,0irq/26-eth0-rx-0-21swapper/310:15:293
29715050,0irq/26-eth0-rx-0-21swapper/310:05:393
29715050,0irq/26-eth0-rx-0-21swapper/309:56:493
29715050,0irq/26-eth0-rx-0-21swapper/309:19:483
27150,0ktimersoftd/20-21swapper/210:20:412
27150,0ktimersoftd/20-21swapper/209:21:432
259950,0migration/226933-21sh11:27:272
259950,0migration/217824-21munin-node10:59:512
259950,0migration/211596-21sh10:58:432
249950,0watchdog/224985-21cut10:24:492
249950,0watchdog/20-21swapper/211:29:492
19150,0ktimersoftd/10-21swapper/111:00:241
179950,0migration/14044-21sh09:12:521
179950,0migration/130759-21kthreadcore10:49:481
179950,0migration/129805-21idleruntime09:49:461
179950,0migration/123869-21kthreadcore10:04:471
179950,0migration/123057-21kthreadcore09:44:471
179950,0migration/120356-21taskset09:43:411
179950,0migration/114871-21gltestperf07:24:441
149950,0migration/09411-21kthreadcore09:34:470
149950,0migration/08539-21latency12:14:480
149950,0migration/06601-21kthreadcore11:14:470
149950,0migration/04997-21kthreadcore08:29:470
149950,0migration/030599-21cpuspeed_turbos08:49:420
149950,0migration/030262-21kthreadcore11:49:480
149950,0migration/030185-21kthreadcore10:29:470
149950,0migration/029330-21aten_r1power_fr09:09:420
149950,0migration/029033-21cpuspeed_turbos10:09:410
149950,0migration/028965-21munin-node11:29:460
149950,0migration/028259-21munin-node12:09:410
149950,0migration/024616-21kthreadcore11:24:480
149950,0migration/02420-21switchtime09:49:540
149950,0migration/021462-21fschecks_time10:04:440
149950,0migration/021173-21cpuspeed_turbos09:44:430
149950,0migration/021060-21cpuspeed_turbos07:29:440
149950,0migration/02103-21taskset11:10:330
149950,0migration/018678-21kthreadcore08:14:470
149950,0migration/013415-21fschecks_time08:59:450
149950,0migration/012005-21aten_r1power_po11:19:420
62879944,0cyclictest10808-21vmstat08:54:552
62879944,0cyclictest0-21swapper/211:05:082
62879943,0cyclictest8396-21awk07:19:462
62879943,0cyclictest5789-21awk09:14:452
62879943,0cyclictest3556-21lldpd09:55:242
62879943,0cyclictest3556-21lldpd08:40:192
62879943,0cyclictest3556-21lldpd08:26:492
62879943,0cyclictest3556-21lldpd07:45:202
62879943,0cyclictest3556-21lldpd07:09:192
62879943,0cyclictest3514-21snmpd08:13:082
62879943,0cyclictest3514-21snmpd07:52:082
62879943,0cyclictest31231-21awk08:49:442
62879943,0cyclictest29836-21awk09:49:462
62879943,0cyclictest29771-21awk10:09:442
62879943,0cyclictest29364-21awk10:49:462
62879943,0cyclictest27323-21awk07:09:462
62879943,0cyclictest22648-21awk07:54:472
62879943,0cyclictest21888-21awk09:44:462
62879943,0cyclictest17025-21awk08:14:462
62879943,0cyclictest1633-21awk07:14:472
62879943,0cyclictest13161-21awk10:39:432
62879943,0cyclictest12780-21awk11:19:452
62869944,0cyclictest17711-21kthreadcore08:14:471
62869944,0cyclictest0-21swapper/110:29:351
62869943,0cyclictest7472-21awk06:54:461
62869943,0cyclictest5583-21awk09:54:451
62869943,0cyclictest3556-21lldpd12:15:261
62869943,0cyclictest3556-21lldpd09:35:541
62869943,0cyclictest3514-21snmpd11:47:241
62869943,0cyclictest3514-21snmpd08:01:381
62869943,0cyclictest3514-21snmpd07:45:231
62869943,0cyclictest3514-21snmpd07:21:531
62869943,0cyclictest30212-21awk08:24:461
62869943,0cyclictest29120-21sadc08:24:311
62869943,0cyclictest28324-21awk07:34:451
62869943,0cyclictest17851-21awk08:39:431
62869943,0cyclictest10232-21awk08:09:461
62869943,0cyclictest10119-21sadc08:34:311
62859944,0cyclictest7536-21kworker/0:207:49:510
62859944,0cyclictest0-21swapper/009:57:060
62859943,0cyclictest5376-21awk10:14:450
62859943,0cyclictest3514-21snmpd08:56:530
62859943,0cyclictest3241-21irqbalance09:27:190
62859943,0cyclictest3241-21irqbalance09:19:390
62859943,0cyclictest2553-21awk07:39:450
62859943,0cyclictest21566-21kworker/0:010:41:320
62859943,0cyclictest20408-21awk12:04:450
62859940,0cyclictest0-21swapper/009:59:380
339940,0migration/39527-21irqcore07:44:473
339940,0migration/37950-21kthreadcore08:29:483
339940,0migration/35011-21kthreadcore07:39:483
339940,0migration/326103-21kthreadcore08:44:483
339940,0migration/322989-21kthreadcore07:04:493
339940,0migration/311234-21kthreadcore06:54:483
29725040,0irq/27-eth0-tx-27882-21telnet11:49:432
29725040,0irq/27-eth0-tx-0-21swapper/212:09:552
29725040,0irq/27-eth0-tx-0-21swapper/210:34:552
29725040,0irq/27-eth0-tx-0-21swapper/210:30:212
29725040,0irq/27-eth0-tx-0-21swapper/210:14:382
29725040,0irq/27-eth0-tx-0-21swapper/210:04:522
29725040,0irq/27-eth0-tx-0-21swapper/209:59:462
29725040,0irq/27-eth0-tx-0-21swapper/209:35:412
29725040,0irq/27-eth0-tx-0-21swapper/209:24:482
29725040,0irq/27-eth0-tx-0-21swapper/209:09:482
29725040,0irq/27-eth0-tx-0-21swapper/008:46:440
29725040,0irq/27-eth0-tx-0-21swapper/008:34:430
29725040,0irq/27-eth0-tx-0-21swapper/008:24:490
29725040,0irq/27-eth0-tx-0-21swapper/007:04:510
29715040,0irq/26-eth0-rx-0-21swapper/311:55:373
29715040,0irq/26-eth0-rx-0-21swapper/311:49:473
29715040,0irq/26-eth0-rx-0-21swapper/311:34:383
29715040,0irq/26-eth0-rx-0-21swapper/310:56:303
29715040,0irq/26-eth0-rx-0-21swapper/310:49:483
29715040,0irq/26-eth0-rx-0-21swapper/310:29:373
29715040,0irq/26-eth0-rx-0-21swapper/308:54:423
29715040,0irq/26-eth0-rx-0-21swapper/307:34:483
259940,0migration/29778-21kthreadcore06:54:482
259940,0migration/25361-21kthreadcore08:04:452
259940,0migration/23218-21aten_r1power_po12:14:422
259940,0migration/230553-21kthreadcore07:59:472
259940,0migration/230456-21kthreadcore07:34:472
259940,0migration/224245-21kthreadcore08:19:482
259940,0migration/219863-21munin-node12:04:432
259940,0migration/217409-21kthreadcore06:59:482
259940,0migration/213544-21fschecks_time08:59:452
259940,0migration/211382-21cpu12:19:432
249940,0watchdog/27951-21kthreadcore11:54:492
249940,0watchdog/24518-21if_err_eth1.208:29:452
249940,0watchdog/20-21swapper/210:44:452
249940,0watchdog/20-21swapper/207:29:462
179940,0migration/15728-21kthreadcore11:34:481
179940,0migration/15023-21kthreadcore11:54:481
179940,0migration/132726-21taskset07:12:521
179940,0migration/131521-21kthreadcore12:09:451
179940,0migration/129911-21runrttasks08:46:591
179940,0migration/128240-21fschecks_count11:49:441
179940,0migration/119699-21cpuspeed_turbos12:04:421
179940,0migration/119226-21taskset10:21:321
179940,0migration/118787-21taskset10:40:551
179940,0migration/118683-21diskmemload08:59:541
179940,0migration/117650-21kthreadcore06:59:481
179940,0migration/114464-21sh09:19:471
169940,0watchdog/17209-21munin-node07:39:501
169940,0watchdog/15449-21grep08:04:451
169940,0watchdog/14020-21ssh10:54:371
169940,0watchdog/13436-21ssh09:31:171
169940,0watchdog/125317-21memory11:24:491
169940,0watchdog/121114-21users07:49:571
169940,0watchdog/10-21swapper/109:05:411
169940,0watchdog/10-21swapper/109:05:411
169940,0watchdog/10-21swapper/107:29:461
149940,0migration/014708-21kthreadcore11:39:460
149940,0migration/014064-21if_eth006:59:460
149940,0migration/013761-21mdstat07:44:490
149940,0migration/013521-21fschecks_time09:39:430
149940,0migration/011581-21aten_r1power_po11:59:410
62879933,0cyclictest3556-21lldpd08:47:192
62879932,0cyclictest2570-21awk07:39:462
62869932,0cyclictest5916-21awk09:14:471
62869932,0cyclictest3556-21lldpd10:34:551
62869932,0cyclictest3514-21snmpd07:16:261
62869932,0cyclictest21197-21awk10:44:461
62869932,0cyclictest14299-21tr08:34:481
62859933,0cyclictest7536-21kworker/0:209:30:020
62859933,0cyclictest7536-21kworker/0:209:04:320
62859933,0cyclictest7536-21kworker/0:209:04:320
62859933,0cyclictest7536-21kworker/0:208:39:440
62859933,0cyclictest7536-21kworker/0:208:19:330
62859933,0cyclictest7536-21kworker/0:208:04:330
62859933,0cyclictest7536-21kworker/0:207:59:390
62859933,0cyclictest7536-21kworker/0:207:54:350
62859933,0cyclictest7536-21kworker/0:207:19:330
62859933,0cyclictest7448-21awk06:54:460
62859933,0cyclictest4604-21kworker/0:212:19:320
62859933,0cyclictest4604-21kworker/0:211:54:320
62859933,0cyclictest4604-21kworker/0:211:44:340
62859933,0cyclictest21566-21kworker/0:010:59:360
62859933,0cyclictest21566-21kworker/0:010:54:320
62859933,0cyclictest21566-21kworker/0:010:49:320
62859933,0cyclictest21566-21kworker/0:010:19:360
62859930,0cyclictest26487-21munin-node07:09:430
339930,0migration/36919-21runrttasks07:15:593
29715030,0irq/26-eth0-rx-0-21swapper/309:10:083
29715030,0irq/26-eth0-rx-0-21swapper/308:19:443
29715030,0irq/26-eth0-rx-0-21swapper/308:14:423
29715030,0irq/26-eth0-rx-0-21swapper/307:59:423
29715030,0irq/26-eth0-rx-0-21swapper/307:51:063
249930,0watchdog/20-21swapper/207:24:462
169930,0watchdog/114351-21kthreadcore12:19:481
169930,0watchdog/10-21swapper/111:59:531
169930,0watchdog/10-21swapper/111:29:491
169930,0watchdog/10-21swapper/110:15:531
169930,0watchdog/10-21swapper/109:24:411
169930,0watchdog/10-21swapper/108:54:331
169930,0watchdog/10-21swapper/107:04:501
149930,0migration/027743-21df07:34:430
62869920,0cyclictest30354-21taskset08:49:331
35120,0ktimersoftd/315570-21latency08:34:493
29715020,0irq/26-eth0-rx-0-21swapper/308:39:413
29715020,0irq/26-eth0-rx-0-21swapper/307:24:353
29715020,0irq/26-eth0-rx-0-21swapper/307:19:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional