You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 23:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Dec 17, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1323925655,0sleep00-21swapper/007:06:380
1349623725,0sleep10-21swapper/107:09:361
1324823627,0sleep30-21swapper/307:06:453
1310223425,0sleep20-21swapper/207:05:042
13566991313,0cyclictest0-21swapper/209:09:552
339960,0migration/34850-21sh10:35:553
339960,0migration/329693-21switchtime09:34:563
339960,0migration/329584-21munin-node11:29:503
339960,0migration/322733-21sh09:33:133
339960,0migration/322406-21sh10:46:423
339960,0migration/321779-21sh10:29:353
339960,0migration/314943-21switchtime09:44:563
29715060,0irq/26-eth0-rx-23078-21port_sshpriv12:19:533
29715060,0irq/26-eth0-rx-15713-21diskstats11:59:463
259960,0migration/232099-21sh12:09:182
149960,0migration/021234-21sh10:28:350
135659960,0cyclictest11656-21diskmemload11:29:421
339950,0migration/37788-21munin-node12:29:523
339950,0migration/34608-21kthreadcore11:14:523
339950,0migration/34098-21munin-node08:14:493
339950,0migration/330925-21fschecks_time11:49:463
339950,0migration/330769-21sh12:06:273
339950,0migration/328334-21kthreadcore12:24:513
339950,0migration/325702-21munin-node07:14:533
339950,0migration/325525-21switchtime11:24:563
339950,0migration/324355-21cpuspeed_turbos10:49:463
339950,0migration/324147-21latency_hist08:54:363
339950,0migration/324025-21sh09:50:203
339950,0migration/321431-21aten2.4-expect07:39:473
339950,0migration/317294-21munin-node09:09:543
339950,0migration/316261-21latency12:34:513
339950,0migration/315918-21irqrtprio07:34:523
339950,0migration/315669-21aten_r1power_en07:59:463
339950,0migration/314880-21unixbench_multi12:14:553
339950,0migration/312632-21kthreadcore08:19:513
339950,0migration/31140-21munin-node12:09:483
29725050,0irq/27-eth0-tx-32636-21munin-node10:54:582
29725050,0irq/27-eth0-tx-24451-21diskstats10:49:472
29725050,0irq/27-eth0-tx-17723-21munin-node09:49:452
29725050,0irq/27-eth0-tx-16870-21cut10:44:502
29725050,0irq/27-eth0-tx-11909-21munin-node09:09:500
29725050,0irq/27-eth0-tx-11656-21diskmemload11:56:592
29725050,0irq/27-eth0-tx-0-21swapper/212:34:502
29725050,0irq/27-eth0-tx-0-21swapper/211:42:512
29725050,0irq/27-eth0-tx-0-21swapper/211:05:312
29725050,0irq/27-eth0-tx-0-21swapper/210:24:492
29725050,0irq/27-eth0-tx-0-21swapper/210:13:092
29725050,0irq/27-eth0-tx-0-21swapper/210:03:342
29725050,0irq/27-eth0-tx-0-21swapper/008:51:190
29725050,0irq/27-eth0-tx-0-21swapper/007:19:490
29725050,0irq/27-eth0-tx-0-21swapper/007:09:480
29715050,0irq/26-eth0-rx-8331-21ssh09:43:353
29715050,0irq/26-eth0-rx-71112sleep311:54:473
29715050,0irq/26-eth0-rx-31394-21kthreadcore10:14:523
29715050,0irq/26-eth0-rx-28214-21ssh10:30:053
29715050,0irq/26-eth0-rx-28053-21ssh10:14:263
29715050,0irq/26-eth0-rx-27431-21port_sshpriv11:44:543
29715050,0irq/26-eth0-rx-18449-21hwlatdetect11:04:483
29715050,0irq/26-eth0-rx-13035-21ssh10:24:293
29715050,0irq/26-eth0-rx-10694-21users11:34:583
29715050,0irq/26-eth0-rx-0-21swapper/311:39:453
29715050,0irq/26-eth0-rx-0-21swapper/311:20:413
29715050,0irq/26-eth0-rx-0-21swapper/311:09:533
29715050,0irq/26-eth0-rx-0-21swapper/310:06:543
29715050,0irq/26-eth0-rx-0-21swapper/309:59:543
29715050,0irq/26-eth0-rx-0-21swapper/309:57:493
29715050,0irq/26-eth0-rx-0-21swapper/309:24:563
29715050,0irq/26-eth0-rx-0-21swapper/308:39:523
29715050,0irq/26-eth0-rx-0-21swapper/308:39:523
29715050,0irq/26-eth0-rx-0-21swapper/308:04:513
29715050,0irq/26-eth0-rx-0-21swapper/307:19:523
27150,0ktimersoftd/20-21swapper/211:48:222
259950,0migration/26950-21kthreadcore10:19:502
259950,0migration/228739-21fschecks_count11:29:472
259950,0migration/219161-21sh11:24:072
259950,0migration/217866-21taskset10:05:562
259950,0migration/216834-21irqrtprio07:59:512
259950,0migration/211711-21kthreadcore10:39:522
259950,0migration/210358-21sh11:18:412
179950,0migration/19066-21aten_r1power_po10:59:461
179950,0migration/14145-21taskset09:21:461
179950,0migration/132296-21unixbench-2d09:54:571
179950,0migration/123613-21kthreadcore07:39:521
179950,0migration/122615-21df_abs08:04:471
179950,0migration/116856-21kthreadcore10:24:491
179950,0migration/115861-21unixbench_multi08:19:571
179950,0migration/114890-21sh10:44:031
179950,0migration/111730-21sendmail_mailqu09:24:571
169950,0watchdog/115402-21gltestperf07:34:501
149950,0migration/07915-21latency_hist07:29:360
149950,0migration/0602-21kthreadcore10:34:510
149950,0migration/03650-21taskset08:35:570
149950,0migration/029472-21irqcore11:29:500
149950,0migration/027382-21irqcore09:54:500
149950,0migration/026131-21latency_hist11:09:350
149950,0migration/025911-21mdstat09:14:520
149950,0migration/025212-21munin-node08:54:520
149950,0migration/024076-21kthreadcore10:09:520
149950,0migration/017239-21kthreadcore07:59:510
149950,0migration/015851-21irqrtprio07:34:520
149950,0migration/01418-21kthreadcore11:49:500
149950,0migration/013684-21kthreadcore10:59:520
149950,0migration/013413-21cpuspeed_turbos11:39:450
149950,0migration/011098-21latency_hist10:04:350
135669955,0cyclictest19129-21strings07:09:572
135669950,0cyclictest0-21swapper/212:04:182
135669950,0cyclictest0-21swapper/209:58:572
135669950,0cyclictest0-21swapper/209:35:282
135659955,0cyclictest11656-21diskmemload10:30:251
135659955,0cyclictest0-21swapper/111:52:521
135659955,0cyclictest0-21swapper/110:11:111
135659955,0cyclictest0-21swapper/109:54:001
135659955,0cyclictest0-21swapper/107:49:361
135649955,0cyclictest26438-21kworker/0:112:34:560
135649955,0cyclictest26438-21kworker/0:112:29:520
135649955,0cyclictest26438-21kworker/0:112:25:400
135649955,0cyclictest26438-21kworker/0:112:19:540
135649955,0cyclictest26438-21kworker/0:112:16:000
135649955,0cyclictest26438-21kworker/0:112:10:400
135649955,0cyclictest26438-21kworker/0:112:04:440
135649955,0cyclictest26438-21kworker/0:112:02:260
135649955,0cyclictest26438-21kworker/0:111:56:100
135649955,0cyclictest26438-21kworker/0:111:44:440
135649955,0cyclictest26438-21kworker/0:111:34:500
135649955,0cyclictest26438-21kworker/0:111:24:540
135649955,0cyclictest26438-21kworker/0:111:20:380
135649955,0cyclictest26438-21kworker/0:111:15:280
135649955,0cyclictest26438-21kworker/0:111:04:400
135649955,0cyclictest26438-21kworker/0:110:49:520
135649955,0cyclictest26438-21kworker/0:110:45:020
135649955,0cyclictest26438-21kworker/0:110:40:120
135649955,0cyclictest26438-21kworker/0:110:29:440
135649955,0cyclictest26438-21kworker/0:110:20:400
135649955,0cyclictest26438-21kworker/0:110:14:540
135649955,0cyclictest26438-21kworker/0:109:50:350
135649955,0cyclictest26438-21kworker/0:109:44:590
135649955,0cyclictest26438-21kworker/0:109:41:070
135649955,0cyclictest26438-21kworker/0:109:35:150
135649955,0cyclictest26438-21kworker/0:109:30:190
135649955,0cyclictest26438-21kworker/0:109:25:390
135649955,0cyclictest26438-21kworker/0:109:19:530
135649955,0cyclictest26438-21kworker/0:108:44:530
135649955,0cyclictest0-21swapper/010:56:220
135649950,0cyclictest0-21swapper/010:00:340
135649950,0cyclictest0-21swapper/008:19:590
339940,0migration/36012-21kthreadcore07:24:533
339940,0migration/332348-21kthreadcore08:34:523
339940,0migration/32805-21taskset08:12:433
339940,0migration/319779-21runrttasks07:10:123
339940,0migration/317007-21taskset08:45:443
339940,0migration/31324-21irqcore10:54:513
339940,0migration/312126-21kthreadcore07:29:523
339940,0migration/311584-21taskset09:09:063
29725040,0irq/27-eth0-tx-5983-21telnet09:24:462
29725040,0irq/27-eth0-tx-4553-21munin-node11:34:462
29725040,0irq/27-eth0-tx-27299-21irqcore11:09:492
29725040,0irq/27-eth0-tx-1453-21kthreadcore12:09:492
29725040,0irq/27-eth0-tx-0-21swapper/212:25:112
29725040,0irq/27-eth0-tx-0-21swapper/212:19:442
29725040,0irq/27-eth0-tx-0-21swapper/211:49:482
29725040,0irq/27-eth0-tx-0-21swapper/210:59:472
29725040,0irq/27-eth0-tx-0-21swapper/210:29:362
29725040,0irq/27-eth0-tx-0-21swapper/210:14:522
29725040,0irq/27-eth0-tx-0-21swapper/209:45:242
29725040,0irq/27-eth0-tx-0-21swapper/209:14:482
29725040,0irq/27-eth0-tx-0-21swapper/007:39:460
29715040,0irq/26-eth0-rx-0-21swapper/310:59:413
29715040,0irq/26-eth0-rx-0-21swapper/310:39:363
29715040,0irq/26-eth0-rx-0-21swapper/309:19:373
29715040,0irq/26-eth0-rx-0-21swapper/309:14:503
259940,0migration/29450-21kthreadcore07:29:512
259940,0migration/232703-21kthreadcore08:59:522
259940,0migration/22993-21gltestperf12:29:472
259940,0migration/229877-21fschecks_count09:19:492
259940,0migration/229871-21smart_sda08:54:572
259940,0migration/225123-21kthreadcore08:29:532
259940,0migration/21758-21kthreadcore09:39:512
259940,0migration/21050-21kthreadcore08:09:522
249940,0watchdog/29712-21grep09:04:542
249940,0watchdog/221395-21iostat07:14:502
249940,0watchdog/215404-21gltestperf07:34:502
249940,0watchdog/214501-21proc_pri12:14:532
249940,0watchdog/20-21swapper/208:44:542
179940,0migration/18830-21diskmemload12:14:421
179940,0migration/17569-21taskset07:27:101
179940,0migration/16229-21kthreadcore08:39:511
179940,0migration/16229-21kthreadcore08:39:511
179940,0migration/15991-21taskset09:39:531
179940,0migration/14016-21diskmemload10:18:421
179940,0migration/130389-21taskset08:56:561
179940,0migration/129173-21kthreadcore11:09:501
179940,0migration/123807-21latency_hist12:04:351
179940,0migration/123806-21aten_r1power_cu09:34:451
179940,0migration/122142-21kthreadcore12:19:501
179940,0migration/118800-21kthreadcore09:29:521
179940,0migration/118015-21df_abs11:04:471
179940,0migration/116649-21ntp_kernel_pll_11:19:541
179940,0migration/114389-21runrttasks07:34:031
179940,0migration/110481-21kthreadcore11:54:511
169940,0watchdog/18920-21ssh10:00:171
169940,0watchdog/13257-21if_eth1.312:29:491
169940,0watchdog/121506-21sh09:14:501
169940,0watchdog/121020-21ssh11:43:371
169940,0watchdog/112721-21basename09:09:501
169940,0watchdog/10-21swapper/108:59:541
149940,0migration/032218-21kthreadcore08:09:510
135669944,0cyclictest3985-21sadc08:39:362
135669943,0cyclictest5121-21awk08:39:492
135669943,0cyclictest5121-21awk08:39:492
135669943,0cyclictest4127-21awk08:14:502
135669943,0cyclictest3556-21lldpd08:49:482
135669943,0cyclictest3514-21snmpd07:49:532
135669943,0cyclictest3514-21snmpd07:42:232
135669943,0cyclictest3514-21snmpd07:24:082
135669943,0cyclictest31449-21awk10:34:482
135669943,0cyclictest2273-21awk07:24:512
135669943,0cyclictest20674-21awk11:24:492
135669943,0cyclictest17509-21awk08:24:512
135669943,0cyclictest15919-21awk09:29:502
135669943,0cyclictest10830-21awk08:19:492
135659944,0cyclictest0-21swapper/112:37:581
135659944,0cyclictest0-21swapper/111:25:451
135659944,0cyclictest0-21swapper/110:54:041
135659944,0cyclictest0-21swapper/110:08:301
135659943,0cyclictest5440-21awk11:34:501
135659943,0cyclictest4097-21awk08:14:491
135659943,0cyclictest3556-21lldpd12:12:481
135659943,0cyclictest3556-21lldpd10:20:181
135659943,0cyclictest3556-21lldpd09:07:181
135659943,0cyclictest3556-21lldpd08:26:471
135659943,0cyclictest3556-21lldpd07:46:171
135659943,0cyclictest3514-21snmpd09:48:081
135659943,0cyclictest3514-21snmpd08:47:381
135659943,0cyclictest3514-21snmpd08:36:081
135659943,0cyclictest27063-21awk12:24:501
135659943,0cyclictest26798-21sadc07:19:361
135659943,0cyclictest16312-21awk11:59:491
135659943,0cyclictest14659-21awk07:09:511
135649944,0cyclictest26438-21kworker/0:108:59:490
135649944,0cyclictest26438-21kworker/0:108:39:590
135649944,0cyclictest26438-21kworker/0:108:39:590
135649944,0cyclictest26438-21kworker/0:108:14:410
135649944,0cyclictest26438-21kworker/0:108:04:470
135649944,0cyclictest26438-21kworker/0:107:54:590
135649944,0cyclictest26438-21kworker/0:107:49:390
135649944,0cyclictest26438-21kworker/0:107:45:250
135649944,0cyclictest26438-21kworker/0:107:29:390
135649944,0cyclictest26438-21kworker/0:107:15:390
135649943,0cyclictest24112-21awk08:29:510
135649943,0cyclictest17533-21awk08:24:510
135649941,0cyclictest0-21swapper/009:04:470
35130,0ktimersoftd/30-21swapper/307:46:503
29715030,0irq/26-eth0-rx-0-21swapper/308:59:503
29715030,0irq/26-eth0-rx-0-21swapper/308:49:463
29715030,0irq/26-eth0-rx-0-21swapper/308:32:453
29715030,0irq/26-eth0-rx-0-21swapper/308:26:073
29715030,0irq/26-eth0-rx-0-21swapper/307:55:073
29715030,0irq/26-eth0-rx-0-21swapper/307:49:463
249930,0watchdog/20-21swapper/208:04:462
249930,0watchdog/20-21swapper/207:44:462
169930,0watchdog/16559-21runrttasks10:44:411
169930,0watchdog/131575-21if_eth1.310:34:491
169930,0watchdog/10-21swapper/110:55:011
169930,0watchdog/10-21swapper/108:49:501
169930,0watchdog/10-21swapper/108:29:581
169930,0watchdog/10-21swapper/107:59:461
135669932,0cyclictest14620-21sensors07:54:582
135659933,0cyclictest22726-21awk11:44:491
135659932,0cyclictest2688-21tr11:14:471
135659931,0cyclictest0-21swapper/108:09:511
169920,0watchdog/10-21swapper/107:54:381
169920,0watchdog/10-21swapper/107:19:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional