You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 19:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 19, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1902924333,0sleep30-21swapper/306:48:083
1927023525,0sleep20-21swapper/206:50:592
1909523524,0sleep00-21swapper/006:48:570
1934423026,0sleep10-21swapper/106:51:501
35170,0ktimersoftd/30-21swapper/312:12:253
339960,0migration/38910-21sh10:05:513
339960,0migration/36709-21munin-node11:22:333
339960,0migration/331327-21sh12:18:493
339960,0migration/316724-21sh09:09:293
339960,0migration/316660-21munin-node08:47:353
339960,0migration/316653-21sh09:49:433
29715060,0irq/26-eth0-rx-31622-21sh11:38:153
29715060,0irq/26-eth0-rx-24368-21ssh10:34:373
29715060,0irq/26-eth0-rx-20719-21kthreadcore09:32:313
29715060,0irq/26-eth0-rx-2040-21diskstats09:42:263
29715060,0irq/26-eth0-rx-15206-21ntp_kernel_pll_10:07:333
29715060,0irq/26-eth0-rx-13347-21cut10:27:303
27160,0ktimersoftd/20-21swapper/212:20:182
194539966,0cyclictest0-21swapper/209:40:332
194519966,0cyclictest9076-21ssh09:46:010
179960,0migration/11328-21taskset10:22:171
149960,0migration/02700-21kernelversion10:22:300
149960,0migration/025511-21sh10:37:140
149960,0migration/024754-21sh10:15:090
149960,0migration/023956-21sh10:53:380
149960,0migration/023365-21sh11:52:540
149960,0migration/016342-21sh12:11:460
149960,0migration/016342-21sh12:11:460
149960,0migration/015906-21sendmail_mailst08:22:360
8215050,0irq/24-0000:00:8102-21latency_hist07:32:142
339950,0migration/39358-21aten_r1power_cu07:57:243
339950,0migration/36651-21vmstat07:02:393
339950,0migration/34738-21cpuspeed_turbos08:42:283
339950,0migration/33921-21df_abs08:17:273
339950,0migration/332145-21taskset09:57:533
339950,0migration/331655-21kthreadcore07:22:313
339950,0migration/330605-21munin-node11:57:333
339950,0migration/328436-21kthreadcore10:57:303
339950,0migration/326574-21idleruntime10:17:263
339950,0migration/326389-21aten_r1power_en06:57:253
339950,0migration/325692-21latency_hist09:57:143
339950,0migration/325572-21latency_hist10:17:143
339950,0migration/325211-21kthreadcore08:32:303
339950,0migration/324054-21kthreadcore08:07:303
339950,0migration/32039-21munin-node09:22:263
339950,0migration/317316-21kthreadcore07:12:323
339950,0migration/315405-21munin-node07:37:263
339950,0migration/313349-21munin-node08:22:323
29725050,0irq/27-eth0-tx-24449-21ssh09:53:512
29725050,0irq/27-eth0-tx-22700-21open_inodes11:52:332
29725050,0irq/27-eth0-tx-2088-21irqrtprio11:42:312
29725050,0irq/27-eth0-tx-18067-21munin-node09:12:292
29725050,0irq/27-eth0-tx-17914-21munin-node08:52:250
29725050,0irq/27-eth0-tx-1634-21munin-node09:42:272
29725050,0irq/27-eth0-tx-1221-21munin-node10:42:252
29725050,0irq/27-eth0-tx-10837-21if_eth1.209:07:292
29725050,0irq/27-eth0-tx-1038-21munin-node11:22:342
29725050,0irq/27-eth0-tx-0-21swapper/211:32:302
29725050,0irq/27-eth0-tx-0-21swapper/210:52:262
29725050,0irq/27-eth0-tx-0-21swapper/210:47:182
29725050,0irq/27-eth0-tx-0-21swapper/209:57:362
29725050,0irq/27-eth0-tx-0-21swapper/008:27:250
29725050,0irq/27-eth0-tx-0-21swapper/007:42:340
29725050,0irq/27-eth0-tx-0-21swapper/007:23:560
29715050,0irq/26-eth0-rx-6838-21python11:42:373
29715050,0irq/26-eth0-rx-320-21kthreadcore08:37:303
29715050,0irq/26-eth0-rx-2875-21kthreadcore07:27:323
29715050,0irq/26-eth0-rx-26739-21kthreadcore11:17:293
29715050,0irq/26-eth0-rx-25620-21aten_r1power_en10:37:243
29715050,0irq/26-eth0-rx-2380-21irqrtprio11:02:303
29715050,0irq/26-eth0-rx-23498-21load09:12:313
29715050,0irq/26-eth0-rx-21043-21kthreadcore08:52:313
29715050,0irq/26-eth0-rx-19566-21cat10:52:293
29715050,0irq/26-eth0-rx-14972-21ntpq10:47:323
29715050,0irq/26-eth0-rx-0-21swapper/312:10:033
29715050,0irq/26-eth0-rx-0-21swapper/312:10:033
29715050,0irq/26-eth0-rx-0-21swapper/312:02:563
29715050,0irq/26-eth0-rx-0-21swapper/311:52:293
29715050,0irq/26-eth0-rx-0-21swapper/311:47:393
29715050,0irq/26-eth0-rx-0-21swapper/311:33:023
29715050,0irq/26-eth0-rx-0-21swapper/311:28:283
29715050,0irq/26-eth0-rx-0-21swapper/310:23:333
29715050,0irq/26-eth0-rx-0-21swapper/309:38:173
29715050,0irq/26-eth0-rx-0-21swapper/309:17:453
29715050,0irq/26-eth0-rx-0-21swapper/308:57:573
27150,0ktimersoftd/20-21swapper/209:31:242
259950,0migration/29177-21aten_r1power_fr11:47:262
259950,0migration/26803-21munin-node12:02:372
259950,0migration/26188-21munin-node07:02:362
259950,0migration/25796-21kthreadcore09:22:312
259950,0migration/230266-21kthreadcore07:47:312
259950,0migration/223456-21needreboot09:32:332
259950,0migration/223109-21latency10:12:322
259950,0migration/214997-21munin-node11:27:352
259950,0migration/211317-21kthreadcore12:07:282
259950,0migration/211317-21kthreadcore12:07:282
249950,0watchdog/215454-21unixbench-2d10:27:362
249950,0watchdog/215301-21kthreadcore08:22:322
194539955,0cyclictest0-21swapper/210:40:372
194539950,0cyclictest0-21swapper/211:57:142
194539950,0cyclictest0-21swapper/208:58:182
194539950,0cyclictest0-21swapper/208:32:172
194529954,0cyclictest26735-21awk08:57:301
194519955,0cyclictest17671-21diskmemload10:50:200
194519955,0cyclictest17671-21diskmemload09:36:140
19150,0ktimersoftd/10-21swapper/112:20:181
179950,0migration/17453-21aten_r1power_vo07:07:231
179950,0migration/16424-21kthreadcore08:42:331
179950,0migration/15650-21kthreadcore11:22:301
179950,0migration/129096-21latency_hist08:12:141
179950,0migration/124528-21sh11:35:561
179950,0migration/120059-21kthreadcore09:12:301
179950,0migration/117882-21aten_r1power_en09:52:251
179950,0migration/11153-21latency_hist10:22:141
179950,0migration/110926-21kthreadcore11:47:321
169950,0watchdog/132710-21ssh09:39:161
149950,0migration/08007-21missed_timers07:52:330
149950,0migration/06915-21kthreadcore09:02:330
149950,0migration/06543-21unixbench_multi07:02:380
149950,0migration/04386-21kthreadcore07:27:320
149950,0migration/032031-21sh08:57:580
149950,0migration/028708-21munin-node07:47:260
149950,0migration/028286-21kthreadcore09:57:300
149950,0migration/02684-21munin-node09:22:280
149950,0migration/025893-21latency07:17:330
149950,0migration/025511-21kthreadcore08:07:310
149950,0migration/024898-21aten_r1power_po12:17:250
149950,0migration/021590-21kthreadcore06:52:320
149950,0migration/018633-21irqrtprio11:12:280
149950,0migration/018382-21munin-node09:52:270
149950,0migration/017842-21irqcore12:12:290
149950,0migration/017611-21latency_hist09:52:140
149950,0migration/017022-21sh10:11:060
149950,0migration/015311-21sh09:27:310
149950,0migration/01311-21taskset09:21:370
149950,0migration/012352-21kthreadcore09:07:300
149950,0migration/011394-21kthreadcore11:47:320
149950,0migration/010560-21taskset08:42:420
149950,0migration/010137-21munin-node11:27:280
149950,0migration/010137-21idleruntime11:07:260
8215040,0irq/24-0000:00:11140-21cat08:47:142
339940,0migration/39976-21fschecks_time11:07:253
339940,0migration/37122-21diskmemload10:42:343
339940,0migration/34403-21kthreadcore07:52:313
339940,0migration/322413-21pmu-power08:27:343
339940,0migration/320743-21kthreadcore11:12:303
339940,0migration/315008-21kthreadcore09:27:313
29725040,0irq/27-eth0-tx-26264-21if_err_eth111:17:272
29725040,0irq/27-eth0-tx-0-21swapper/212:12:492
29725040,0irq/27-eth0-tx-0-21swapper/210:57:222
29725040,0irq/27-eth0-tx-0-21swapper/210:32:492
29725040,0irq/27-eth0-tx-0-21swapper/210:22:512
29725040,0irq/27-eth0-tx-0-21swapper/210:17:152
29725040,0irq/27-eth0-tx-0-21swapper/209:17:382
29725040,0irq/27-eth0-tx-0-21swapper/209:02:272
29725040,0irq/27-eth0-tx-0-21swapper/008:12:290
29715040,0irq/26-eth0-rx-0-21swapper/309:02:263
29715040,0irq/26-eth0-rx-0-21swapper/308:02:363
29715040,0irq/26-eth0-rx-0-21swapper/307:32:263
29715040,0irq/26-eth0-rx-0-21swapper/307:07:233
259940,0migration/24482-21latency_hist08:42:142
259940,0migration/24165-21kthreadcore10:02:322
259940,0migration/23875-21kthreadcore11:02:312
259940,0migration/229213-21kthreadcore06:57:322
259940,0migration/223043-21kthreadcore06:52:332
259940,0migration/222628-21latency_hist08:07:142
259940,0migration/220027-21kthreadcore08:02:332
259940,0migration/218292-21kthreadcore07:12:332
249940,0watchdog/29471-21kthreadcore07:07:292
249940,0watchdog/223694-21kthreadcore07:17:332
249940,0watchdog/20-21swapper/211:37:312
249940,0watchdog/20-21swapper/208:17:322
249940,0watchdog/20-21swapper/207:37:362
194539943,0cyclictest9265-21awk07:32:292
194539943,0cyclictest3514-21snmpd09:47:372
194539943,0cyclictest3514-21snmpd07:55:512
194539943,0cyclictest31088-21awk08:37:282
194539943,0cyclictest30203-21awk08:12:322
194539943,0cyclictest18810-21awk08:52:292
194539943,0cyclictest18364-21awk11:12:282
194539943,0cyclictest10676-21awk10:07:282
194539943,0cyclictest10162-21awk11:07:262
194529943,0cyclictest9656-21awk12:07:261
194529943,0cyclictest9656-21awk12:07:261
194529943,0cyclictest3556-21lldpd11:07:261
194529943,0cyclictest3516-21awk07:52:291
194529943,0cyclictest3514-21snmpd11:27:521
194529943,0cyclictest3514-21snmpd11:04:221
194529943,0cyclictest3514-21snmpd08:12:361
194529943,0cyclictest3241-21irqbalance08:54:221
194529943,0cyclictest26175-21awk11:37:281
194529943,0cyclictest26014-21awk11:57:281
194529943,0cyclictest2517-21awk07:27:301
194529943,0cyclictest2509-21awk09:42:281
194529943,0cyclictest2447-21awk10:02:301
194529943,0cyclictest22553-21awk07:42:281
194529943,0cyclictest18481-21awk10:32:281
194529943,0cyclictest18442-21awk10:52:281
194529943,0cyclictest17736-21awk12:12:281
194529943,0cyclictest12080-21awk08:47:301
194519944,0cyclictest0-21swapper/011:24:140
194519944,0cyclictest0-21swapper/011:18:240
194519943,0cyclictest3556-21lldpd07:39:550
194519943,0cyclictest3556-21lldpd07:09:550
194519943,0cyclictest3514-21snmpd08:36:060
194519943,0cyclictest3241-21irqbalance10:04:320
194519943,0cyclictest26358-21awk10:57:280
194519943,0cyclictest2067-21awk11:02:290
179940,0migration/17335-21taskset12:03:491
179940,0migration/14524-21kthreadcore07:02:321
179940,0migration/12998-21irqcore09:22:301
179940,0migration/129595-21kernelversion07:47:301
179940,0migration/126591-21irqcore11:17:281
179940,0migration/126207-21fschecks_time10:57:271
179940,0migration/123510-21latency_hist08:32:141
179940,0migration/117874-21cpu10:12:251
179940,0migration/117454-21runrttasks09:51:591
179940,0migration/117272-21taskset09:31:041
179940,0migration/113670-21kthreadcore09:07:311
169940,0watchdog/17700-21ssh11:44:031
169940,0watchdog/128220-21ethtool07:22:291
169940,0watchdog/121114-21grep07:17:291
169940,0watchdog/120884-21unixbench_multi07:37:361
169940,0watchdog/118267-21grep07:12:331
169940,0watchdog/115456-21unixbench-2d10:27:361
169940,0watchdog/110568-21if_err_eth1.310:07:281
169940,0watchdog/10-21swapper/110:45:041
169940,0watchdog/10-21swapper/109:32:321
169940,0watchdog/10-21swapper/109:20:321
169940,0watchdog/10-21swapper/109:02:201
169940,0watchdog/10-21swapper/108:22:321
169940,0watchdog/10-21swapper/108:17:321
169940,0watchdog/10-21swapper/106:52:331
149940,0migration/09521-21aten_r1power_cu10:27:230
149940,0migration/031673-21timerwakeupswit10:17:350
149940,0migration/020907-21kthreadcore08:02:330
149940,0migration/013763-21kthreadcore07:57:310
8215030,0irq/24-0000:00:0-21swapper/207:57:162
29715030,0irq/26-eth0-rx-0-21swapper/308:12:293
29715030,0irq/26-eth0-rx-0-21swapper/307:48:363
29715030,0irq/26-eth0-rx-0-21swapper/307:42:243
29715030,0irq/26-eth0-rx-0-21swapper/307:20:303
29715030,0irq/26-eth0-rx-0-21swapper/306:54:033
259930,0migration/227715-21taskset07:22:262
194539932,0cyclictest25882-21cut07:42:312
194529933,0cyclictest3556-21lldpd08:02:251
194529932,0cyclictest4273-21sadc08:42:141
194529932,0cyclictest3514-21snmpd09:57:221
194529932,0cyclictest27176-21awk06:57:291
194529932,0cyclictest17798-21awk08:27:291
194529932,0cyclictest13262-21kthreadcore07:57:311
194529932,0cyclictest10154-21kthreadcore07:32:311
194529932,0cyclictest10004-21tune2fs10:47:251
194519933,0cyclictest800-21kworker/0:212:02:170
194519933,0cyclictest800-21kworker/0:211:57:190
194519933,0cyclictest800-21kworker/0:211:42:170
194519933,0cyclictest18222-21kworker/0:011:37:170
194519933,0cyclictest18222-21kworker/0:011:32:150
194519933,0cyclictest14761-21kworker/0:110:42:150
194519933,0cyclictest14761-21kworker/0:110:32:190
194519933,0cyclictest14761-21kworker/0:109:12:250
194519933,0cyclictest14761-21kworker/0:108:47:270
194519933,0cyclictest14761-21kworker/0:108:37:190
194519933,0cyclictest14761-21kworker/0:107:32:180
194519933,0cyclictest13312-21kworker/0:007:12:260
194519933,0cyclictest13312-21kworker/0:006:57:200
194519932,0cyclictest3514-21snmpd08:17:210
194519932,0cyclictest26269-21cpuspeed_turbos09:37:250
169930,0watchdog/10-21swapper/111:53:111
169930,0watchdog/10-21swapper/111:15:161
169930,0watchdog/10-21swapper/110:37:361
249920,0watchdog/20-21swapper/208:27:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional