You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 16:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jul 17, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450360,0irq/25-eth10-21swapper/306:45:343
1684723430,0sleep20-21swapper/206:48:162
1681723424,0sleep10-21swapper/106:47:551
1663422622,0sleep00-21swapper/006:45:500
339970,0migration/328505-21munin-node10:49:563
339970,0migration/314948-21kthreadcore10:04:513
4160,0ktimersoftd/00-21swapper/010:38:100
339960,0migration/38450-21sh11:37:193
339960,0migration/321040-21sh10:29:233
339960,0migration/319365-21sh12:04:373
339960,0migration/312156-21kthreadcore11:19:513
339960,0migration/310274-21sh11:58:343
29715060,0irq/26-eth0-rx-10832-21cut10:39:513
29715060,0irq/26-eth0-rx-0-21swapper/311:50:353
29715060,0irq/26-eth0-rx-0-21swapper/309:27:023
27160,0ktimersoftd/20-21swapper/210:38:102
170299966,0cyclictest0-21swapper/111:19:571
170279965,0cyclictest26651-21kworker/0:008:25:300
170279965,0cyclictest0-21swapper/010:04:500
170279963,0cyclictest9393-21munin-run11:39:320
170279960,0cyclictest23568-21ssh11:26:210
170279960,0cyclictest0-21swapper/012:13:390
170279960,0cyclictest0-21swapper/010:49:460
4150,0ktimersoftd/00-21swapper/010:56:010
4150,0ktimersoftd/00-21swapper/009:56:570
339950,0migration/37836-21kthreadcore07:04:513
339950,0migration/36126-21sh09:00:353
339950,0migration/3557-21fschecks_time11:14:443
339950,0migration/34860-21unixbench_multi10:54:563
339950,0migration/34369-21sh10:36:493
339950,0migration/33756-21kthreadcore08:14:513
339950,0migration/331402-21taskset09:15:453
339950,0migration/329842-21kthreadcore08:34:513
339950,0migration/328734-21diskmemload12:09:473
339950,0migration/328343-21kthreadcore08:09:513
339950,0migration/327725-21kthreadcore07:19:513
339950,0migration/327725-21kthreadcore07:19:513
339950,0migration/327328-21munin-node09:34:503
339950,0migration/324561-21fschecks_time11:09:473
339950,0migration/324176-21sh11:44:553
339950,0migration/323774-21munin-node07:14:543
339950,0migration/319606-21runrttasks08:00:503
339950,0migration/319596-21kthreadcore09:09:503
339950,0migration/319141-21latency_hist07:39:343
339950,0migration/314866-21taskset08:45:053
339950,0migration/311228-21cpuspeed_turbos11:59:443
339950,0migration/310728-21taskset10:02:433
29725050,0irq/27-eth0-tx-32352-21ssh09:18:012
29725050,0irq/27-eth0-tx-29157-21cut11:09:522
29725050,0irq/27-eth0-tx-2018-21munin-node08:39:510
29725050,0irq/27-eth0-tx-11158-21ssh10:20:542
29725050,0irq/27-eth0-tx-0-21swapper/209:49:542
29725050,0irq/27-eth0-tx-0-21swapper/209:06:062
29715050,0irq/26-eth0-rx-11581-21kthreadcore11:39:483
29715050,0irq/26-eth0-rx-10560-21tr09:04:493
29715050,0irq/26-eth0-rx-10538-21munin-node09:44:513
29715050,0irq/26-eth0-rx-10268-21chrt12:15:403
29715050,0irq/26-eth0-rx-0-21swapper/311:25:093
29715050,0irq/26-eth0-rx-0-21swapper/311:02:243
29715050,0irq/26-eth0-rx-0-21swapper/310:47:393
29715050,0irq/26-eth0-rx-0-21swapper/310:29:343
29715050,0irq/26-eth0-rx-0-21swapper/310:24:033
29715050,0irq/26-eth0-rx-0-21swapper/310:14:483
29715050,0irq/26-eth0-rx-0-21swapper/310:10:263
29715050,0irq/26-eth0-rx-0-21swapper/309:56:573
29715050,0irq/26-eth0-rx-0-21swapper/309:49:513
29715050,0irq/26-eth0-rx-0-21swapper/309:29:483
29715050,0irq/26-eth0-rx-0-21swapper/309:21:583
29715050,0irq/26-eth0-rx-0-21swapper/308:54:523
27150,0ktimersoftd/20-21swapper/210:56:012
27150,0ktimersoftd/20-21swapper/209:56:572
259950,0migration/227132-21df_abs08:09:472
259950,0migration/22277-21latency_hist11:54:322
259950,0migration/220100-21latency_hist10:09:322
259950,0migration/217857-21unixbench-2d10:05:002
259950,0migration/217646-21hddtemp_smartct11:24:462
259950,0migration/216110-21fschecks_count11:04:452
259950,0migration/21478-21kthreadcore07:49:492
259950,0migration/213213-21kthreadcore09:44:512
259950,0migration/211117-21kthreadcore11:39:482
19150,0ktimersoftd/10-21swapper/110:38:101
19150,0ktimersoftd/10-21swapper/109:56:571
170309955,0cyclictest15271-21diskmemload10:41:312
170309955,0cyclictest0-21swapper/211:38:262
170309950,0cyclictest0-21swapper/212:17:132
170299950,0cyclictest0-21swapper/108:49:521
170279955,0cyclictest15271-21diskmemload09:36:090
170279955,0cyclictest0-21swapper/009:44:490
170279955,0cyclictest0-21swapper/009:30:570
170279950,0cyclictest0-21swapper/011:45:160
170279950,0cyclictest0-21swapper/010:45:400
170279950,0cyclictest0-21swapper/010:15:530
170279950,0cyclictest0-21swapper/010:10:210
179950,0migration/19613-21cpuspeed_turbos09:24:461
179950,0migration/19383-21timerwakeupswit09:59:591
179950,0migration/14462-21proc_pri10:54:531
179950,0migration/12780-21kthreadcore11:34:501
179950,0migration/124425-21gltestperf08:54:481
179950,0migration/120385-21kthreadcore07:14:501
179950,0migration/118208-21munin-node07:34:561
179950,0migration/11714-21hwlatdetect09:19:481
179950,0migration/110421-21sh11:58:551
149950,0migration/04554-21kthreadcore08:14:510
149950,0migration/032240-21fschecks_time07:24:470
149950,0migration/02898-21idleruntime09:39:460
149950,0migration/025965-21runrttasks12:06:000
149950,0migration/022898-21sendmail_mailqu06:49:550
149950,0migration/021563-21kthreadcore09:49:510
149950,0migration/02084-21kthreadcore11:14:480
149950,0migration/019256-21sh10:25:080
149950,0migration/019122-21latency_hist07:39:340
149950,0migration/017994-21taskset12:01:530
149950,0migration/017986-21kthreadcore09:09:500
8215040,0irq/24-0000:00:14229-21idleruntime-cro08:24:332
339940,0migration/38313-21fschecks_count08:19:473
339940,0migration/36607-21taskset07:54:193
339940,0migration/34500-21missed_timers07:24:533
339940,0migration/33994-21kthreadcore08:39:493
339940,0migration/330650-21sh06:59:453
339940,0migration/328868-21kthreadcore07:44:543
29725040,0irq/27-eth0-tx-4868-21kthreadcore08:59:502
29725040,0irq/27-eth0-tx-27901-21telnet08:34:450
29725040,0irq/27-eth0-tx-15296-21if_eth1.310:44:482
29725040,0irq/27-eth0-tx-0-21swapper/212:04:372
29725040,0irq/27-eth0-tx-0-21swapper/211:59:402
29725040,0irq/27-eth0-tx-0-21swapper/211:54:432
29725040,0irq/27-eth0-tx-0-21swapper/211:44:442
29725040,0irq/27-eth0-tx-0-21swapper/211:29:372
29725040,0irq/27-eth0-tx-0-21swapper/211:19:472
29725040,0irq/27-eth0-tx-0-21swapper/211:14:322
29725040,0irq/27-eth0-tx-0-21swapper/210:29:462
29725040,0irq/27-eth0-tx-0-21swapper/210:14:482
29725040,0irq/27-eth0-tx-0-21swapper/209:59:392
29725040,0irq/27-eth0-tx-0-21swapper/209:39:332
29725040,0irq/27-eth0-tx-0-21swapper/209:34:522
29725040,0irq/27-eth0-tx-0-21swapper/209:24:502
29725040,0irq/27-eth0-tx-0-21swapper/208:54:402
29715040,0irq/26-eth0-rx-0-21swapper/311:30:043
29715040,0irq/26-eth0-rx-0-21swapper/311:04:353
29715040,0irq/26-eth0-rx-0-21swapper/309:39:353
29715040,0irq/26-eth0-rx-0-21swapper/308:50:563
29715040,0irq/26-eth0-rx-0-21swapper/307:34:403
29715040,0irq/26-eth0-rx-0-21swapper/307:29:523
29715040,0irq/26-eth0-rx-0-21swapper/306:54:443
259940,0migration/27895-21kthreadcore07:04:512
259940,0migration/226502-21kthreadcore06:54:512
259940,0migration/219480-21kthreadcore06:49:512
259940,0migration/217987-21kthreadcore08:24:512
259940,0migration/217094-21kthreadcore08:49:492
259940,0migration/21551-21sh09:19:472
259940,0migration/214870-21kthreadcore10:24:502
249940,0watchdog/218599-21ssh09:29:472
249940,0watchdog/20-21swapper/210:59:472
249940,0watchdog/20-21swapper/209:10:232
249940,0watchdog/20-21swapper/208:44:512
249940,0watchdog/20-21swapper/207:34:472
249940,0watchdog/20-21swapper/206:59:522
170309944,0cyclictest0-21swapper/210:49:432
170309943,0cyclictest3556-21lldpd08:40:232
170309943,0cyclictest3556-21lldpd08:02:242
170309943,0cyclictest3556-21lldpd07:42:542
170309943,0cyclictest3556-21lldpd07:25:542
170309943,0cyclictest28682-21awk12:09:462
170309943,0cyclictest19167-21awk07:14:492
170299944,0cyclictest937-21awk07:49:471
170299944,0cyclictest0-21swapper/112:12:371
170299944,0cyclictest0-21swapper/110:23:311
170299943,0cyclictest902-21awk11:14:461
170299943,0cyclictest6852-21awk10:39:481
170299943,0cyclictest3514-21snmpd10:51:261
170299943,0cyclictest3514-21snmpd10:45:561
170299943,0cyclictest3514-21snmpd09:34:401
170299943,0cyclictest3514-21snmpd07:08:541
170299943,0cyclictest32432-21awk07:24:481
170299943,0cyclictest3241-21irqbalance11:06:311
170299943,0cyclictest3241-21irqbalance09:05:311
170299943,0cyclictest29481-21awk10:14:471
170299943,0cyclictest22005-21awk08:29:501
170299943,0cyclictest18998-21awk11:44:471
170299943,0cyclictest1896-21awk08:14:481
170299943,0cyclictest15347-21awk08:24:481
170299943,0cyclictest13874-21awk10:24:471
170279944,0cyclictest0-21swapper/011:07:070
170279943,0cyclictest6726-21awk10:39:480
170279943,0cyclictest3514-21snmpd11:09:560
170279943,0cyclictest3514-21snmpd10:19:400
170279943,0cyclictest3514-21snmpd07:23:390
170279943,0cyclictest3514-21snmpd07:23:390
170279943,0cyclictest3241-21irqbalance12:15:010
170279943,0cyclictest3241-21irqbalance11:20:010
170279943,0cyclictest3241-21irqbalance10:59:410
170279943,0cyclictest3241-21irqbalance09:14:510
170279943,0cyclictest3241-21irqbalance09:04:410
170279943,0cyclictest3241-21irqbalance09:01:510
170279943,0cyclictest3241-21irqbalance08:55:110
170279943,0cyclictest3241-21irqbalance08:19:510
170279943,0cyclictest31543-21awk06:59:500
170279943,0cyclictest22103-21awk08:29:510
170279943,0cyclictest21017-21awk08:04:480
179940,0migration/14529-21taskset07:03:251
179940,0migration/132260-21sshd11:32:021
179940,0migration/13108-21kthreadcore08:59:501
179940,0migration/126111-21kthreadcore10:29:521
179940,0migration/125646-21sh12:05:121
179940,0migration/122598-21kthreadcore07:39:521
179940,0migration/119521-21fschecks_time09:49:471
179940,0migration/119369-21kthreadcore06:49:511
179940,0migration/118566-21kthreadcore11:24:491
179940,0migration/115272-21kthreadcore07:59:501
179940,0migration/115155-21missed_timers11:39:501
169940,0watchdog/19245-21ssh09:42:111
169940,0watchdog/128693-21kthreadcore09:14:511
169940,0watchdog/128134-21tr08:09:511
169940,0watchdog/125816-21python08:04:551
169940,0watchdog/123089-21latency09:29:511
169940,0watchdog/117399-21ssh12:00:261
169940,0watchdog/113569-21cut10:04:511
169940,0watchdog/10-21swapper/112:14:421
169940,0watchdog/10-21swapper/111:49:501
169940,0watchdog/10-21swapper/111:13:111
169940,0watchdog/10-21swapper/110:59:391
169940,0watchdog/10-21swapper/109:44:511
149940,0migration/09362-21runrttasks11:56:260
149940,0migration/08330-21kthreadcore07:54:520
149940,0migration/08141-21kthreadcore07:29:510
149940,0migration/0442-21taskset08:10:490
149940,0migration/029060-21kthreadcore11:29:490
149940,0migration/024244-21kthreadcore10:29:510
149940,0migration/019025-21kthreadcore08:49:500
149940,0migration/017024-21munin-node07:09:540
149940,0migration/014727-21kthreadcore11:39:490
149940,0migration/012366-21kthreadcore08:44:520
149940,0migration/011330-21kthreadcore09:24:510
149940,0migration/01030-21runrttasks09:19:450
29725030,0irq/27-eth0-tx-0-21swapper/007:44:470
29715030,0irq/26-eth0-rx-0-21swapper/308:29:483
29715030,0irq/26-eth0-rx-0-21swapper/308:26:033
29715030,0irq/26-eth0-rx-0-21swapper/307:09:453
29715030,0irq/26-eth0-rx-0-21swapper/306:49:443
249930,0watchdog/25849-21munin-node07:29:472
249930,0watchdog/228962-21kthreadcore07:19:522
249930,0watchdog/228962-21kthreadcore07:19:522
249930,0watchdog/20-21swapper/208:14:512
249930,0watchdog/20-21swapper/207:44:512
170309933,0cyclictest3556-21lldpd07:57:542
170309933,0cyclictest0-21swapper/207:09:472
170309932,0cyclictest28772-21iostat08:34:492
170299932,0cyclictest6724-21awk07:29:491
170299932,0cyclictest24781-21awk06:54:481
170299932,0cyclictest22301-21sensors09:09:551
170279932,0cyclictest5844-21sensors07:49:540
170279932,0cyclictest5749-21awk07:04:490
170279932,0cyclictest27385-21awk11:49:480
170279932,0cyclictest14346-21awk07:59:470
170279932,0cyclictest12537-21munin-node07:34:490
170279930,0cyclictest4991-21kthreadcore09:59:500
170279930,0cyclictest0-21swapper/007:19:340
179930,0migration/112794-21irqrtprio07:09:501
179930,0migration/111432-21kthreadcore08:44:511
169930,0watchdog/10-21swapper/110:09:471
169930,0watchdog/10-21swapper/108:34:471
169930,0watchdog/10-21swapper/107:54:471
169930,0watchdog/10-21swapper/107:44:511
169930,0watchdog/10-21swapper/107:19:521
169930,0watchdog/10-21swapper/107:19:521
29715020,0irq/26-eth0-rx-0-21swapper/308:04:353
29715020,0irq/26-eth0-rx-0-21swapper/307:54:393
170309920,0cyclictest21260-21hostname08:29:472
170309920,0cyclictest0-21swapper/208:04:332
170299921,0cyclictest7729-21latency_hist08:19:331
170279920,0cyclictest23683-21latency_hist06:54:340
169920,0watchdog/10-21swapper/108:39:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional