You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-14 - 15:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Thu May 14, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1371824834,0sleep00-21swapper/006:53:120
304450350,0irq/25-eth10-21swapper/306:50:403
1384823422,0sleep10-21swapper/106:54:451
1383423425,0sleep20-21swapper/206:54:342
8215060,0irq/24-0000:00:27647-21sadc11:05:392
339960,0migration/34512-21latency_hist08:25:393
339960,0migration/32909-21sh10:07:093
339960,0migration/327039-21sh10:22:163
339960,0migration/319732-21runrttasks09:37:563
339960,0migration/319607-21sh11:00:293
339960,0migration/316928-21latency_hist08:10:403
29715060,0irq/26-eth0-rx-4889-21cut11:10:543
29715060,0irq/26-eth0-rx-20092-21perl11:40:523
29715060,0irq/26-eth0-rx-17230-21unixbench_multi11:56:023
29715060,0irq/26-eth0-rx-1377-21users11:26:023
149960,0migration/020162-21sh10:40:490
149960,0migration/01512-21sh11:47:000
4150,0ktimersoftd/00-21swapper/009:48:350
339950,0migration/38827-21cpuspeed_turbos07:15:513
339950,0migration/38198-21missed_timers07:35:573
339950,0migration/38135-21taskset07:14:063
339950,0migration/3555-21kthreadcore07:30:553
339950,0migration/35124-21munin-node09:30:513
339950,0migration/34714-21aten_r1power_en09:50:483
339950,0migration/34431-21fschecks_count10:50:513
339950,0migration/33344-21taskset09:27:073
339950,0migration/33110-21munin-node12:10:493
339950,0migration/329476-21fschecks_time09:05:523
339950,0migration/327749-21cpuspeed_turbos07:05:503
339950,0migration/327355-21taskset09:41:503
339950,0migration/327041-21taskset07:02:533
339950,0migration/324834-21kthreadcore09:00:563
339950,0migration/316629-21kthreadcore07:20:553
339950,0migration/314006-21irqcore09:15:543
339950,0migration/312903-21kthreadcore07:40:563
339950,0migration/310621-21sh10:31:573
339950,0migration/310621-21sh10:31:573
29725050,0irq/27-eth0-tx-8942-21python11:51:002
29725050,0irq/27-eth0-tx-4139-21munin-node10:31:012
29725050,0irq/27-eth0-tx-4139-21munin-node10:31:012
29725050,0irq/27-eth0-tx-28494-21munin-node07:30:570
29725050,0irq/27-eth0-tx-26054-21memory09:00:572
29725050,0irq/27-eth0-tx-22869-21munin-node07:50:510
29725050,0irq/27-eth0-tx-21902-21if_eth1.209:40:542
29725050,0irq/27-eth0-tx-12928-21munin-node09:35:532
29725050,0irq/27-eth0-tx-12678-21uname11:35:542
29725050,0irq/27-eth0-tx-12499-21kthreadcore11:55:552
29725050,0irq/27-eth0-tx-10851-21munin-node12:16:012
29725050,0irq/27-eth0-tx-0-21swapper/212:22:092
29725050,0irq/27-eth0-tx-0-21swapper/211:46:362
29725050,0irq/27-eth0-tx-0-21swapper/211:27:072
29725050,0irq/27-eth0-tx-0-21swapper/211:11:082
29725050,0irq/27-eth0-tx-0-21swapper/211:05:582
29725050,0irq/27-eth0-tx-0-21swapper/209:33:312
29725050,0irq/27-eth0-tx-0-21swapper/008:50:500
29725050,0irq/27-eth0-tx-0-21swapper/007:57:460
29725050,0irq/27-eth0-tx-0-21swapper/007:48:160
29725050,0irq/27-eth0-tx-0-21swapper/007:37:160
29715050,0irq/26-eth0-rx-20530-21if_err_eth1.211:20:533
29715050,0irq/26-eth0-rx-16493-21kthreadcore06:55:573
29715050,0irq/26-eth0-rx-14507-21cut10:15:563
29715050,0irq/26-eth0-rx-13729-21irqstats08:55:573
29715050,0irq/26-eth0-rx-13082-21df_abs09:55:513
29715050,0irq/26-eth0-rx-0-21swapper/311:39:413
29715050,0irq/26-eth0-rx-0-21swapper/311:33:093
29715050,0irq/26-eth0-rx-0-21swapper/311:15:513
29715050,0irq/26-eth0-rx-0-21swapper/311:06:413
29715050,0irq/26-eth0-rx-0-21swapper/310:41:533
29715050,0irq/26-eth0-rx-0-21swapper/310:39:283
29715050,0irq/26-eth0-rx-0-21swapper/310:27:443
29715050,0irq/26-eth0-rx-0-21swapper/310:10:563
29715050,0irq/26-eth0-rx-0-21swapper/310:00:413
29715050,0irq/26-eth0-rx-0-21swapper/309:48:363
259950,0migration/26579-21idleruntime08:50:532
259950,0migration/25487-21idleruntime09:50:512
259950,0migration/229777-21idleruntime09:45:522
259950,0migration/225814-21sh11:41:512
259950,0migration/22164-21sendmail_mailqu09:06:002
259950,0migration/220103-21latency_hist10:40:392
259950,0migration/212230-21sh10:15:382
259950,0migration/211630-21sh09:12:542
249950,0watchdog/2369-21cut10:05:572
249950,0watchdog/217366-21sed08:31:022
169950,0watchdog/117271-21grep11:15:571
140009955,0cyclictest0-21swapper/212:06:472
140009954,0cyclictest29004-21date09:25:392
149950,0migration/08530-21kthreadcore10:50:560
149950,0migration/0714-21kthreadcore08:20:560
149950,0migration/06770-21kthreadcore08:00:540
149950,0migration/06010-21kthreadcore11:30:560
149950,0migration/05627-21kthreadcore10:30:550
149950,0migration/05627-21kthreadcore10:30:550
149950,0migration/05458-21taskset08:50:050
149950,0migration/04639-21latency_hist09:10:390
149950,0migration/03511-21munin-node11:50:500
149950,0migration/029228-21kernelversion11:05:540
149950,0migration/028874-21taskset09:05:500
149950,0migration/028050-21df_abs11:25:510
149950,0migration/027305-21kthreadcore08:15:550
149950,0migration/026002-21kthreadcore07:25:570
149950,0migration/024336-21kthreadcore10:00:560
149950,0migration/023822-21kthreadcore11:20:550
149950,0migration/023404-21kthreadcore07:00:560
149950,0migration/021426-21taskset07:23:350
149950,0migration/021417-21kthreadcore12:00:540
149950,0migration/017526-21taskset08:31:520
149950,0migration/016893-21kthreadcore10:15:560
149950,0migration/015994-21kthreadcore11:35:560
149950,0migration/014736-21kthreadcore10:55:540
149950,0migration/013410-21kthreadcore08:05:550
149950,0migration/012793-21kthreadcore07:40:560
149950,0migration/012133-21taskset09:54:440
139989955,0cyclictest0-21swapper/112:09:061
139989955,0cyclictest0-21swapper/110:59:151
139989955,0cyclictest0-21swapper/110:47:451
139989955,0cyclictest0-21swapper/110:06:261
139989955,0cyclictest0-21swapper/109:40:071
139989955,0cyclictest0-21swapper/109:27:581
139989954,0cyclictest8866-21kthreadcore08:50:561
139989950,0cyclictest0-21swapper/111:59:191
139989950,0cyclictest0-21swapper/111:39:461
139989950,0cyclictest0-21swapper/111:26:221
139989950,0cyclictest0-21swapper/109:49:441
139989950,0cyclictest0-21swapper/108:56:261
139989950,0cyclictest0-21swapper/107:32:531
139979954,0cyclictest3556-21lldpd10:25:170
139979950,0cyclictest0-21swapper/011:41:280
139979950,0cyclictest0-21swapper/010:09:330
139979950,0cyclictest0-21swapper/009:27:180
339940,0migration/39059-21kthreadcore09:10:573
339940,0migration/323691-21kthreadcore11:00:553
339940,0migration/319701-21fschecks_count12:00:513
339940,0migration/315096-21kthreadcore08:30:563
29725040,0irq/27-eth0-tx-4150-21ssh11:30:532
29725040,0irq/27-eth0-tx-18747-21ssh08:56:272
29725040,0irq/27-eth0-tx-14117-21kthreadcore11:15:542
29725040,0irq/27-eth0-tx-12919-21munin-node09:15:512
29725040,0irq/27-eth0-tx-12170-21munin-node10:35:532
29725040,0irq/27-eth0-tx-0-21swapper/211:20:502
29725040,0irq/27-eth0-tx-0-21swapper/210:55:402
29725040,0irq/27-eth0-tx-0-21swapper/210:20:452
29725040,0irq/27-eth0-tx-0-21swapper/209:55:502
29725040,0irq/27-eth0-tx-0-21swapper/209:27:312
29725040,0irq/27-eth0-tx-0-21swapper/008:55:400
29725040,0irq/27-eth0-tx-0-21swapper/008:26:020
29715040,0irq/26-eth0-rx-0-21swapper/312:23:223
29715040,0irq/26-eth0-rx-0-21swapper/312:15:533
29715040,0irq/26-eth0-rx-0-21swapper/312:05:503
29715040,0irq/26-eth0-rx-0-21swapper/311:50:463
29715040,0irq/26-eth0-rx-0-21swapper/311:46:453
29715040,0irq/26-eth0-rx-0-21swapper/309:22:203
29715040,0irq/26-eth0-rx-0-21swapper/308:45:573
29715040,0irq/26-eth0-rx-0-21swapper/307:55:513
29715040,0irq/26-eth0-rx-0-21swapper/307:25:563
259940,0migration/27407-21kthreadcore12:10:552
259940,0migration/25347-21fschecks_time08:25:532
259940,0migration/228002-21runrttasks07:27:422
259940,0migration/222915-21kthreadcore10:00:552
259940,0migration/220682-21kthreadcore08:35:552
259940,0migration/218703-21kthreadcore08:10:562
259940,0migration/214867-21kthreadcore10:15:562
249940,0watchdog/229836-21tr07:30:542
249940,0watchdog/21587-21nfs4_client10:25:572
249940,0watchdog/20-21swapper/208:45:582
179940,0migration/19273-21kthreadcore10:10:571
179940,0migration/17547-21kthreadcore08:00:551
179940,0migration/12984-21kthreadcore08:20:571
179940,0migration/124673-21kthreadcore11:40:561
179940,0migration/120812-21cpuspeed_turbos10:20:511
179940,0migration/120033-21aten_r1power_fr11:00:491
179940,0migration/113505-21fschecks_time09:15:511
169940,0watchdog/19126-21kthreadcore09:10:571
169940,0watchdog/17055-21kthreadcore09:50:531
169940,0watchdog/124762-21iostat08:15:541
169940,0watchdog/112193-21ps12:15:531
169940,0watchdog/10-21swapper/108:35:541
140009944,0cyclictest29217-21grep10:45:552
140009944,0cyclictest0-21swapper/210:54:442
140009943,0cyclictest9423-21awk07:15:542
140009943,0cyclictest3556-21lldpd08:44:162
140009943,0cyclictest3556-21lldpd08:03:162
140009943,0cyclictest3556-21lldpd07:59:162
140009943,0cyclictest3514-21snmpd12:00:442
140009943,0cyclictest11383-21awk08:05:532
140009940,0cyclictest0-21swapper/207:39:522
149940,0migration/030402-21kthreadcore10:25:550
149940,0migration/024456-21kthreadcore11:00:550
149940,0migration/01605-21sh12:08:030
149940,0migration/015755-21kthreadcore09:55:560
149940,0migration/013860-21if_eth009:35:520
139989944,0cyclictest12186-21diskmemload10:54:031
139989944,0cyclictest0-21swapper/112:13:591
139989944,0cyclictest0-21swapper/109:56:021
139989944,0cyclictest0-21swapper/109:41:131
139989943,0cyclictest5811-21awk09:30:541
139989943,0cyclictest3556-21lldpd11:52:191
139989943,0cyclictest3556-21lldpd11:32:191
139989943,0cyclictest3556-21lldpd11:14:191
139989943,0cyclictest3556-21lldpd10:45:181
139989943,0cyclictest3556-21lldpd10:37:181
139989943,0cyclictest3556-21lldpd07:18:161
139989943,0cyclictest3556-21lldpd07:12:161
139989943,0cyclictest3514-21snmpd12:02:591
139989943,0cyclictest3514-21snmpd08:25:581
139989943,0cyclictest32426-21ps08:45:561
139989943,0cyclictest3241-21irqbalance11:45:571
139989943,0cyclictest3241-21irqbalance10:32:371
139989943,0cyclictest3241-21irqbalance10:32:371
139989943,0cyclictest3241-21irqbalance10:04:171
139989943,0cyclictest3241-21irqbalance09:21:081
139989943,0cyclictest3241-21irqbalance08:31:281
139989943,0cyclictest30460-21awk07:55:531
139989943,0cyclictest29454-21awk10:25:541
139989943,0cyclictest28871-21awk11:05:531
139989943,0cyclictest25706-21awk08:40:551
139989943,0cyclictest22705-21awk07:25:541
139989943,0cyclictest21707-21awk07:00:541
139989943,0cyclictest21551-21awk09:00:541
139989943,0cyclictest20595-21awk11:20:531
139989943,0cyclictest19866-21awk12:20:541
139989943,0cyclictest17090-21awk07:45:531
139989943,0cyclictest15069-21awk06:55:551
139979944,0cyclictest0-21swapper/012:23:150
139979943,0cyclictest3514-21snmpd08:40:580
139979943,0cyclictest29125-21awk10:45:540
139979943,0cyclictest2731-21awk07:10:540
139979943,0cyclictest21821-21awk09:40:540
139979943,0cyclictest18016-21awk08:10:550
139979943,0cyclictest13909-21awk09:15:530
139979943,0cyclictest11384-21sadc11:15:380
8215030,0irq/24-0000:00:0-21swapper/206:56:232
29715030,0irq/26-eth0-rx-0-21swapper/310:45:513
29715030,0irq/26-eth0-rx-0-21swapper/308:50:503
29715030,0irq/26-eth0-rx-0-21swapper/308:40:513
29715030,0irq/26-eth0-rx-0-21swapper/308:35:503
29715030,0irq/26-eth0-rx-0-21swapper/308:25:513
29715030,0irq/26-eth0-rx-0-21swapper/308:19:203
29715030,0irq/26-eth0-rx-0-21swapper/307:50:503
29715030,0irq/26-eth0-rx-0-21swapper/307:45:503
249930,0watchdog/216277-21aten_r1power_po07:45:502
169930,0watchdog/10-21swapper/109:05:501
169930,0watchdog/10-21swapper/108:05:501
140009933,0cyclictest3556-21lldpd07:07:452
140009932,0cyclictest3556-21lldpd08:19:462
140009932,0cyclictest3556-21lldpd07:50:452
140009932,0cyclictest3556-21lldpd07:40:462
140009932,0cyclictest3556-21lldpd07:20:452
140009932,0cyclictest3556-21lldpd07:10:462
140009932,0cyclictest21825-21awk07:00:552
140009932,0cyclictest2020-21tr08:20:572
139989932,0cyclictest18088-21awk08:10:551
139989932,0cyclictest16175-21awk07:20:541
139989930,0cyclictest13365-21munin-node10:15:531
139989930,0cyclictest0-21swapper/107:42:311
139979933,0cyclictest5450-21kworker/0:112:16:100
139979933,0cyclictest5450-21kworker/0:111:55:400
139979933,0cyclictest5450-21kworker/0:110:10:420
139979933,0cyclictest3734-21kworker/0:009:30:490
139979933,0cyclictest3734-21kworker/0:009:20:470
139979933,0cyclictest3734-21kworker/0:009:00:550
139979933,0cyclictest18771-21kworker/0:207:15:430
139979933,0cyclictest18771-21kworker/0:207:05:410
139979933,0cyclictest18771-21kworker/0:206:55:410
139979933,0cyclictest0-21swapper/012:10:470
139979932,0cyclictest13431-21sed10:35:540
139979930,0cyclictest18087-21munin-node08:35:530
139979930,0cyclictest0-21swapper/011:15:490
29715020,0irq/26-eth0-rx-0-21swapper/308:10:433
29715020,0irq/26-eth0-rx-0-21swapper/308:00:443
139989921,0cyclictest22640-21latency_hist07:50:401
139989920,0cyclictest0-21swapper/107:35:401
139989920,0cyclictest0-21swapper/107:05:471
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional