You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 16:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Wed Mar 11, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2327123926,0sleep30-21swapper/306:57:463
2333223430,0sleep20-21swapper/206:58:332
2339223228,0sleep10-21swapper/106:59:121
2350823026,0sleep00-21swapper/007:00:350
339960,0migration/3632-21missed_timers08:41:583
339960,0migration/34919-21sh10:10:173
339960,0migration/328762-21sh09:42:483
339960,0migration/319633-21sh12:01:403
339960,0migration/318044-21sh12:17:523
29725060,0irq/27-eth0-tx-23890-21munin-node07:01:560
29715060,0irq/26-eth0-rx-5800-21ps11:11:573
29715060,0irq/26-eth0-rx-31226-21if_err_eth1.209:46:543
29715060,0irq/26-eth0-rx-26328-21sh12:02:383
29715060,0irq/26-eth0-rx-11349-21ps10:12:003
236749960,0cyclictest0-21swapper/210:57:042
236739960,0cyclictest0-21swapper/109:43:221
236729966,0cyclictest0-21swapper/009:19:220
149960,0migration/09425-21fschecks_time08:51:550
149960,0migration/029673-21sh09:24:540
149960,0migration/029673-21sh09:24:540
149960,0migration/018536-21sh12:19:210
149960,0migration/018433-21sh11:58:090
149960,0migration/014621-21kthreadcore10:57:000
149960,0migration/012776-21sh09:13:400
149960,0migration/012667-21sh09:32:400
149960,0migration/012665-21sh10:35:340
8215050,0irq/24-0000:00:31238-21idleruntime-cro07:31:422
339950,0migration/38832-21kthreadcore12:11:573
339950,0migration/38819-21kthreadcore09:11:583
339950,0migration/35493-21taskset07:35:533
339950,0migration/34669-21taskset09:27:413
339950,0migration/34271-21taskset07:08:023
339950,0migration/33790-21kthreadcore07:56:583
339950,0migration/33225-21taskset10:47:443
339950,0migration/327691-21taskset11:03:493
339950,0migration/325437-21munin-node12:22:003
339950,0migration/324678-21latency_hist07:26:423
339950,0migration/323387-21kthreadcore08:11:583
339950,0migration/322756-21cpuspeed_turbos09:21:533
339950,0migration/322756-21cpuspeed_turbos09:21:533
339950,0migration/322247-21sh10:01:523
339950,0migration/321794-21fschecks_count10:41:523
339950,0migration/317214-21kthreadcore08:06:583
339950,0migration/316199-21gltestperf08:56:573
339950,0migration/313509-21irqcore07:41:583
339950,0migration/312214-21fschecks_time07:16:573
29725050,0irq/27-eth0-tx-27755-21munin-node08:41:540
29725050,0irq/27-eth0-tx-19923-21munin-node12:02:022
29725050,0irq/27-eth0-tx-18216-21munin-node11:17:012
29725050,0irq/27-eth0-tx-1040-21munin-node08:21:520
29725050,0irq/27-eth0-tx-0-21swapper/211:58:012
29725050,0irq/27-eth0-tx-0-21swapper/211:54:312
29725050,0irq/27-eth0-tx-0-21swapper/210:13:182
29725050,0irq/27-eth0-tx-0-21swapper/009:01:530
29725050,0irq/27-eth0-tx-0-21swapper/008:13:450
29725050,0irq/27-eth0-tx-0-21swapper/008:09:150
29725050,0irq/27-eth0-tx-0-21swapper/007:58:220
29715050,0irq/26-eth0-rx-6559-21runrttasks10:28:273
29715050,0irq/26-eth0-rx-29271-21ssh10:26:243
29715050,0irq/26-eth0-rx-26513-21timerandwakeup11:22:013
29715050,0irq/26-eth0-rx-21495-21sed11:41:583
29715050,0irq/26-eth0-rx-10746-21swap10:52:013
29715050,0irq/26-eth0-rx-0-21swapper/312:30:303
29715050,0irq/26-eth0-rx-0-21swapper/312:06:543
29715050,0irq/26-eth0-rx-0-21swapper/311:51:553
29715050,0irq/26-eth0-rx-0-21swapper/311:39:283
29715050,0irq/26-eth0-rx-0-21swapper/311:27:003
29715050,0irq/26-eth0-rx-0-21swapper/311:17:383
29715050,0irq/26-eth0-rx-0-21swapper/311:07:323
29715050,0irq/26-eth0-rx-0-21swapper/311:00:043
29715050,0irq/26-eth0-rx-0-21swapper/310:17:063
29715050,0irq/26-eth0-rx-0-21swapper/309:17:263
29715050,0irq/26-eth0-rx-0-21swapper/309:09:323
27150,0ktimersoftd/20-21swapper/212:10:182
259950,0migration/27674-21latency_hist08:26:422
259950,0migration/232055-21kthreadcore09:26:572
259950,0migration/219587-21runrttasks12:21:452
259950,0migration/218184-21sh07:42:042
259950,0migration/210813-21needreboot10:31:592
249950,0watchdog/227569-21sh11:45:312
249950,0watchdog/20-21swapper/210:17:072
236749955,0cyclictest0-21swapper/211:30:392
236749954,0cyclictest4313-21crond11:11:402
236749950,0cyclictest0-21swapper/209:19:282
236739955,0cyclictest0-21swapper/109:07:161
236739950,0cyclictest0-21swapper/110:50:511
236729955,0cyclictest0-21swapper/012:09:010
236729955,0cyclictest0-21swapper/011:32:540
236729955,0cyclictest0-21swapper/010:52:330
236729955,0cyclictest0-21swapper/007:36:440
236729950,0cyclictest0-21swapper/011:13:310
19150,0ktimersoftd/10-21swapper/109:39:541
19150,0ktimersoftd/10-21swapper/109:26:301
19150,0ktimersoftd/10-21swapper/109:26:301
179950,0migration/127574-21gltestperf08:16:541
179950,0migration/119496-21missed_timers09:56:591
179950,0migration/119215-21sh12:21:191
169950,0watchdog/16067-21taskset10:51:551
169950,0watchdog/131406-21irqcore09:46:551
149950,0migration/05179-21sh09:29:030
149950,0migration/03188-21kthreadcore07:32:000
149950,0migration/030831-21munin-node10:06:530
149950,0migration/030743-21kthreadcore12:26:570
149950,0migration/030115-21irqcore11:06:590
149950,0migration/029891-21cpuspeed_turbos10:26:530
149950,0migration/029087-21sh10:04:400
149950,0migration/027471-21taskset11:24:130
149950,0migration/023087-21kthreadcore12:01:570
149950,0migration/022557-21kthreadcore12:21:550
149950,0migration/020930-21runrttasks09:38:220
149950,0migration/020244-21aten_r1power_cu11:41:520
149950,0migration/019712-21kthreadcore07:21:570
149950,0migration/019056-21mdstat10:16:580
149950,0migration/017223-21kthreadcore10:36:580
149950,0migration/017058-21kthreadcore11:36:580
149950,0migration/016213-21hddtemp_smartct08:56:570
149950,0migration/015329-21irqrtprio09:56:570
149950,0migration/013062-21mdstat08:26:590
149950,0migration/010992-21kthreadcore09:51:580
149950,0migration/010968-21taskset07:12:530
149950,0migration/01064-21kthreadcore10:46:580
149950,0migration/010346-21sh12:13:410
8215040,0irq/24-0000:00:0-21swapper/207:31:422
339940,0migration/35345-21irqcore11:31:573
339940,0migration/34759-21latency_hist07:11:423
339940,0migration/323266-21kthreadcore08:36:573
339940,0migration/320472-21runrttasks09:57:503
29725040,0irq/27-eth0-tx-8038-21grep11:31:582
29725040,0irq/27-eth0-tx-3592-21ssh10:27:292
29725040,0irq/27-eth0-tx-3306-21sshd10:07:002
29725040,0irq/27-eth0-tx-0-21swapper/212:11:422
29725040,0irq/27-eth0-tx-0-21swapper/211:46:482
29725040,0irq/27-eth0-tx-0-21swapper/211:37:242
29725040,0irq/27-eth0-tx-0-21swapper/211:21:572
29725040,0irq/27-eth0-tx-0-21swapper/210:42:232
29725040,0irq/27-eth0-tx-0-21swapper/209:13:562
29725040,0irq/27-eth0-tx-0-21swapper/209:03:362
29725040,0irq/27-eth0-tx-0-21swapper/008:46:530
29725040,0irq/27-eth0-tx-0-21swapper/008:03:230
29725040,0irq/27-eth0-tx-0-21swapper/007:41:580
29715040,0irq/26-eth0-rx-4035-21kthreadcore08:21:583
29715040,0irq/26-eth0-rx-0-21swapper/311:46:473
29715040,0irq/26-eth0-rx-0-21swapper/310:36:493
29715040,0irq/26-eth0-rx-0-21swapper/310:32:053
29715040,0irq/26-eth0-rx-0-21swapper/309:52:343
29715040,0irq/26-eth0-rx-0-21swapper/309:36:583
29715040,0irq/26-eth0-rx-0-21swapper/309:31:423
29715040,0irq/26-eth0-rx-0-21swapper/309:03:203
259940,0migration/27747-21kthreadcore11:11:582
259940,0migration/26887-21kthreadcore08:46:582
259940,0migration/229782-21kthreadcore12:26:572
259940,0migration/227020-21unixbench_multi08:37:032
259940,0migration/22609-21kthreadcore07:06:592
259940,0migration/224998-21timerwakeupswit07:47:042
259940,0migration/224555-21kthreadcore09:21:572
259940,0migration/224555-21kthreadcore09:21:572
259940,0migration/222830-21fschecks_count09:41:542
259940,0migration/220707-21ksmtuned08:34:432
259940,0migration/219226-21kthreadcore09:56:582
259940,0migration/218915-21ntp_kernel_err08:07:002
259940,0migration/215514-21irqcore09:36:582
259940,0migration/214514-21kthreadcore07:17:002
259940,0migration/213069-21runrttasks08:04:382
259940,0migration/210177-21kthreadcore07:36:562
249940,0watchdog/224696-21basename07:01:562
249940,0watchdog/221790-21cat11:01:552
249940,0watchdog/213453-21switchtime08:27:042
249940,0watchdog/20-21swapper/210:51:512
249940,0watchdog/20-21swapper/209:46:512
249940,0watchdog/20-21swapper/209:06:512
249940,0watchdog/20-21swapper/207:52:002
236749944,0cyclictest0-21swapper/209:34:082
236749943,0cyclictest3556-21lldpd10:36:452
236749943,0cyclictest3556-21lldpd09:52:142
236749943,0cyclictest3556-21lldpd08:54:452
236749943,0cyclictest3514-21snmpd08:41:542
236749943,0cyclictest30226-21awk10:46:562
236749943,0cyclictest23078-21awk10:01:562
236749943,0cyclictest22505-21awk10:21:542
236749943,0cyclictest12632-21awk12:16:552
236739944,0cyclictest0-21swapper/111:31:131
236739944,0cyclictest0-21swapper/109:28:051
236739944,0cyclictest0-21swapper/108:21:421
236739943,0cyclictest6929-21awk09:11:561
236739943,0cyclictest3556-21lldpd10:33:151
236739943,0cyclictest3514-21snmpd12:08:091
236739943,0cyclictest3514-21snmpd08:32:391
236739943,0cyclictest3514-21snmpd07:29:241
236739943,0cyclictest3241-21irqbalance10:23:591
236739943,0cyclictest29824-21awk11:06:571
236739943,0cyclictest23006-21awk09:01:561
236739943,0cyclictest21470-21awk11:21:541
236739943,0cyclictest20611-21awk12:21:531
236739943,0cyclictest20100-21awk07:46:571
236739943,0cyclictest14563-21awk10:16:551
236739943,0cyclictest13123-21awk11:36:551
236729944,0cyclictest0-21swapper/010:14:520
236729944,0cyclictest0-21swapper/008:17:060
236729943,0cyclictest3556-21lldpd08:40:150
236729943,0cyclictest3556-21lldpd07:09:450
236729943,0cyclictest3514-21snmpd07:47:240
236729943,0cyclictest31338-21ps09:06:580
236729943,0cyclictest26668-21awk07:51:550
236729943,0cyclictest25678-21awk07:26:570
236729943,0cyclictest0-21swapper/007:16:570
179940,0migration/18475-21runrttasks08:51:261
179940,0migration/16913-21aten_r1power_fr08:01:531
179940,0migration/15139-21cpuspeed_turbos07:11:541
179940,0migration/14967-21kthreadcore12:11:561
179940,0migration/13583-21taskset10:27:271
179940,0migration/130579-21kthreadcore11:46:571
179940,0migration/129639-21switchtime07:02:041
179940,0migration/124687-21latency_hist07:26:421
179940,0migration/124260-21kthreadcore10:41:561
179940,0migration/119143-21switchtime10:37:041
179940,0migration/116794-21kthreadcore10:57:001
179940,0migration/115634-21kthreadcore09:16:581
179940,0migration/112960-21kthreadcore08:51:581
179940,0migration/112488-21taskset07:41:481
179940,0migration/11045-21kthreadcore07:06:581
179940,0migration/110437-21kthreadcore10:11:571
169940,0watchdog/1930-21if_err_eth107:56:561
169940,0watchdog/14143-21ssh11:31:431
169940,0watchdog/121842-21diskmemload09:54:031
169940,0watchdog/121156-21cut08:36:521
169940,0watchdog/120945-21munin-node08:57:031
169940,0watchdog/113216-21cut07:17:001
169940,0watchdog/10-21swapper/111:41:591
169940,0watchdog/10-21swapper/110:06:591
169940,0watchdog/10-21swapper/108:27:041
169940,0watchdog/10-21swapper/107:37:001
149940,0migration/023876-21kthreadcore10:21:560
149940,0migration/023263-21kthreadcore11:01:570
149940,0migration/017772-21kthreadcore08:31:580
149940,0migration/016637-21kthreadcore11:16:580
29715030,0irq/26-eth0-rx-0-21swapper/308:53:333
29715030,0irq/26-eth0-rx-0-21swapper/308:48:093
29715030,0irq/26-eth0-rx-0-21swapper/308:26:533
29715030,0irq/26-eth0-rx-0-21swapper/307:46:533
29715030,0irq/26-eth0-rx-0-21swapper/307:03:303
259930,0migration/2639-21runrttasks08:20:282
249930,0watchdog/20-21swapper/207:56:562
249930,0watchdog/20-21swapper/207:21:562
236749933,0cyclictest3556-21lldpd09:00:152
236749932,0cyclictest20229-21aten2.4-expect08:11:522
236739933,0cyclictest26738-21awk07:51:561
236739932,0cyclictest5489-21awk11:11:551
236739932,0cyclictest3514-21snmpd07:31:541
236739932,0cyclictest28735-21awk08:41:551
236739932,0cyclictest22042-21kthreadcore12:01:571
236739932,0cyclictest10143-21ssh11:52:171
236739930,0cyclictest21497-21tune2fs11:01:541
236729933,0cyclictest26455-21kworker/0:110:41:420
236729933,0cyclictest26455-21kworker/0:109:46:560
236729933,0cyclictest1931-21kworker/0:011:52:320
236729932,0cyclictest29450-21awk11:26:540
236729932,0cyclictest28676-21grep11:46:530
236729932,0cyclictest28139-21sensors09:42:030
169930,0watchdog/121842-21diskmemload09:31:591
169930,0watchdog/10-21swapper/112:29:511
169930,0watchdog/10-21swapper/111:59:311
169930,0watchdog/10-21swapper/111:16:511
169930,0watchdog/10-21swapper/110:01:591
169930,0watchdog/10-21swapper/108:11:561
169930,0watchdog/10-21swapper/108:06:521
35120,0ktimersoftd/328283-21kthreadcore07:51:583
339920,0migration/327218-21diskstats08:16:533
339920,0migration/325828-21iostat_ios07:26:583
329920,0watchdog/311502-21python07:37:013
29715020,0irq/26-eth0-rx-0-21swapper/308:31:573
29715020,0irq/26-eth0-rx-0-21swapper/308:02:093
249920,0watchdog/20-21swapper/207:11:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional