You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 11:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jul 18, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1073824233,0sleep20-21swapper/218:48:432
1062323929,0sleep30-21swapper/318:47:203
1052023425,0sleep10-21swapper/118:46:061
1078622824,0sleep00-21swapper/018:49:130
8215060,0irq/24-0000:00:26195-21crond19:49:302
339960,0migration/34989-21latency22:39:483
339960,0migration/332498-21sh22:58:313
339960,0migration/325466-21sh21:16:353
339960,0migration/317048-21sh23:25:423
339960,0migration/314639-21runrttasks22:29:003
29715060,0irq/26-eth0-rx-15733-21kthreadcore21:49:473
149960,0migration/06694-21sh22:41:580
149960,0migration/030044-21sh22:35:390
149960,0migration/022563-21sh22:32:470
149960,0migration/020927-21sh00:08:530
108819960,0cyclictest0-21swapper/221:31:372
108799960,0cyclictest0-21swapper/023:59:500
339950,0migration/39311-21kthreadcore21:44:463
339950,0migration/39267-21kthreadcore19:59:473
339950,0migration/37105-21taskset19:59:013
339950,0migration/36057-21runrttasks22:23:353
339950,0migration/33575-21munin-node20:44:463
339950,0migration/33377-21sh22:00:043
339950,0migration/332189-21kthreadcore00:14:463
339950,0migration/328657-21kthreadcore23:14:463
339950,0migration/327387-21df_abs21:19:423
339950,0migration/326495-21gltestperf20:59:433
339950,0migration/326443-21runrttasks21:35:583
339950,0migration/326236-21timerwakeupswit23:49:523
339950,0migration/325179-21munin-node18:59:443
339950,0migration/322656-21munin-node20:34:473
339950,0migration/322361-21aten2.4-expect22:14:393
339950,0migration/32104-21fschecks_count20:19:433
339950,0migration/319903-21munin-node19:19:453
339950,0migration/318732-21irqcore23:09:453
339950,0migration/315541-21kthreadcore19:39:463
339950,0migration/314071-21kthreadcore21:29:493
339950,0migration/311592-21taskset19:11:113
29725050,0irq/27-eth0-tx-9875-21ssh23:40:312
29725050,0irq/27-eth0-tx-4683-21munin-node23:59:422
29725050,0irq/27-eth0-tx-3788-21ssh21:24:442
29725050,0irq/27-eth0-tx-3760-21ssh00:15:072
29725050,0irq/27-eth0-tx-28640-21munin-node23:54:462
29725050,0irq/27-eth0-tx-27000-21munin-node21:19:452
29725050,0irq/27-eth0-tx-26692-21ssh23:50:342
29725050,0irq/27-eth0-tx-26510-21sed20:59:432
29725050,0irq/27-eth0-tx-15490-21ssh22:09:462
29725050,0irq/27-eth0-tx-12175-21kthreadcore22:44:472
29725050,0irq/27-eth0-tx-0-21swapper/223:34:452
29725050,0irq/27-eth0-tx-0-21swapper/223:02:332
29725050,0irq/27-eth0-tx-0-21swapper/222:39:532
29725050,0irq/27-eth0-tx-0-21swapper/222:21:282
29725050,0irq/27-eth0-tx-0-21swapper/221:55:332
29725050,0irq/27-eth0-tx-0-21swapper/221:14:362
29725050,0irq/27-eth0-tx-0-21swapper/200:10:032
29725050,0irq/27-eth0-tx-0-21swapper/020:49:360
29725050,0irq/27-eth0-tx-0-21swapper/020:39:500
29715050,0irq/26-eth0-rx-6559-21runrttasks23:48:433
29715050,0irq/26-eth0-rx-412-21cut21:39:483
29715050,0irq/26-eth0-rx-27697-21sed23:34:413
29715050,0irq/26-eth0-rx-21863-21ssh22:14:033
29715050,0irq/26-eth0-rx-21822-21load22:49:483
29715050,0irq/26-eth0-rx-21310-21ssh21:54:413
29715050,0irq/26-eth0-rx-10869-21seq21:28:533
29715050,0irq/26-eth0-rx-10828-21grep23:04:473
29715050,0irq/26-eth0-rx-0-21swapper/323:59:423
29715050,0irq/26-eth0-rx-0-21swapper/323:43:333
29715050,0irq/26-eth0-rx-0-21swapper/323:31:403
29715050,0irq/26-eth0-rx-0-21swapper/323:03:133
29715050,0irq/26-eth0-rx-0-21swapper/322:46:313
29715050,0irq/26-eth0-rx-0-21swapper/322:34:493
29715050,0irq/26-eth0-rx-0-21swapper/322:04:433
29715050,0irq/26-eth0-rx-0-21swapper/320:49:573
29715050,0irq/26-eth0-rx-0-21swapper/300:09:333
29715050,0irq/26-eth0-rx-0-21swapper/300:09:273
259950,0migration/24937-21latency19:29:482
259950,0migration/24303-21aten_r1power_cu21:44:392
259950,0migration/232102-21kthreadcore21:59:462
259950,0migration/226129-21sh20:09:482
259950,0migration/224036-21mdstat19:19:472
259950,0migration/222784-21fschecks_count22:14:412
259950,0migration/218101-21latency21:49:482
259950,0migration/214887-21ntp_offset20:49:502
259950,0migration/214787-21kthreadcore19:39:462
259950,0migration/212359-21kthreadcore23:04:482
259950,0migration/211198-21fschecks_time23:24:412
249950,0watchdog/224585-21cut21:34:482
249950,0watchdog/221309-21cut22:49:482
19150,0ktimersoftd/10-21swapper/123:38:381
19150,0ktimersoftd/10-21swapper/123:28:241
19150,0ktimersoftd/10-21swapper/123:04:211
19150,0ktimersoftd/10-21swapper/122:55:551
179950,0migration/19588-21kthreadcore22:24:461
179950,0migration/13729-21kthreadcore19:54:481
179950,0migration/126388-21fschecks_time20:59:431
179950,0migration/125505-21sh21:34:511
179950,0migration/123042-21munin-node20:54:511
179950,0migration/122455-21idleruntime20:34:451
179950,0migration/122117-21fschecks_time00:09:421
179950,0migration/119545-21kthreadcore18:54:491
179950,0migration/118153-21taskset19:15:251
179950,0migration/114879-21kthreadcore23:44:471
149950,0migration/09958-21sh23:40:430
149950,0migration/05377-21kthreadcore21:04:480
149950,0migration/04947-21taskset19:07:190
149950,0migration/04412-21taskset22:02:270
149950,0migration/030687-21kthreadcore19:49:460
149950,0migration/027687-21latency22:14:460
149950,0migration/027673-21sh21:38:520
149950,0migration/027167-21latency_hist20:14:300
149950,0migration/026951-21kthreadcore19:24:470
149950,0migration/025192-21munin-node19:44:490
149950,0migration/022246-21gltestperf00:09:420
149950,0migration/021707-21kthreadcore21:14:470
149950,0migration/021173-21kthreadcore20:54:480
149950,0migration/021155-21kthreadcore23:09:470
149950,0migration/020230-21taskset20:07:030
149950,0migration/016771-21kthreadcore23:44:470
149950,0migration/016722-21taskset23:24:550
149950,0migration/016153-21kthreadcore18:49:470
108819955,0cyclictest0-21swapper/222:58:482
108819955,0cyclictest0-21swapper/221:41:432
108819950,0cyclictest0-21swapper/222:26:482
108819950,0cyclictest0-21swapper/220:55:032
108809955,0cyclictest0-21swapper/123:23:491
108809954,0cyclictest30689-21tr21:59:451
108809950,0cyclictest0-21swapper/123:07:061
108809950,0cyclictest0-21swapper/121:06:391
108809950,0cyclictest0-21swapper/120:29:551
108799950,0cyclictest0-21swapper/023:55:440
108799950,0cyclictest0-21swapper/022:56:460
108799950,0cyclictest0-21swapper/022:21:560
108799950,0cyclictest0-21swapper/021:51:400
108799950,0cyclictest0-21swapper/021:46:460
8215040,0irq/24-0000:00:0-21swapper/200:04:302
339940,0migration/331764-21taskset19:29:003
339940,0migration/323623-21kthreadcore20:09:463
339940,0migration/32195-21kthreadcore19:04:473
339940,0migration/31548-21kthreadcore19:29:463
29725040,0irq/27-eth0-tx-7882-21proc_pri23:19:502
29725040,0irq/27-eth0-tx-0-21swapper/223:44:492
29725040,0irq/27-eth0-tx-0-21swapper/223:29:352
29725040,0irq/27-eth0-tx-0-21swapper/223:15:032
29725040,0irq/27-eth0-tx-0-21swapper/223:09:352
29725040,0irq/27-eth0-tx-0-21swapper/222:30:592
29725040,0irq/27-eth0-tx-0-21swapper/019:59:420
29725040,0irq/27-eth0-tx-0-21swapper/019:29:450
29715040,0irq/26-eth0-rx-32469-21taskset19:50:173
29715040,0irq/26-eth0-rx-29981-21kthreadcore23:54:473
29715040,0irq/26-eth0-rx-0-21swapper/323:19:343
29715040,0irq/26-eth0-rx-0-21swapper/322:33:463
29715040,0irq/26-eth0-rx-0-21swapper/321:09:343
29715040,0irq/26-eth0-rx-0-21swapper/321:04:433
29715040,0irq/26-eth0-rx-0-21swapper/320:54:413
259940,0migration/27580-21kthreadcore19:09:472
259940,0migration/26295-21munin-node22:04:432
259940,0migration/26189-21kthreadcore20:44:482
259940,0migration/224394-21runrttasks18:59:372
259940,0migration/218435-21kthreadcore20:04:482
259940,0migration/213196-21timerwakeupswit19:59:522
259940,0migration/212672-21kthreadcore21:09:472
249940,0watchdog/27716-21sshd20:20:002
249940,0watchdog/21716-21ssh21:04:402
249940,0watchdog/20-21swapper/218:58:012
179940,0migration/18059-21kthreadcore23:59:471
179940,0migration/14561-21timerwakeupswit19:04:521
179940,0migration/13858-21sh00:15:211
179940,0migration/13059-21kthreadcore20:19:471
179940,0migration/128240-21irqrtprio21:19:461
179940,0migration/124360-21gltestperf22:34:451
179940,0migration/121087-21kthreadcore19:44:461
179940,0migration/119147-21unixbench_multi00:04:511
179940,0migration/118531-21latency_hist21:14:301
179940,0migration/112320-21kthreadcore22:44:471
169940,0watchdog/18421-21latency21:24:481
169940,0watchdog/17583-21kthreadcore20:44:481
169940,0watchdog/16969-21ssh22:42:361
169940,0watchdog/15952-21taskset22:23:201
169940,0watchdog/112720-21ssh21:49:361
169940,0watchdog/110475-21users21:44:521
169940,0watchdog/10-21swapper/123:54:481
169940,0watchdog/10-21swapper/123:39:521
169940,0watchdog/10-21swapper/123:29:481
169940,0watchdog/10-21swapper/120:14:481
169940,0watchdog/10-21swapper/119:09:491
149940,0migration/07547-21runrttasks23:01:060
149940,0migration/025775-21aten_r1power_en20:59:400
149940,0migration/024446-21kthreadcore20:34:480
149940,0migration/016347-21kthreadcore19:39:460
108819943,0cyclictest3556-21lldpd19:27:582
108819943,0cyclictest3556-21lldpd19:15:552
108819943,0cyclictest3514-21snmpd20:18:282
108819943,0cyclictest3514-21snmpd19:49:432
108819943,0cyclictest24574-21awk22:34:472
108819943,0cyclictest22520-21awk20:34:462
108819943,0cyclictest15858-21awk20:29:462
108809944,0cyclictest0-21swapper/121:42:081
108809943,0cyclictest7345-21awk19:34:471
108809943,0cyclictest3556-21lldpd22:51:281
108809943,0cyclictest3556-21lldpd22:33:571
108809943,0cyclictest3556-21lldpd22:10:281
108809943,0cyclictest3556-21lldpd22:08:281
108809943,0cyclictest3556-21lldpd21:10:571
108809943,0cyclictest3556-21lldpd20:01:281
108809943,0cyclictest3556-21lldpd19:24:271
108809943,0cyclictest26250-21awk19:24:451
108809943,0cyclictest23264-21awk22:14:431
108809943,0cyclictest21224-21awk23:49:451
108809943,0cyclictest14931-21awk20:04:461
108799944,0cyclictest3514-21snmpd20:34:000
108799944,0cyclictest0-21swapper/023:38:140
108799944,0cyclictest0-21swapper/022:12:380
108799944,0cyclictest0-21swapper/000:17:580
108799943,0cyclictest8486-21grep22:44:420
108799943,0cyclictest7660-21awk22:24:440
108799943,0cyclictest3514-21snmpd23:30:000
108799943,0cyclictest3514-21snmpd23:15:000
108799943,0cyclictest3241-21irqbalance23:04:380
108799943,0cyclictest3241-21irqbalance20:19:490
108799943,0cyclictest29443-21cut21:39:460
108799943,0cyclictest22032-21awk21:54:440
29725030,0irq/27-eth0-tx-0-21swapper/019:19:400
29725030,0irq/27-eth0-tx-0-21swapper/019:14:410
29715030,0irq/26-eth0-rx-0-21swapper/320:39:423
29715030,0irq/26-eth0-rx-0-21swapper/320:29:453
29715030,0irq/26-eth0-rx-0-21swapper/320:28:263
259930,0migration/24599-21unixbench-2d19:04:522
249930,0watchdog/20-21swapper/220:24:522
249930,0watchdog/20-21swapper/219:54:452
169930,0watchdog/10-21swapper/121:29:561
169930,0watchdog/10-21swapper/120:49:441
169930,0watchdog/10-21swapper/120:24:521
108819933,0cyclictest3556-21lldpd18:53:562
108819932,0cyclictest7242-21awk19:34:462
108819930,0cyclictest0-21swapper/220:42:162
108809933,0cyclictest3556-21lldpd19:31:281
108809932,0cyclictest30094-21sensors18:59:511
108809932,0cyclictest26931-21fschecks_count19:49:421
108809932,0cyclictest26817-21perl23:14:431
108809932,0cyclictest21550-21diskstats21:54:421
108809932,0cyclictest18617-21awk23:09:441
108809930,0cyclictest0-21swapper/120:39:471
108809930,0cyclictest0-21swapper/120:13:321
108799933,0cyclictest9223-21awk20:24:450
108799933,0cyclictest22348-21kworker/0:223:19:330
108799933,0cyclictest22348-21kworker/0:222:50:430
108799933,0cyclictest22348-21kworker/0:221:24:310
108799933,0cyclictest22348-21kworker/0:221:19:330
108799933,0cyclictest22348-21kworker/0:221:09:410
108799932,0cyclictest580-21cat19:54:300
108799932,0cyclictest3556-21lldpd20:14:580
108799932,0cyclictest3514-21snmpd18:59:130
108799932,0cyclictest27509-21tail18:59:470
108799932,0cyclictest20501-21cpuspeed_turbos23:49:410
108799932,0cyclictest14621-21kthreadcore21:29:490
108799932,0cyclictest12049-21sensors19:34:530
108799932,0cyclictest11056-21strings22:04:480
108799932,0cyclictest0-21swapper/019:13:460
339920,0migration/327724-21diskstats20:14:433
329920,0watchdog/30-21swapper/319:34:533
29715020,0irq/26-eth0-rx-0-21swapper/320:04:413
29715020,0irq/26-eth0-rx-0-21swapper/319:44:313
29715020,0irq/26-eth0-rx-0-21swapper/318:54:323
29715020,0irq/26-eth0-rx-0-21swapper/318:49:413
169920,0watchdog/10-21swapper/119:39:331
169920,0watchdog/10-21swapper/118:49:331
12210221,0sleep30-21swapper/319:14:423
108799922,0cyclictest22348-21kworker/0:220:44:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional