You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-28 - 01:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Fri Aug 28, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/318:45:353
2794323724,0sleep00-21swapper/018:42:330
2789123127,0sleep10-21swapper/118:41:581
2788223127,0sleep20-21swapper/218:41:512
339960,0migration/36897-21sh22:54:323
339960,0migration/35681-21sh23:55:283
339960,0migration/332347-21sh21:47:453
339960,0migration/329794-21sh00:10:433
339960,0migration/326035-21munin-node19:55:533
339960,0migration/325049-21unixbench_multi20:15:593
339960,0migration/323365-21sh22:23:033
339960,0migration/315161-21sh22:38:473
29725060,0irq/27-eth0-tx-2740-21munin-node18:50:510
29725060,0irq/27-eth0-tx-17134-21munin-node19:25:470
29715060,0irq/26-eth0-rx-13164-21yum23:15:573
29715060,0irq/26-eth0-rx-11146-21if_eth020:55:513
149960,0migration/0742-21sh21:50:210
149960,0migration/07163-21sh22:33:350
149960,0migration/024503-21kthreadcore19:05:520
149960,0migration/021683-21munin-node19:00:560
149960,0migration/020517-21sh00:02:190
149960,0migration/016517-21sh21:37:550
149960,0migration/011440-21mdstat23:55:550
8215050,0irq/24-0000:00:10236-21munin-run19:20:362
339950,0migration/39621-21df_abs21:55:493
339950,0migration/38202-21kthreadcore20:05:533
339950,0migration/37984-21kthreadcore23:35:543
339950,0migration/3529-21sh22:10:443
339950,0migration/34568-21munin-node23:31:003
339950,0migration/3425-21sh20:46:063
339950,0migration/33606-21kthreadcore21:30:533
339950,0migration/330222-21kthreadcore21:05:543
339950,0migration/325574-21sh21:03:563
339950,0migration/324528-21kthreadcore19:05:523
339950,0migration/324068-21kthreadcore23:45:523
339950,0migration/322749-21munin-node00:05:493
339950,0migration/321678-21taskset23:01:083
339950,0migration/321060-21munin-node20:40:523
339950,0migration/320990-21kthreadcore19:50:523
339950,0migration/31980-21unixbench_multi18:45:583
339950,0migration/318686-21if_eth1.321:40:533
339950,0migration/315409-21kthreadcore19:45:533
339950,0migration/314370-21if_eth1.320:35:503
339950,0migration/312206-21kthreadcore22:15:523
29725050,0irq/27-eth0-tx-6824-21cpuspeed_turbos23:35:482
29725050,0irq/27-eth0-tx-6316-21ssh22:52:502
29725050,0irq/27-eth0-tx-4087-21sed23:50:582
29725050,0irq/27-eth0-tx-29527-21ssh00:10:352
29725050,0irq/27-eth0-tx-25767-21munin-node20:20:560
29725050,0irq/27-eth0-tx-17173-21munin-node22:00:512
29725050,0irq/27-eth0-tx-15305-21ssh22:17:382
29725050,0irq/27-eth0-tx-0-21swapper/223:59:102
29725050,0irq/27-eth0-tx-0-21swapper/223:50:252
29725050,0irq/27-eth0-tx-0-21swapper/222:22:342
29725050,0irq/27-eth0-tx-0-21swapper/222:11:482
29725050,0irq/27-eth0-tx-0-21swapper/221:47:202
29725050,0irq/27-eth0-tx-0-21swapper/221:05:352
29725050,0irq/27-eth0-tx-0-21swapper/020:45:380
29725050,0irq/27-eth0-tx-0-21swapper/020:05:480
29725050,0irq/27-eth0-tx-0-21swapper/019:15:240
29715050,0irq/26-eth0-rx-4581-21kthreadcore22:30:533
29715050,0irq/26-eth0-rx-28266-21kthreadcore22:45:523
29715050,0irq/26-eth0-rx-24325-21fschecks_time19:30:483
29715050,0irq/26-eth0-rx-18929-21kthreadcore23:20:523
29715050,0irq/26-eth0-rx-14834-21if_err_eth1.200:00:503
29715050,0irq/26-eth0-rx-11994-21kthreadcore21:15:533
29715050,0irq/26-eth0-rx-11700-21proc_pri23:55:573
29715050,0irq/26-eth0-rx-0-21swapper/323:40:473
29715050,0irq/26-eth0-rx-0-21swapper/323:26:183
29715050,0irq/26-eth0-rx-0-21swapper/323:10:533
29715050,0irq/26-eth0-rx-0-21swapper/322:09:233
29715050,0irq/26-eth0-rx-0-21swapper/321:39:373
29715050,0irq/26-eth0-rx-0-21swapper/321:26:403
29715050,0irq/26-eth0-rx-0-21swapper/321:25:303
29715050,0irq/26-eth0-rx-0-21swapper/320:50:573
29715050,0irq/26-eth0-rx-0-21swapper/320:25:523
282749955,0cyclictest0-21swapper/123:02:131
282749955,0cyclictest0-21swapper/122:19:581
282749955,0cyclictest0-21swapper/121:32:111
282749955,0cyclictest0-21swapper/121:27:371
282749955,0cyclictest0-21swapper/121:12:291
282749950,0cyclictest0-21swapper/123:54:141
282749950,0cyclictest0-21swapper/122:37:281
282749950,0cyclictest0-21swapper/121:44:101
282749950,0cyclictest0-21swapper/121:23:031
282749950,0cyclictest0-21swapper/120:57:211
282739955,0cyclictest0-21swapper/023:20:510
282739952,0cyclictest31222-21munin-run20:00:360
282739950,0cyclictest0-21swapper/021:22:270
282739950,0cyclictest0-21swapper/020:57:420
259950,0migration/29227-21sh21:35:012
259950,0migration/26066-21munin-node22:30:592
259950,0migration/228946-21kthreadcore20:45:522
259950,0migration/226841-21fschecks_time21:25:492
259950,0migration/226806-21cpuspeed_turbos21:05:482
259950,0migration/223855-21latency_hist22:45:362
259950,0migration/223390-21sh23:05:402
259950,0migration/219461-21kthreadcore23:00:522
259950,0migration/217189-21sh21:18:192
249950,0watchdog/22149-21grep23:30:532
249950,0watchdog/221252-21ssh23:42:492
249950,0watchdog/216965-21kthreadcore20:10:542
249950,0watchdog/215359-21kthreadcore20:55:542
249950,0watchdog/211187-21kthreadcore21:55:542
179950,0migration/19476-21kthreadcore22:55:521
179950,0migration/18461-21munin-node18:50:571
179950,0migration/15755-21taskset22:51:091
179950,0migration/131164-21cpuspeed_turbos23:30:481
179950,0migration/123817-21kthreadcore00:05:511
149950,0migration/09990-21kthreadcore19:40:540
149950,0migration/09935-21fschecks_count18:55:480
149950,0migration/07724-21sh21:51:560
149950,0migration/07034-21sh22:11:380
149950,0migration/05965-21unixbench_multi20:25:580
149950,0migration/05396-21taskset20:04:150
149950,0migration/031058-21kthreadcore18:45:530
149950,0migration/02961-21idleruntime20:50:510
149950,0migration/029236-21sh23:26:200
149950,0migration/029151-21kthreadcore21:25:530
149950,0migration/029042-21kthreadcore22:25:530
149950,0migration/028874-21kthreadcore21:05:530
149950,0migration/028342-21kthreadcore22:05:540
149950,0migration/02828-21kthreadcore23:30:540
149950,0migration/025828-21kthreadcore22:45:510
149950,0migration/024104-21kthreadcore20:40:540
149950,0migration/023907-21sh22:24:410
149950,0migration/022907-21taskset23:04:540
149950,0migration/01995-21kthreadcore19:35:540
149950,0migration/019222-21timerwakeupswit20:35:580
149950,0migration/018722-21df_abs21:00:480
149950,0migration/016531-21kthreadcore20:10:540
149950,0migration/016527-21taskset19:21:200
149950,0migration/015278-21sh22:39:080
149950,0migration/011916-21kthreadcore21:55:540
149950,0migration/011827-21kthreadcore23:15:500
339940,0migration/39997-21kthreadcore20:30:533
339940,0migration/37413-21kthreadcore19:15:533
339940,0migration/320763-21kthreadcore19:25:523
339940,0migration/31400-21cpuspeed_turbos21:50:473
29725040,0irq/27-eth0-tx-3832-21telnet19:15:470
29725040,0irq/27-eth0-tx-0-21swapper/223:22:012
29725040,0irq/27-eth0-tx-0-21swapper/222:55:482
29725040,0irq/27-eth0-tx-0-21swapper/222:40:472
29725040,0irq/27-eth0-tx-0-21swapper/222:25:472
29725040,0irq/27-eth0-tx-0-21swapper/221:36:212
29725040,0irq/27-eth0-tx-0-21swapper/221:10:392
29725040,0irq/27-eth0-tx-0-21swapper/220:50:462
29725040,0irq/27-eth0-tx-0-21swapper/200:10:412
29725040,0irq/27-eth0-tx-0-21swapper/020:15:480
29725040,0irq/27-eth0-tx-0-21swapper/019:35:280
29715040,0irq/26-eth0-rx-0-21swapper/323:05:493
29715040,0irq/26-eth0-rx-0-21swapper/322:55:473
29715040,0irq/26-eth0-rx-0-21swapper/322:41:513
29715040,0irq/26-eth0-rx-0-21swapper/322:25:403
29715040,0irq/26-eth0-rx-0-21swapper/322:01:223
29715040,0irq/26-eth0-rx-0-21swapper/321:10:493
29715040,0irq/26-eth0-rx-0-21swapper/320:10:523
29715040,0irq/26-eth0-rx-0-21swapper/320:03:033
29715040,0irq/26-eth0-rx-0-21swapper/319:35:473
282759944,0cyclictest0-21swapper/223:10:442
282759943,0cyclictest8967-21awk22:35:512
282759943,0cyclictest3514-21snmpd19:23:122
282759943,0cyclictest3514-21snmpd19:15:272
282759943,0cyclictest3514-21snmpd19:04:422
282759943,0cyclictest29441-21awk18:45:512
282759943,0cyclictest26604-21awk20:20:512
282759943,0cyclictest26006-21awk22:05:512
282749944,0cyclictest0-21swapper/123:47:181
282749943,0cyclictest3556-21lldpd22:20:421
282749943,0cyclictest3514-21snmpd21:52:271
282749943,0cyclictest3514-21snmpd20:32:121
282749943,0cyclictest3514-21snmpd20:11:421
282749943,0cyclictest3514-21snmpd20:09:421
282749943,0cyclictest3514-21snmpd20:03:121
282749943,0cyclictest3514-21snmpd19:46:121
282749943,0cyclictest3514-21snmpd19:40:421
282749943,0cyclictest3514-21snmpd19:17:421
282749943,0cyclictest3514-21snmpd19:05:421
282749943,0cyclictest3241-21irqbalance23:17:541
282749943,0cyclictest3241-21irqbalance21:16:041
282749943,0cyclictest3241-21irqbalance20:49:041
282749943,0cyclictest3241-21irqbalance19:35:551
282749943,0cyclictest27476-21awk21:05:511
282749943,0cyclictest26542-21awk21:45:501
282749943,0cyclictest25965-21awk22:05:511
282749943,0cyclictest24974-21awk22:45:501
282749943,0cyclictest22654-21sadc23:25:351
282749943,0cyclictest22572-21sadc19:05:361
282749943,0cyclictest19125-21irqcore19:50:511
282749943,0cyclictest15457-21awk23:40:501
282749943,0cyclictest14911-21awk00:00:501
282749943,0cyclictest14300-21awk20:35:501
282749943,0cyclictest10411-21awk18:55:501
282739943,0cyclictest7647-21awk20:30:510
282739943,0cyclictest3514-21snmpd23:40:420
282739943,0cyclictest3514-21snmpd23:36:420
282739943,0cyclictest3514-21snmpd22:01:120
282739943,0cyclictest3514-21snmpd19:51:120
282739943,0cyclictest31331-21awk23:50:500
282739943,0cyclictest3024-21kworker/0:122:55:570
282739943,0cyclictest24352-21awk23:05:510
259940,0migration/29339-21kthreadcore23:15:492
259940,0migration/25340-21fschecks_time19:40:492
259940,0migration/25032-21kthreadcore21:50:532
259940,0migration/23972-21irqrtprio18:50:522
259940,0migration/227612-21kthreadcore19:55:542
259940,0migration/224203-21kthreadcore19:05:522
259940,0migration/223951-21kthreadcore20:40:542
259940,0migration/221689-21kthreadcore21:20:562
259940,0migration/218326-21fschecks_time21:40:502
259940,0migration/213605-21kthreadcore18:55:522
259940,0migration/210577-21kthreadcore20:30:532
249940,0watchdog/20-21swapper/223:25:492
249940,0watchdog/20-21swapper/220:05:542
249940,0watchdog/20-21swapper/200:00:532
179940,0migration/17961-21kthreadcore23:55:531
179940,0migration/15663-21kthreadcore22:10:551
179940,0migration/13795-21kthreadcore20:25:521
179940,0migration/1322-21kthreadcore18:45:531
179940,0migration/131298-21kthreadcore00:10:531
179940,0migration/130863-21taskset19:56:361
179940,0migration/130336-21kthreadcore20:20:541
179940,0migration/128047-21kthreadcore23:05:531
179940,0migration/121794-21kthreadcore21:00:531
179940,0migration/121672-21kthreadcore20:15:531
179940,0migration/121648-21kthreadcore20:40:541
179940,0migration/119184-21kthreadcore22:00:561
179940,0migration/117127-21taskset19:25:421
179940,0migration/110961-21fschecks_count19:20:491
169940,0watchdog/13746-21cut20:50:541
169940,0watchdog/132105-21ssh22:30:221
169940,0watchdog/126098-21kthreadcore23:25:531
169940,0watchdog/117375-21kthreadcore22:40:541
169940,0watchdog/111189-21kthreadcore21:55:541
169940,0watchdog/10-21swapper/123:10:531
169940,0watchdog/10-21swapper/122:33:581
149940,0migration/05668-21runrttasks22:51:000
149940,0migration/026443-21kthreadcore00:05:520
149940,0migration/020743-21kthreadcore21:40:550
149940,0migration/014069-21kthreadcore21:15:540
339930,0migration/35161-21kthreadcore18:50:533
29715030,0irq/26-eth0-rx-0-21swapper/319:40:493
29715030,0irq/26-eth0-rx-0-21swapper/319:21:263
29715030,0irq/26-eth0-rx-0-21swapper/319:10:443
29715030,0irq/26-eth0-rx-0-21swapper/319:03:413
29715030,0irq/26-eth0-rx-0-21swapper/318:55:463
282759933,0cyclictest32427-21awk20:00:512
282759933,0cyclictest24740-21awk19:30:502
282759932,0cyclictest3241-21irqbalance19:45:542
282759932,0cyclictest14348-21awk20:35:502
282759930,0cyclictest0-21swapper/219:36:402
282749932,0cyclictest9860-21cut21:35:471
282749932,0cyclictest3514-21snmpd19:11:421
282749930,0cyclictest6938-21diskstats23:35:491
282739933,0cyclictest3024-21kworker/0:123:45:480
282739933,0cyclictest3024-21kworker/0:123:10:370
282739933,0cyclictest3024-21kworker/0:121:30:430
282739933,0cyclictest30088-21kworker/0:219:45:370
282739933,0cyclictest28255-21kworker/0:200:10:420
282739933,0cyclictest0-21swapper/022:15:440
282739932,0cyclictest3272-21iostat_ios21:10:520
282739932,0cyclictest19089-21grep22:40:540
259930,0migration/25143-21kthreadcore20:25:532
249930,0watchdog/20-21swapper/219:25:462
179930,0migration/126799-21kthreadcore19:30:521
29715020,0irq/26-eth0-rx-0-21swapper/320:20:503
282759920,0cyclictest0-21swapper/220:15:362
249920,0watchdog/20-21swapper/219:50:382
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional