You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 11:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Mon Sep 07, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450790,0irq/25-eth10-21swapper/318:40:293
1035024746,0sleep00-21swapper/018:41:250
1053823728,0sleep10-21swapper/118:43:381
1059923523,0sleep20-21swapper/218:44:192
339970,0migration/322199-21sh22:11:303
339960,0migration/330292-21sh21:55:083
339960,0migration/330287-21munin-node21:34:583
339960,0migration/319998-21sh00:14:293
339960,0migration/318344-21irqcore21:09:553
29715060,0irq/26-eth0-rx-4326-21ssh23:00:153
27160,0ktimersoftd/20-21swapper/222:04:292
149960,0migration/05697-21sh22:21:110
149960,0migration/024002-21sh21:33:350
149960,0migration/02385-21timerandwakeup00:00:010
149960,0migration/012088-21sh00:09:290
149960,0migration/012041-21sh23:25:550
106979960,0cyclictest14584-21sensors_volt21:25:042
106969960,0cyclictest0-21swapper/121:04:301
106969960,0cyclictest0-21swapper/119:10:021
106959960,0cyclictest0-21swapper/023:35:060
4150,0ktimersoftd/00-21swapper/020:56:300
339950,0migration/35484-21kthreadcore20:14:573
339950,0migration/3484-21aten_r1power_en19:49:503
339950,0migration/332235-21kthreadcore18:59:563
339950,0migration/330759-21idleruntime23:19:523
339950,0migration/328877-21latency22:14:583
339950,0migration/328422-21latency22:34:583
339950,0migration/327715-21munin-node23:14:593
339950,0migration/325071-21latency_hist20:54:393
339950,0migration/323964-21kthreadcore22:54:553
339950,0migration/323501-21unixbench_multi18:50:023
339950,0migration/323279-21sh20:50:103
339950,0migration/322870-21taskset21:51:493
339950,0migration/321677-21taskset23:14:333
339950,0migration/318460-21latency_hist19:14:393
339950,0migration/316297-21kthreadcore23:49:553
339950,0migration/31434-21fschecks_time21:19:533
339950,0migration/313725-21aten2.4-expect23:29:513
29725050,0irq/27-eth0-tx-6215-21munin-node19:30:010
29725050,0irq/27-eth0-tx-28542-21unixbench_multi22:55:022
29725050,0irq/27-eth0-tx-25223-21munin-node19:20:010
29725050,0irq/27-eth0-tx-19818-21python23:10:002
29725050,0irq/27-eth0-tx-16152-21munin-node21:49:552
29725050,0irq/27-eth0-tx-0-21swapper/020:44:570
29725050,0irq/27-eth0-tx-0-21swapper/019:05:030
29715050,0irq/26-eth0-rx-9185-21kthreadcore22:04:563
29715050,0irq/26-eth0-rx-6559-21runrttasks22:43:123
29715050,0irq/26-eth0-rx-5780-21kernelversion00:04:553
29715050,0irq/26-eth0-rx-31631-21ssh21:15:513
29715050,0irq/26-eth0-rx-17619-21kthreadcore22:29:543
29715050,0irq/26-eth0-rx-11511-21cut19:54:583
29715050,0irq/26-eth0-rx-10352-21kthreadcore20:19:563
29715050,0irq/26-eth0-rx-0-21swapper/323:59:593
29715050,0irq/26-eth0-rx-0-21swapper/323:55:413
29715050,0irq/26-eth0-rx-0-21swapper/323:43:423
29715050,0irq/26-eth0-rx-0-21swapper/323:04:543
29715050,0irq/26-eth0-rx-0-21swapper/322:19:463
29715050,0irq/26-eth0-rx-0-21swapper/321:32:293
29715050,0irq/26-eth0-rx-0-21swapper/321:25:003
29715050,0irq/26-eth0-rx-0-21swapper/321:04:423
29715050,0irq/26-eth0-rx-0-21swapper/320:59:563
29715050,0irq/26-eth0-rx-0-21swapper/320:34:513
29715050,0irq/26-eth0-rx-0-21swapper/319:45:233
29715050,0irq/26-eth0-rx-0-21swapper/319:34:583
249950,0watchdog/220790-21kthreadcore20:49:572
249950,0watchdog/211038-21kthreadcore19:29:572
19150,0ktimersoftd/10-21swapper/123:03:411
179950,0migration/17787-21taskset20:18:021
179950,0migration/16450-21runrttasks21:40:111
179950,0migration/1445-21aten_r1power_cu19:49:501
179950,0migration/128719-21pmu-power22:35:001
179950,0migration/128616-21unixbench_singl22:55:021
179950,0migration/127242-21kthreadcore21:14:571
179950,0migration/116206-21kthreadcore23:09:551
179950,0migration/115252-21taskset22:09:291
149950,0migration/0988-21aten_r1power_en20:59:500
149950,0migration/0925-21kthreadcore18:59:560
149950,0migration/08394-21kthreadcore22:44:570
149950,0migration/0626-21kthreadcore22:59:550
149950,0migration/05888-21missed_timers19:49:570
149950,0migration/04969-21kthreadcore20:39:550
149950,0migration/03808-21kthreadcore20:14:560
149950,0migration/032577-21taskset19:48:470
149950,0migration/025575-21kthreadcore22:14:560
149950,0migration/024962-21needreboot19:39:580
149950,0migration/024352-21kthreadcore23:14:550
149950,0migration/022606-21netstat20:49:580
149950,0migration/017159-21kthreadcore22:49:560
149950,0migration/016390-21kthreadcore23:29:560
149950,0migration/016051-21kthreadcore19:34:580
149950,0migration/01492-21kthreadcore19:24:550
149950,0migration/01490-21kernelversion21:39:550
149950,0migration/014468-21fschecks_time19:59:520
149950,0migration/014163-21kthreadcore19:09:560
149950,0migration/013488-21missed_timers20:19:580
149950,0migration/011479-21ksmtuned23:45:500
106979955,0cyclictest0-21swapper/222:37:442
106979954,0cyclictest3514-21snmpd23:31:012
106979954,0cyclictest3514-21snmpd20:15:452
106979954,0cyclictest3514-21snmpd19:26:442
106979953,0cyclictest22782-21sadc22:34:382
106979950,0cyclictest0-21swapper/223:15:252
106979950,0cyclictest0-21swapper/221:30:352
106979950,0cyclictest0-21swapper/221:01:442
106969955,0cyclictest0-21swapper/121:22:381
106969955,0cyclictest0-21swapper/120:57:051
106969950,0cyclictest0-21swapper/122:40:211
106969950,0cyclictest0-21swapper/121:44:421
106959955,0cyclictest0-21swapper/022:36:370
106959955,0cyclictest0-21swapper/022:28:340
106959955,0cyclictest0-21swapper/021:12:060
106959950,0cyclictest0-21swapper/022:54:540
106959950,0cyclictest0-21swapper/022:04:460
339940,0migration/38911-21kthreadcore19:29:563
339940,0migration/34246-21kthreadcore20:39:553
339940,0migration/331329-21kthreadcore20:09:573
339940,0migration/330573-21runrttasks18:58:473
339940,0migration/327042-21latency_hist20:09:393
339940,0migration/32333-21kthreadcore21:39:563
339940,0migration/316147-21kthreadcore22:49:563
339940,0migration/315418-21fschecks_time20:24:523
29725040,0irq/27-eth0-tx-30878-21proc_pri21:15:012
29725040,0irq/27-eth0-tx-30300-21idleruntime23:39:542
29725040,0irq/27-eth0-tx-12051-21ssh22:44:582
29725040,0irq/27-eth0-tx-11073-21ssh00:06:242
29725040,0irq/27-eth0-tx-0-21swapper/223:49:502
29725040,0irq/27-eth0-tx-0-21swapper/223:44:402
29725040,0irq/27-eth0-tx-0-21swapper/223:04:452
29725040,0irq/27-eth0-tx-0-21swapper/222:24:552
29725040,0irq/27-eth0-tx-0-21swapper/222:09:492
29725040,0irq/27-eth0-tx-0-21swapper/221:44:452
29725040,0irq/27-eth0-tx-0-21swapper/221:39:492
29725040,0irq/27-eth0-tx-0-21swapper/221:34:442
29725040,0irq/27-eth0-tx-0-21swapper/221:20:262
29725040,0irq/27-eth0-tx-0-21swapper/221:09:542
29725040,0irq/27-eth0-tx-0-21swapper/221:04:592
29725040,0irq/27-eth0-tx-0-21swapper/220:54:492
29725040,0irq/27-eth0-tx-0-21swapper/220:46:432
29725040,0irq/27-eth0-tx-0-21swapper/200:10:152
29725040,0irq/27-eth0-tx-0-21swapper/020:34:540
29725040,0irq/27-eth0-tx-0-21swapper/020:29:510
29715040,0irq/26-eth0-rx-0-21swapper/323:44:423
29715040,0irq/26-eth0-rx-0-21swapper/323:34:573
29715040,0irq/26-eth0-rx-0-21swapper/323:24:513
29715040,0irq/26-eth0-rx-0-21swapper/322:44:523
29715040,0irq/26-eth0-rx-0-21swapper/322:24:493
29715040,0irq/26-eth0-rx-0-21swapper/321:47:503
29715040,0irq/26-eth0-rx-0-21swapper/320:44:523
29715040,0irq/26-eth0-rx-0-21swapper/319:14:523
259940,0migration/232073-21fschecks_time22:19:512
259940,0migration/231475-21latency19:44:572
259940,0migration/22295-21kthreadcore22:59:562
259940,0migration/221408-21latency_hist23:34:382
249940,0watchdog/22150-21cut22:39:562
249940,0watchdog/214200-21kernelversion19:34:572
249940,0watchdog/20-21swapper/223:59:562
249940,0watchdog/20-21swapper/223:54:562
249940,0watchdog/20-21swapper/222:04:492
249940,0watchdog/20-21swapper/220:40:012
249940,0watchdog/20-21swapper/220:04:572
249940,0watchdog/20-21swapper/219:39:572
179940,0migration/19243-21kthreadcore22:44:571
179940,0migration/18102-21kthreadcore23:24:561
179940,0migration/14967-21latency_hist23:44:381
179940,0migration/14879-21kthreadcore21:59:561
179940,0migration/131851-21kthreadcore23:39:571
179940,0migration/129415-21kthreadcore18:54:551
179940,0migration/128104-21taskset23:58:121
179940,0migration/126056-21latency_hist19:44:391
179940,0migration/125285-21kthreadcore20:29:561
179940,0migration/124811-21irqrtprio22:14:561
179940,0migration/124384-21kthreadcore23:14:551
179940,0migration/121797-21kthreadcore21:29:561
179940,0migration/117163-21latency_hist21:09:391
179940,0migration/116616-21kthreadcore19:34:581
179940,0migration/115151-21kthreadcore23:29:561
179940,0migration/113095-21timerandwakeup22:25:041
169940,0watchdog/19253-21kthreadcore23:04:561
169940,0watchdog/125606-21sh21:34:531
169940,0watchdog/121121-21unixbench-2d22:30:001
169940,0watchdog/115453-21ssh21:05:211
169940,0watchdog/111173-21kthreadcore20:44:571
169940,0watchdog/10-21swapper/122:49:561
169940,0watchdog/10-21swapper/120:50:491
169940,0watchdog/10-21swapper/119:54:571
149940,0migration/029136-21kthreadcore21:54:560
149940,0migration/02618-21kthreadcore23:19:550
149940,0migration/019425-21kthreadcore18:49:560
149940,0migration/018148-21runrttasks00:10:000
149940,0migration/018080-21kthreadcore23:49:560
106979944,0cyclictest29530-21timerwakeupswit22:15:022
106979943,0cyclictest8150-21awk19:54:562
106979943,0cyclictest6498-21awk23:24:542
106979943,0cyclictest3556-21lldpd20:34:522
106979943,0cyclictest3556-21lldpd20:20:212
106979943,0cyclictest3556-21lldpd20:10:512
106979943,0cyclictest3556-21lldpd20:01:212
106979943,0cyclictest3514-21snmpd22:50:462
106979943,0cyclictest3514-21snmpd19:22:142
106979943,0cyclictest3514-21snmpd19:12:292
106979943,0cyclictest3514-21snmpd18:49:442
106979943,0cyclictest3241-21irqbalance21:55:072
106979943,0cyclictest3241-21irqbalance19:49:472
106979943,0cyclictest3241-21irqbalance19:04:472
106979943,0cyclictest31800-21awk18:59:542
106979943,0cyclictest30824-21awk23:19:522
106979943,0cyclictest25149-21awk18:54:522
106979943,0cyclictest22351-21awk20:29:542
106979943,0cyclictest19455-21awk19:14:562
106979943,0cyclictest15736-21awk20:24:542
106979943,0cyclictest11896-21awk18:44:552
106969944,0cyclictest0-21swapper/122:22:041
106969943,0cyclictest9678-21awk21:24:571
106969943,0cyclictest6112-21awk19:04:551
106969943,0cyclictest3514-21snmpd23:35:161
106969943,0cyclictest3514-21snmpd20:24:151
106969943,0cyclictest3514-21snmpd20:05:151
106969943,0cyclictest3514-21snmpd19:29:441
106969943,0cyclictest3514-21snmpd19:24:591
106969943,0cyclictest3514-21snmpd00:10:011
106969943,0cyclictest3514-21snmpd00:01:461
106969943,0cyclictest3292-21awk20:39:531
106969943,0cyclictest31848-21awk18:59:541
106969943,0cyclictest28015-21awk20:09:541
106969943,0cyclictest27227-21awk19:44:551
106969943,0cyclictest26074-21awk19:19:531
106969943,0cyclictest18520-21awk18:49:541
106969943,0cyclictest17050-21awk21:49:531
106969943,0cyclictest14826-21awk19:59:531
106969943,0cyclictest13904-21awk23:49:521
106959944,0cyclictest0-21swapper/021:04:420
106959943,0cyclictest3556-21lldpd23:43:230
106959943,0cyclictest3556-21lldpd23:04:530
106959943,0cyclictest3556-21lldpd21:27:230
106959943,0cyclictest3556-21lldpd21:16:230
106959943,0cyclictest3514-21snmpd23:11:010
106959943,0cyclictest3241-21irqbalance22:03:170
106959943,0cyclictest21505-21awk20:04:550
29725030,0irq/27-eth0-tx-7329-21aten2.4-expect19:54:520
29715030,0irq/26-eth0-rx-0-21swapper/321:59:493
29715030,0irq/26-eth0-rx-0-21swapper/320:29:503
29715030,0irq/26-eth0-rx-0-21swapper/319:39:503
29715030,0irq/26-eth0-rx-0-21swapper/319:04:523
29715030,0irq/26-eth0-rx-0-21swapper/318:44:513
169930,0watchdog/18919-21diskmemload00:05:161
169930,0watchdog/131151-21kthreadcore20:34:571
169930,0watchdog/10-21swapper/121:54:531
106969932,0cyclictest3556-21lldpd20:25:511
106969932,0cyclictest11715-21idleruntime18:44:541
106969930,0cyclictest30538-21perl23:19:511
106969930,0cyclictest16313-21head22:09:531
106959933,0cyclictest391-21kworker/0:123:55:010
106959933,0cyclictest391-21kworker/0:122:39:500
106959933,0cyclictest391-21kworker/0:122:30:060
106959933,0cyclictest391-21kworker/0:122:09:460
106959933,0cyclictest391-21kworker/0:121:49:520
106959933,0cyclictest391-21kworker/0:121:45:080
106959933,0cyclictest391-21kworker/0:121:34:400
106959933,0cyclictest20368-21kworker/0:221:20:080
106959933,0cyclictest20368-21kworker/0:220:24:560
106959933,0cyclictest20368-21kworker/0:220:09:520
106959933,0cyclictest17154-21kworker/0:019:14:460
106959933,0cyclictest17154-21kworker/0:018:55:120
106959933,0cyclictest17154-21kworker/0:018:44:410
339920,0migration/314292-21diskstats19:59:513
29715020,0irq/26-eth0-rx-0-21swapper/319:24:443
29715020,0irq/26-eth0-rx-0-21swapper/319:19:413
169920,0watchdog/10-21swapper/119:14:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional