You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 03:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 02, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2747323627,0sleep10-21swapper/118:49:591
304450350,0irq/25-eth10-21swapper/318:49:013
2764423322,0sleep00-21swapper/018:51:580
2759923324,0sleep20-21swapper/218:51:242
8215060,0irq/24-0000:00:2108-21munin-run18:58:552
35160,0ktimersoftd/30-21swapper/322:44:233
339960,0migration/37281-21sh23:59:413
339960,0migration/315546-21sh00:05:233
339960,0migration/310775-21gltestperf19:29:093
339960,0migration/310475-21aten_r1power_fr21:44:053
29725060,0irq/27-eth0-tx-23350-21munin-node19:39:080
29715060,0irq/26-eth0-rx-30847-21munin-node00:14:153
29715060,0irq/26-eth0-rx-25356-21ssh22:12:173
278829966,0cyclictest0-21swapper/223:17:282
278829966,0cyclictest0-21swapper/221:03:182
278829965,0cyclictest0-21swapper/200:00:212
278829960,0cyclictest0-21swapper/221:33:342
278819966,0cyclictest8469-21sensors21:19:151
278819966,0cyclictest23662-21ssh23:29:291
278819966,0cyclictest0-21swapper/123:34:501
149960,0migration/07506-21sh23:39:450
149960,0migration/0393-21sh22:36:140
149960,0migration/025680-21fschecks_count20:29:080
149960,0migration/023382-21sh00:09:520
149960,0migration/017085-21sh22:06:330
149960,0migration/010174-21aten_r1power_po19:29:070
8215050,0irq/24-0000:00:3087-21munin-run19:23:552
8215050,0irq/24-0000:00:2127-21cat21:38:532
339950,0migration/38508-21taskset19:00:133
339950,0migration/37452-21kthreadcore19:24:123
339950,0migration/34398-21aten2.4-expect19:49:043
339950,0migration/33536-21kthreadcore20:59:143
339950,0migration/327950-21kthreadcore22:14:113
339950,0migration/326612-21munin-node23:14:093
339950,0migration/32187-21munin-node23:19:093
339950,0migration/32122-21latency_hist21:38:533
339950,0migration/319718-21kernelversion21:49:093
339950,0migration/319367-21kthreadcore19:34:123
339950,0migration/31835-21taskset18:55:573
339950,0migration/318091-21cpuspeed_turbos22:49:063
339950,0migration/315763-21taskset23:04:213
339950,0migration/31360-21cpuspeed_turbos23:39:063
339950,0migration/312898-21aten_r1power_en20:44:043
339950,0migration/312172-21kthreadcore21:04:103
339950,0migration/310216-21aten_r1power_en22:04:053
29725050,0irq/27-eth0-tx-26618-21df_inode22:14:072
29725050,0irq/27-eth0-tx-24638-21ssh21:49:332
29725050,0irq/27-eth0-tx-2456-21kthreadcore23:39:112
29725050,0irq/27-eth0-tx-1863-21cut22:19:052
29725050,0irq/27-eth0-tx-10942-21interrupts22:24:092
29725050,0irq/27-eth0-tx-10422-21munin-node21:04:162
29725050,0irq/27-eth0-tx-0-21swapper/223:34:102
29725050,0irq/27-eth0-tx-0-21swapper/221:57:222
29725050,0irq/27-eth0-tx-0-21swapper/221:35:042
29725050,0irq/27-eth0-tx-0-21swapper/221:24:112
29725050,0irq/27-eth0-tx-0-21swapper/019:54:170
29725050,0irq/27-eth0-tx-0-21swapper/019:49:120
29725050,0irq/27-eth0-tx-0-21swapper/019:34:130
29725050,0irq/27-eth0-tx-0-21swapper/018:54:050
29715050,0irq/26-eth0-rx-6559-21runrttasks21:28:363
29715050,0irq/26-eth0-rx-3424-21kthreadcore22:19:113
29715050,0irq/26-eth0-rx-30242-21cut21:34:113
29715050,0irq/26-eth0-rx-26482-21munin-node23:54:113
29715050,0irq/26-eth0-rx-23811-21ssh23:50:283
29715050,0irq/26-eth0-rx-23162-21users00:09:173
29715050,0irq/26-eth0-rx-0-21swapper/323:44:063
29715050,0irq/26-eth0-rx-0-21swapper/323:09:063
29715050,0irq/26-eth0-rx-0-21swapper/322:38:593
29715050,0irq/26-eth0-rx-0-21swapper/322:33:593
29715050,0irq/26-eth0-rx-0-21swapper/321:59:173
29715050,0irq/26-eth0-rx-0-21swapper/321:54:493
29715050,0irq/26-eth0-rx-0-21swapper/321:29:043
29715050,0irq/26-eth0-rx-0-21swapper/321:19:113
29715050,0irq/26-eth0-rx-0-21swapper/321:13:253
29715050,0irq/26-eth0-rx-0-21swapper/320:55:563
29715050,0irq/26-eth0-rx-0-21swapper/320:24:073
278829955,0cyclictest0-21swapper/223:33:512
278829955,0cyclictest0-21swapper/222:50:392
278829955,0cyclictest0-21swapper/222:45:182
278829955,0cyclictest0-21swapper/222:04:472
278829955,0cyclictest0-21swapper/221:20:572
278829955,0cyclictest0-21swapper/220:14:162
278829955,0cyclictest0-21swapper/200:04:172
278829950,0cyclictest0-21swapper/223:52:282
278829950,0cyclictest0-21swapper/223:25:392
278829950,0cyclictest0-21swapper/222:56:012
278829950,0cyclictest0-21swapper/222:36:002
278829950,0cyclictest0-21swapper/200:17:132
278819955,0cyclictest0-21swapper/121:57:431
278819955,0cyclictest0-21swapper/121:38:201
278819954,0cyclictest13818-21awk20:44:091
278819950,0cyclictest0-21swapper/123:17:201
278819950,0cyclictest0-21swapper/121:03:201
278809955,0cyclictest25978-21diskmemload21:09:080
27150,0ktimersoftd/20-21swapper/223:08:472
27150,0ktimersoftd/20-21swapper/200:19:222
259950,0migration/29019-21latency_hist19:03:552
259950,0migration/225521-21sh22:12:462
259950,0migration/219156-21kthreadcore00:09:102
259950,0migration/216607-21sh21:44:322
179950,0migration/19103-21sh22:01:391
179950,0migration/13651-21kthreadcore23:19:111
179950,0migration/12668-21munin-node19:19:201
179950,0migration/125506-21sh22:53:421
179950,0migration/124821-21latency20:49:131
179950,0migration/116767-21sh22:05:391
179950,0migration/116046-21munin-node19:09:051
179950,0migration/116046-21munin-node19:09:051
179950,0migration/114900-21kthreadcore19:29:131
179950,0migration/112887-21kthreadcore21:24:111
169950,0watchdog/121328-21kthreadcore22:29:121
149950,0migration/06765-21munin-node00:19:160
149950,0migration/06593-21kthreadcore22:19:120
149950,0migration/04936-21kthreadcore20:59:140
149950,0migration/04694-21kthreadcore22:39:110
149950,0migration/03847-21kthreadcore18:59:090
149950,0migration/0328-21taskset21:34:200
149950,0migration/029846-21hwlatdetect19:19:090
149950,0migration/029651-21kthreadcore21:54:090
149950,0migration/029335-21kthreadcore20:54:110
149950,0migration/027557-21kthreadcore23:14:100
149950,0migration/027524-21gltestperf21:14:060
149950,0migration/025198-21sendmail_mailtr20:49:170
149950,0migration/024249-21kthreadcore19:14:100
149950,0migration/024249-21kthreadcore19:14:100
149950,0migration/023188-21latency22:49:120
149950,0migration/022290-21kthreadcore23:29:130
149950,0migration/019070-21taskset20:46:230
149950,0migration/018140-21fschecks_count19:59:080
149950,0migration/014581-21ntp_offset00:04:130
149950,0migration/013706-21kthreadcore22:24:110
149950,0migration/012957-21kthreadcore22:44:090
149950,0migration/010493-21latency_hist21:23:530
149950,0migration/010491-21kthreadcore20:39:140
339940,0migration/3646-21runrttasks20:34:093
339940,0migration/329254-21kthreadcore20:29:133
339940,0migration/315384-21missed_timers22:24:123
29725040,0irq/27-eth0-tx-31014-21telnet20:09:030
29725040,0irq/27-eth0-tx-0-21swapper/223:54:052
29725040,0irq/27-eth0-tx-0-21swapper/223:44:022
29725040,0irq/27-eth0-tx-0-21swapper/223:09:172
29725040,0irq/27-eth0-tx-0-21swapper/222:58:562
29725040,0irq/27-eth0-tx-0-21swapper/222:39:282
29725040,0irq/27-eth0-tx-0-21swapper/222:29:122
29725040,0irq/27-eth0-tx-0-21swapper/221:08:542
29725040,0irq/27-eth0-tx-0-21swapper/220:54:432
29715040,0irq/26-eth0-rx-5417-21kthreadcore00:19:103
29715040,0irq/26-eth0-rx-0-21swapper/323:34:053
29715040,0irq/26-eth0-rx-0-21swapper/323:28:573
29715040,0irq/26-eth0-rx-0-21swapper/323:24:043
29715040,0irq/26-eth0-rx-0-21swapper/322:58:573
29715040,0irq/26-eth0-rx-0-21swapper/322:54:123
29715040,0irq/26-eth0-rx-0-21swapper/322:29:113
29715040,0irq/26-eth0-rx-0-21swapper/321:13:573
29715040,0irq/26-eth0-rx-0-21swapper/319:39:053
29715040,0irq/26-eth0-rx-0-21swapper/319:05:283
278829944,0cyclictest0-21swapper/219:25:042
278829943,0cyclictest5236-21awk19:49:082
278829943,0cyclictest3514-21snmpd21:59:072
278829943,0cyclictest3514-21snmpd20:34:072
278829943,0cyclictest3514-21snmpd20:24:072
278829943,0cyclictest3514-21snmpd20:21:072
278829943,0cyclictest31764-21awk20:09:062
278829943,0cyclictest30941-21awk19:44:092
278829943,0cyclictest24202-21awk19:39:092
278829943,0cyclictest23352-21awk19:14:092
278829943,0cyclictest23352-21awk19:14:092
278829943,0cyclictest10976-21awk19:29:102
278819944,0cyclictest0-21swapper/123:24:071
278819944,0cyclictest0-21swapper/122:46:551
278819944,0cyclictest0-21swapper/119:54:161
278819943,0cyclictest9939-21awk00:04:081
278819943,0cyclictest3514-21snmpd23:09:071
278819943,0cyclictest3241-21irqbalance22:39:221
278819943,0cyclictest3241-21irqbalance21:05:021
278819943,0cyclictest3241-21irqbalance19:14:131
278819943,0cyclictest3241-21irqbalance19:14:131
278819943,0cyclictest3241-21irqbalance00:09:011
278819943,0cyclictest27731-21awk21:14:071
278819943,0cyclictest26723-21awk22:54:091
278819943,0cyclictest19470-21awk21:09:081
278819943,0cyclictest19041-21awk22:09:101
278819943,0cyclictest10618-21awk23:04:081
278819943,0cyclictest10228-21awk23:44:081
278809943,0cyclictest6124-21awk20:14:090
278809943,0cyclictest3556-21lldpd22:14:060
278809943,0cyclictest3556-21lldpd21:49:350
278809943,0cyclictest3514-21snmpd21:33:070
278809943,0cyclictest3514-21snmpd19:09:070
278809943,0cyclictest3514-21snmpd19:09:070
278809943,0cyclictest3252-21awk21:39:090
278809943,0cyclictest3241-21irqbalance23:59:210
278809943,0cyclictest3241-21irqbalance23:44:020
278809943,0cyclictest3241-21irqbalance22:55:320
278809943,0cyclictest2921-21kworker/0:021:45:030
278809943,0cyclictest10501-21awk23:04:070
278809940,0cyclictest0-21swapper/022:29:040
278809940,0cyclictest0-21swapper/021:58:570
259940,0migration/232211-21munin-node21:14:102
259940,0migration/231076-21unixbench-2d20:29:182
259940,0migration/222318-21kthreadcore19:59:122
249940,0watchdog/25861-21cut23:19:112
249940,0watchdog/217334-21perl19:34:082
249940,0watchdog/216415-21netstat19:54:122
249940,0watchdog/20-21swapper/219:09:162
249940,0watchdog/20-21swapper/219:09:162
179940,0migration/17306-21processes22:59:151
179940,0migration/13889-21kthreadcore23:59:111
179940,0migration/132215-21df_abs20:34:051
179940,0migration/132200-21munin-node20:09:081
179940,0migration/130850-21munin-node00:14:151
179940,0migration/130016-21sh19:44:051
179940,0migration/128352-21kthreadcore22:34:111
179940,0migration/121468-21kthreadcore20:24:131
179940,0migration/120257-21kthreadcore21:49:101
179940,0migration/120077-21kthreadcore23:49:101
179940,0migration/118949-21kthreadcore19:34:121
179940,0migration/11839-21taskset18:56:001
179940,0migration/113602-21kthreadcore21:44:101
169940,0watchdog/16977-21kthreadcore22:19:121
169940,0watchdog/128029-21cut20:29:121
169940,0watchdog/126925-21perl22:14:081
169940,0watchdog/115733-21python22:24:161
169940,0watchdog/110335-21users19:49:161
169940,0watchdog/10-21swapper/123:54:111
169940,0watchdog/10-21swapper/123:40:311
169940,0watchdog/10-21swapper/120:55:561
169940,0watchdog/10-21swapper/118:59:041
149940,0migration/07702-21users22:59:180
149940,0migration/026205-21if_eth023:54:090
149940,0migration/019242-21kthreadcore23:49:090
149940,0migration/015723-21kthreadcore20:19:120
149940,0migration/011695-21if_eth121:24:100
8215030,0irq/24-0000:00:0-21swapper/220:44:062
29715030,0irq/26-eth0-rx-0-21swapper/320:49:183
29715030,0irq/26-eth0-rx-0-21swapper/320:19:053
29715030,0irq/26-eth0-rx-0-21swapper/320:18:393
29715030,0irq/26-eth0-rx-0-21swapper/320:04:053
29715030,0irq/26-eth0-rx-0-21swapper/319:59:063
29715030,0irq/26-eth0-rx-0-21swapper/319:54:053
29715030,0irq/26-eth0-rx-0-21swapper/319:20:563
29715030,0irq/26-eth0-rx-0-21swapper/319:18:413
29715030,0irq/26-eth0-rx-0-21swapper/319:18:413
29715030,0irq/26-eth0-rx-0-21swapper/319:09:043
29715030,0irq/26-eth0-rx-0-21swapper/319:09:043
278829932,0cyclictest3514-21snmpd20:49:072
278829932,0cyclictest3514-21snmpd20:04:072
278829932,0cyclictest3210-21awk18:59:072
278829930,0cyclictest6928-21perl20:39:102
278819933,0cyclictest3556-21lldpd19:24:061
278819932,0cyclictest3490-21irqrtprio21:39:101
278819932,0cyclictest25936-21kthreadcore20:04:111
278819932,0cyclictest15456-21grep20:19:111
278819932,0cyclictest14621-21ps19:04:141
278819931,0cyclictest20651-21kthreadcore19:59:111
278819930,0cyclictest24161-21idleruntime19:39:081
278819930,0cyclictest11633-21munin-node20:39:151
278809933,0cyclictest2921-21kworker/0:023:26:190
278809933,0cyclictest2921-21kworker/0:023:19:170
278809933,0cyclictest2921-21kworker/0:022:08:570
278809933,0cyclictest2921-21kworker/0:000:15:400
278809933,0cyclictest25113-21awk20:04:090
278809933,0cyclictest10281-21kworker/0:120:24:150
278809933,0cyclictest10281-21kworker/0:119:44:010
278809933,0cyclictest10281-21kworker/0:119:24:080
278809933,0cyclictest10281-21kworker/0:119:04:400
278809932,0cyclictest2921-21kworker/0:023:34:130
278809932,0cyclictest17513-21sed23:08:530
278809930,0cyclictest15693-21cut21:04:120
169930,0watchdog/10-21swapper/121:32:281
169930,0watchdog/10-21swapper/120:14:121
169930,0watchdog/10-21swapper/100:20:031
149930,0migration/031958-21aten2.4-expect20:34:040
35120,0ktimersoftd/331531-21kthreadcore19:44:113
29715020,0irq/26-eth0-rx-0-21swapper/320:42:033
29715020,0irq/26-eth0-rx-0-21swapper/320:09:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional