You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-13 - 17:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Dec 13, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
745623728,0sleep10-21swapper/107:07:061
737523623,0sleep00-21swapper/007:06:090
735223626,0sleep30-21swapper/307:05:523
755823329,0sleep20-21swapper/207:08:192
77749966,0cyclictest0-21swapper/011:10:130
77749960,0cyclictest0-21swapper/009:52:100
339960,0migration/328257-21sh12:26:293
29715060,0irq/26-eth0-rx-3422-21kthreadcore09:05:153
29715060,0irq/26-eth0-rx-0-21swapper/310:42:473
149960,0migration/022093-21idleruntime-cro07:44:580
149960,0migration/010167-21timerandwakeup12:15:190
8215050,0irq/24-0000:00:14449-21cat07:14:582
8215050,0irq/24-0000:00:11787-21latency_hist08:49:582
8215050,0irq/24-0000:00:0-21swapper/210:24:582
77759950,0cyclictest0-21swapper/111:23:281
77749955,0cyclictest0-21swapper/012:36:080
77749955,0cyclictest0-21swapper/011:09:540
339950,0migration/38780-21fschecks_time10:25:133
339950,0migration/38537-21taskset07:32:183
339950,0migration/37611-21irqrtprio09:10:193
339950,0migration/34773-21taskset12:31:553
339950,0migration/34357-21munin-node11:00:103
339950,0migration/33724-21diskmemload10:01:143
339950,0migration/330280-21cpuspeed_turbos08:15:113
339950,0migration/328495-21kthreadcore09:00:153
339950,0migration/327792-21fschecks_time09:40:163
339950,0migration/326222-21kthreadcore08:10:153
339950,0migration/32596-21sh12:12:133
339950,0migration/324082-21fschecks_time11:30:123
339950,0migration/321564-21cpuspeed_turbos07:20:103
339950,0migration/320530-21unixbench-2d10:10:233
339950,0migration/320206-21latency11:25:163
339950,0migration/320074-21sh09:54:063
339950,0migration/319251-21fschecks_time08:55:123
339950,0migration/318922-21sh10:49:583
339950,0migration/316096-21kthreadcore08:25:173
339950,0migration/314652-21kthreadcore12:20:143
339950,0migration/314637-21kthreadcore08:00:153
339950,0migration/313728-21timerandwakeup07:10:163
339950,0migration/313034-21munin-node11:05:103
339950,0migration/312716-21taskset11:21:103
339950,0migration/310921-21kthreadcore07:35:163
29725050,0irq/27-eth0-tx-5343-21munin-node08:45:120
29725050,0irq/27-eth0-tx-31264-21grep11:50:172
29725050,0irq/27-eth0-tx-28985-21munin-node07:50:170
29725050,0irq/27-eth0-tx-27857-21ssh09:57:152
29725050,0irq/27-eth0-tx-27423-21taskset12:09:282
29725050,0irq/27-eth0-tx-23914-21munin-node10:15:122
29725050,0irq/27-eth0-tx-21481-21cut10:50:152
29725050,0irq/27-eth0-tx-21287-21munin-node07:20:110
29725050,0irq/27-eth0-tx-1905-21munin-node11:55:162
29725050,0irq/27-eth0-tx-18848-21fschecks_time09:35:132
29725050,0irq/27-eth0-tx-11294-21ssh11:02:482
29725050,0irq/27-eth0-tx-10985-21perl10:45:112
29725050,0irq/27-eth0-tx-0-21swapper/212:29:502
29725050,0irq/27-eth0-tx-0-21swapper/009:10:010
29725050,0irq/27-eth0-tx-0-21swapper/008:43:530
29725050,0irq/27-eth0-tx-0-21swapper/008:00:190
29715050,0irq/26-eth0-rx-9295-21grep10:05:163
29715050,0irq/26-eth0-rx-5549-21irqstats12:15:133
29715050,0irq/26-eth0-rx-3986-21grep11:35:163
29715050,0irq/26-eth0-rx-29552-21sensors09:20:193
29715050,0irq/26-eth0-rx-22135-21kthreadcore09:35:163
29715050,0irq/26-eth0-rx-20402-21grep11:45:143
29715050,0irq/26-eth0-rx-15010-21ps09:30:183
29715050,0irq/26-eth0-rx-12695-21grep12:00:143
29715050,0irq/26-eth0-rx-11617-21irqrtprio10:45:133
29715050,0irq/26-eth0-rx-0-21swapper/312:35:453
29715050,0irq/26-eth0-rx-0-21swapper/311:58:283
29715050,0irq/26-eth0-rx-0-21swapper/311:53:353
29715050,0irq/26-eth0-rx-0-21swapper/311:40:103
29715050,0irq/26-eth0-rx-0-21swapper/311:15:163
29715050,0irq/26-eth0-rx-0-21swapper/311:13:193
29715050,0irq/26-eth0-rx-0-21swapper/310:56:333
29715050,0irq/26-eth0-rx-0-21swapper/310:35:163
29715050,0irq/26-eth0-rx-0-21swapper/310:20:033
29715050,0irq/26-eth0-rx-0-21swapper/310:16:123
29715050,0irq/26-eth0-rx-0-21swapper/309:49:493
29715050,0irq/26-eth0-rx-0-21swapper/309:27:253
29715050,0irq/26-eth0-rx-0-21swapper/309:17:463
29715050,0irq/26-eth0-rx-0-21swapper/308:45:193
259950,0migration/26951-21irqcore10:05:152
259950,0migration/232550-21idleruntime10:20:122
259950,0migration/230370-21sh09:21:092
259950,0migration/229184-21sh11:14:122
259950,0migration/228339-21df_abs12:10:102
259950,0migration/225111-21gltestperf08:35:132
259950,0migration/222377-21sh11:28:212
259950,0migration/221269-21kthreadcore11:45:152
259950,0migration/220689-21sh12:23:442
259950,0migration/217841-21kthreadcore07:40:152
259950,0migration/216081-21kthreadcore09:50:152
259950,0migration/215560-21fschecks_time09:15:112
259950,0migration/213434-21kthreadcore11:40:142
259950,0migration/212547-21kthreadcore12:00:142
249950,0watchdog/232006-21ssh11:35:002
249950,0watchdog/229332-21unixbench_multi08:10:212
249950,0watchdog/216790-21rm10:30:082
179950,0migration/13477-21taskset10:00:451
179950,0migration/131911-21kthreadcore12:30:131
179950,0migration/127303-21sh09:56:031
179950,0migration/127020-21kthreadcore09:20:151
179950,0migration/126681-21missed_timers11:10:161
179950,0migration/121757-21runrttasks07:41:221
179950,0migration/112824-21taskset12:20:001
149950,0migration/07978-21kthreadcore09:45:160
149950,0migration/05978-21kthreadcore10:40:180
149950,0migration/04334-21sh12:30:580
149950,0migration/032621-21fschecks_time09:05:100
149950,0migration/029553-21aten_r1power_fr10:00:090
149950,0migration/029041-21kthreadcore09:20:150
149950,0migration/025558-21sh12:05:290
149950,0migration/025486-21irqcore08:35:150
149950,0migration/024219-21proc_pri08:55:190
149950,0migration/022489-21sh10:14:180
149950,0migration/022154-21kthreadcore09:35:170
149950,0migration/019054-21kthreadcore08:05:150
149950,0migration/017875-21irqcore10:30:150
149950,0migration/017324-21cpuspeed_turbos11:45:090
149950,0migration/015074-21fschecks_count07:15:080
149950,0migration/014840-21kthreadcore08:25:160
149950,0migration/01302-21sh09:41:190
149950,0migration/011717-21nfs_client11:20:170
149950,0migration/011470-21idleruntime12:00:110
8215040,0irq/24-0000:00:28753-21latency_hist07:49:582
77799943,0cyclictest6259-21awk08:45:142
77799943,0cyclictest4208-21awk07:55:112
77799943,0cyclictest3514-21snmpd10:09:582
77799943,0cyclictest23174-21sadc08:09:582
77759943,0cyclictest3556-21lldpd08:04:441
77759943,0cyclictest3556-21lldpd07:48:141
77759943,0cyclictest3556-21lldpd07:27:441
77759943,0cyclictest29839-21awk07:50:141
77759943,0cyclictest26580-21awk11:50:121
77759943,0cyclictest24453-21awk11:30:141
77759943,0cyclictest18044-21awk11:45:131
77759943,0cyclictest17566-21awk08:05:121
77759943,0cyclictest15385-21awk10:10:111
77759943,0cyclictest1180-21awk09:25:131
77759943,0cyclictest11347-21awk10:45:131
77749944,0cyclictest30176-21kworker/0:111:00:530
77749944,0cyclictest30176-21kworker/0:110:15:160
77749944,0cyclictest30176-21kworker/0:108:15:120
77749944,0cyclictest30176-21kworker/0:107:30:160
77749943,0cyclictest6817-21awk10:05:140
77749943,0cyclictest3514-21snmpd11:28:130
77749943,0cyclictest3514-21snmpd10:51:130
77749943,0cyclictest2882-21awk11:55:130
77749943,0cyclictest28545-21awk10:55:110
77749943,0cyclictest26634-21awk11:50:120
77749943,0cyclictest22481-21awk12:25:130
77749943,0cyclictest18642-21awk08:30:140
77749943,0cyclictest15873-21awk09:15:130
339940,0migration/32737-21runrttasks07:51:213
339940,0migration/326839-21kthreadcore07:45:163
339940,0migration/320406-21kthreadcore08:05:153
339940,0migration/313765-21kthreadcore08:50:153
29725040,0irq/27-eth0-tx-32645-21ssh09:25:022
29725040,0irq/27-eth0-tx-0-21swapper/212:36:132
29725040,0irq/27-eth0-tx-0-21swapper/212:31:132
29725040,0irq/27-eth0-tx-0-21swapper/211:20:012
29725040,0irq/27-eth0-tx-0-21swapper/211:15:092
29725040,0irq/27-eth0-tx-0-21swapper/211:06:052
29725040,0irq/27-eth0-tx-0-21swapper/210:35:202
29725040,0irq/27-eth0-tx-0-21swapper/210:00:082
29725040,0irq/27-eth0-tx-0-21swapper/209:44:592
29725040,0irq/27-eth0-tx-0-21swapper/209:30:012
29725040,0irq/27-eth0-tx-0-21swapper/009:00:110
29715040,0irq/26-eth0-rx-21088-21cpuspeed_turbos09:55:123
29715040,0irq/26-eth0-rx-0-21swapper/312:05:203
29715040,0irq/26-eth0-rx-0-21swapper/310:30:023
259940,0migration/29236-21kthreadcore08:20:152
259940,0migration/24693-21users08:40:282
259940,0migration/24394-21aten_r1power_vo12:15:082
259940,0migration/231478-21kthreadcore08:15:152
259940,0migration/226655-21kthreadcore07:45:162
259940,0migration/224865-21kthreadcore11:30:152
259940,0migration/223719-21kthreadcore07:20:152
259940,0migration/217200-21kthreadcore07:15:122
259940,0migration/216130-21crond08:00:582
259940,0migration/212462-21kthreadcore08:25:152
259940,0migration/210374-21kthreadcore09:10:212
259940,0migration/210070-21irqcore07:35:152
249940,0watchdog/22872-21irqrtprio10:40:162
249940,0watchdog/228714-21iostat10:55:122
249940,0watchdog/20-21swapper/209:40:012
179940,0migration/19828-21fschecks_count09:30:111
179940,0migration/1982-21sh09:40:381
179940,0migration/19437-21kthreadcore07:10:111
179940,0migration/1919-21kthreadcore10:20:141
179940,0migration/17986-21kthreadcore08:45:161
179940,0migration/14809-21fschecks_count08:20:101
179940,0migration/14719-21hddtemp_smartct11:00:111
179940,0migration/14702-21kthreadcore07:55:121
179940,0migration/131399-21kthreadcore12:10:141
179940,0migration/131319-21sh10:19:461
179940,0migration/130823-21hddtemp_smartct08:15:131
179940,0migration/128912-21taskset12:27:531
179940,0migration/127763-21aten_r1power_fr10:55:081
179940,0migration/125196-21idleruntime08:35:141
179940,0migration/12480-21kthreadcore09:05:151
179940,0migration/122929-21taskset11:29:321
179940,0migration/120120-21pmu-power07:15:151
179940,0migration/12006-21aten_r1power_fr11:55:091
179940,0migration/118410-21munin-node08:30:121
179940,0migration/116644-21kthreadcore09:15:141
179940,0migration/114626-21kthreadcore08:50:161
179940,0migration/114218-21kthreadcore12:00:141
179940,0migration/114033-21kthreadcore11:05:141
179940,0migration/112074-21runrttasks09:49:591
169940,0watchdog/17020-21tune2fs09:10:131
169940,0watchdog/129809-21ssh11:15:041
169940,0watchdog/122447-21cut09:35:171
169940,0watchdog/11641-21munin-node10:40:161
169940,0watchdog/115014-21ssh11:41:161
169940,0watchdog/111973-21ssh12:18:401
169940,0watchdog/111670-21ssh09:49:371
169940,0watchdog/110966-21kthreadcore10:05:161
169940,0watchdog/10-21swapper/111:35:161
169940,0watchdog/10-21swapper/110:30:081
169940,0watchdog/10-21swapper/108:10:211
149940,0migration/08079-21kthreadcore07:55:130
149940,0migration/024532-21kthreadcore07:45:150
149940,0migration/024053-21fschecks_time11:30:120
149940,0migration/014586-21kthreadcore12:20:140
149940,0migration/012362-21kthreadcore10:45:140
77799933,0cyclictest3241-21irqbalance09:05:472
77799933,0cyclictest3241-21irqbalance08:55:472
77799932,0cyclictest7861-21cut07:30:192
77799932,0cyclictest3514-21snmpd08:31:122
77759933,0cyclictest3556-21lldpd09:03:141
77759933,0cyclictest3241-21irqbalance07:30:281
77759932,0cyclictest3556-21lldpd08:55:141
77759932,0cyclictest3556-21lldpd08:25:141
77759932,0cyclictest21704-21fschecks_count07:20:111
77749933,0cyclictest30176-21kworker/0:111:40:090
77749933,0cyclictest30176-21kworker/0:111:35:090
77749933,0cyclictest30176-21kworker/0:108:20:200
77749933,0cyclictest30176-21kworker/0:108:13:140
77749933,0cyclictest17827-21kworker/0:212:10:090
77749932,0cyclictest9570-21grep07:35:130
77749932,0cyclictest8027-21basename07:10:050
77749932,0cyclictest3514-21snmpd10:29:130
77749932,0cyclictest32008-21tr11:15:140
77749932,0cyclictest26596-21sensors09:55:210
77749932,0cyclictest15458-21grep08:50:160
77749932,0cyclictest1271-21awk09:25:140
77749932,0cyclictest1060-21tr10:20:150
77749930,0cyclictest9753-21diskstats09:30:100
77749930,0cyclictest26107-21perl10:35:120
4130,0ktimersoftd/01658-21runrttasks07:25:550
29715030,0irq/26-eth0-rx-29828-21ntpq08:35:193
29715030,0irq/26-eth0-rx-0-21swapper/308:30:203
29715030,0irq/26-eth0-rx-0-21swapper/307:40:153
29715030,0irq/26-eth0-rx-0-21swapper/307:27:433
29715030,0irq/26-eth0-rx-0-21swapper/307:15:063
259930,0migration/226767-21kthreadcore09:00:142
249930,0watchdog/20-21swapper/207:25:012
179930,0migration/19275-21kthreadcore12:35:141
169930,0watchdog/125383-40yum-updatesd-he10:50:441
169930,0watchdog/10-21swapper/112:05:241
169930,0watchdog/10-21swapper/110:35:081
169930,0watchdog/10-21swapper/110:25:161
169930,0watchdog/10-21swapper/108:40:131
169930,0watchdog/10-21swapper/107:35:131
29715020,0irq/26-eth0-rx-0-21swapper/308:43:203
29715020,0irq/26-eth0-rx-0-21swapper/308:20:093
29715020,0irq/26-eth0-rx-0-21swapper/307:56:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional