You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 19:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Wed Dec 24, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
644524028,0sleep30-21swapper/307:07:043
640523725,0sleep00-21swapper/007:06:330
657023627,0sleep20-21swapper/207:08:312
662023127,0sleep10-21swapper/107:09:061
6859991818,0cyclictest3524-21snmpd08:19:451
6860991111,0cyclictest3524-21snmpd12:35:362
68549998,0cyclictest28032-21cut07:46:160
29805070,0irq/28-eth0-rx-0-21swapper/311:44:283
68609965,0cyclictest7313-21sed09:56:182
68609960,0cyclictest0-21swapper/210:54:262
68549963,0cyclictest18574-21diskstats09:46:110
339960,0migration/35867-21sh10:13:193
339960,0migration/34362-21sh10:48:563
339960,0migration/321684-21sh10:06:083
339960,0migration/31926-21sh09:52:393
339960,0migration/314957-21munin-node08:01:123
339960,0migration/312070-21munin-node12:06:173
339960,0migration/310169-21timerandwakeup08:16:243
329960,0watchdog/36444-21tr07:31:173
329960,0watchdog/320465-21cut08:46:183
29815060,0irq/29-eth0-tx-1029-21iostat12:36:172
29805060,0irq/28-eth0-rx-6293-21sed12:36:263
29805060,0irq/28-eth0-rx-3547-21kthreadcore10:31:183
29805060,0irq/28-eth0-rx-25924-21open_files12:11:223
29805060,0irq/28-eth0-rx-17124-21perl11:51:133
29805060,0irq/28-eth0-rx-14049-21ssh12:25:593
27160,0ktimersoftd/20-21swapper/210:05:532
27160,0ktimersoftd/20-21swapper/207:46:162
68609950,0cyclictest0-21swapper/211:51:022
68609950,0cyclictest0-21swapper/210:34:342
68599950,0cyclictest0-21swapper/112:32:411
68599950,0cyclictest0-21swapper/111:03:461
68599950,0cyclictest0-21swapper/110:57:561
68599950,0cyclictest0-21swapper/110:54:181
68549954,0cyclictest22654-21tune2fs11:36:140
68549953,0cyclictest9987-21perl09:41:130
68549953,0cyclictest8225-21perl11:46:140
68549953,0cyclictest7842-21perl07:11:100
68549953,0cyclictest691-21perl07:51:120
68549953,0cyclictest6516-21grep09:56:180
68549953,0cyclictest5908-21df_abs10:51:130
68549953,0cyclictest5248-21interrupts09:01:170
68549953,0cyclictest4986-21irqrtprio07:31:170
68549953,0cyclictest4897-21sh10:50:100
68549953,0cyclictest4848-21if_eth011:26:150
68549953,0cyclictest4651-21cpu09:21:130
68549953,0cyclictest462-21df_inode11:06:120
68549953,0cyclictest4397-21cat10:31:180
68549953,0cyclictest32724-21diskstats09:36:160
68549953,0cyclictest32653-21diskstats12:36:140
68549953,0cyclictest31432-21perl11:41:120
68549953,0cyclictest31278-21ls10:26:180
68549953,0cyclictest30720-21aten2.4-expect10:11:120
68549953,0cyclictest29917-21python11:01:260
68549953,0cyclictest29620-21perl07:26:130
68549953,0cyclictest29324-21needreboot12:31:200
68549953,0cyclictest29320-21diskstats08:11:120
68549953,0cyclictest2829-21if_err_eth112:01:150
68549953,0cyclictest28194-21swap08:51:230
68549953,0cyclictest27476-21df09:51:130
68549953,0cyclictest27444-21ssh09:16:100
68549953,0cyclictest27396-21memory07:21:210
68549953,0cyclictest25962-21tune2fs11:56:150
68549953,0cyclictest2481-21ntp_kernel_pll_12:16:190
68549953,0cyclictest24666-21ntp_states09:11:190
68549953,0cyclictest24458-21python08:26:220
68549953,0cyclictest23609-21tune2fs09:31:140
68549953,0cyclictest22919-21iostat10:06:140
68549953,0cyclictest2283-21sh11:23:280
68549953,0cyclictest22623-21sendmail_mailqu11:51:210
68549953,0cyclictest20706-21ssh11:34:170
68549953,0cyclictest20502-21vmstat09:26:260
68549953,0cyclictest20354-21df_abs10:41:120
68549953,0cyclictest20233-21df_inode12:11:140
68549953,0cyclictest18047-21sh11:16:020
68549953,0cyclictest17586-21iostat_ios10:21:160
68549953,0cyclictest17488-21munin-node08:21:240
68549953,0cyclictest15860-21users11:11:260
68549953,0cyclictest15497-21iostat07:16:150
68549953,0cyclictest15360-21perl10:56:140
68549953,0cyclictest15174-21diskstats08:46:120
68549953,0cyclictest15171-21perl12:26:140
68549953,0cyclictest14948-21diskstats08:01:120
68549953,0cyclictest1428-21iostat_ios08:36:150
68549953,0cyclictest13736-21python10:16:240
68549953,0cyclictest13539-21perl10:01:150
68549953,0cyclictest13406-21expr08:41:180
68549953,0cyclictest11821-21perl10:36:150
68549953,0cyclictest11742-21diskstats09:06:110
68549953,0cyclictest11662-21perl07:36:130
68549953,0cyclictest10887-21aten2.4-expect12:06:120
68549953,0cyclictest10794-21sadc08:20:590
68549952,0cyclictest7750-21diskstats07:56:130
68549952,0cyclictest6170-21grep12:21:140
68549952,0cyclictest25476-21chrt08:31:310
68549952,0cyclictest24078-21port_sshpriv07:41:190
68549952,0cyclictest21723-21munin-node08:06:250
339950,0migration/332650-21aten_r1power_cu08:36:093
339950,0migration/332490-21kthreadcore11:21:183
339950,0migration/329170-21taskset08:56:053
339950,0migration/327413-21kthreadcore07:46:163
339950,0migration/326142-21taskset11:19:293
339950,0migration/324922-21munin-node12:31:183
339950,0migration/322628-21kthreadcore10:41:173
339950,0migration/319671-21kthreadcore10:21:173
339950,0migration/318544-21diskmemload09:11:063
339950,0migration/316388-21kthreadcore09:26:173
339950,0migration/315898-21munin-node09:41:253
339950,0migration/314538-21cpuspeed_turbos07:16:113
339950,0migration/311761-21munin-node09:06:113
329950,0watchdog/38531-21hwlatdetect08:41:143
329950,0watchdog/37407-21sh11:46:103
329950,0watchdog/37153-21ssh11:06:583
329950,0watchdog/34423-21perl09:56:143
329950,0watchdog/313185-21proc_pri07:11:173
329950,0watchdog/310298-21kthreadcore10:16:183
329950,0watchdog/30-21swapper/311:11:183
329950,0watchdog/30-21swapper/310:51:103
29815050,0irq/29-eth0-tx-9660-21cut09:21:192
29815050,0irq/29-eth0-tx-5374-21munin-node12:21:172
29815050,0irq/29-eth0-tx-30662-21munin-node10:11:252
29815050,0irq/29-eth0-tx-29957-21sh12:16:162
29815050,0irq/29-eth0-tx-29865-21ssh11:39:382
29815050,0irq/29-eth0-tx-28903-21munin-node10:46:152
29815050,0irq/29-eth0-tx-25332-21munin-node10:26:112
29815050,0irq/29-eth0-tx-21688-21munin-node10:06:202
29815050,0irq/29-eth0-tx-18930-21fschecks_time09:46:112
29815050,0irq/29-eth0-tx-18163-21ssh12:07:492
29815050,0irq/29-eth0-tx-17841-21irqrtprio10:21:172
29815050,0irq/29-eth0-tx-16006-21ssh09:41:372
29815050,0irq/29-eth0-tx-15491-21if_eth012:26:162
29815050,0irq/29-eth0-tx-14367-21ssh11:47:012
29815050,0irq/29-eth0-tx-0-21swapper/212:02:062
29815050,0irq/29-eth0-tx-0-21swapper/211:26:002
29815050,0irq/29-eth0-tx-0-21swapper/209:26:262
29805050,0irq/28-eth0-rx-7790-21grep09:21:183
29805050,0irq/28-eth0-rx-5060-21kthreadcore12:01:183
29805050,0irq/28-eth0-rx-31181-21latency10:26:173
29805050,0irq/28-eth0-rx-27717-21cpuspeed_turbos09:16:123
29805050,0irq/28-eth0-rx-23354-21kthreadcore11:36:183
29805050,0irq/28-eth0-rx-18156-21kthreadcore10:01:203
29805050,0irq/28-eth0-rx-13256-21kthreadcore10:36:183
29805050,0irq/28-eth0-rx-0-21swapper/312:29:423
29805050,0irq/28-eth0-rx-0-21swapper/311:31:213
29805050,0irq/28-eth0-rx-0-21swapper/311:01:413
29805050,0irq/28-eth0-rx-0-21swapper/310:59:083
29805050,0irq/28-eth0-rx-0-21swapper/309:46:203
29805050,0irq/28-eth0-rx-0-21swapper/309:36:213
29805050,0irq/28-eth0-rx-0-21swapper/309:31:183
259950,0migration/25604-21sh11:42:322
259950,0migration/228480-21unixbench_singl08:51:242
259950,0migration/227937-21sh10:44:252
259950,0migration/226566-21munin-node08:31:502
259950,0migration/215551-21sh11:11:252
249950,0watchdog/232493-21cut07:51:102
249950,0watchdog/220204-21grep10:56:182
19150,0ktimersoftd/10-21swapper/110:14:441
179950,0migration/19647-21sh10:33:361
179950,0migration/13970-21sh12:18:211
179950,0migration/132705-21taskset11:58:161
179950,0migration/132452-21kthreadcore08:11:171
179950,0migration/128393-21taskset07:24:371
179950,0migration/127799-21df_abs09:16:131
179950,0migration/126464-21munin-node10:26:141
179950,0migration/123700-21kthreadcore07:41:171
179950,0migration/120500-21sh08:01:191
179950,0migration/119704-21sh09:11:141
179950,0migration/116824-21mdstat12:06:201
179950,0migration/11189-21sh12:36:181
179950,0migration/111584-21sh09:59:071
169950,0watchdog/129973-21cut09:51:181
169950,0watchdog/129700-21unixbench_multi09:31:261
169950,0watchdog/121039-21unixbench_singl12:26:261
8305040,0irq/26-0000:00:0-21swapper/207:40:582
8305040,0irq/26-0000:00:0-21swapper/207:20:582
68609944,0cyclictest83050irq/26-0000:00:11:21:042
68609944,0cyclictest0-21swapper/209:16:512
68609943,0cyclictest3524-21snmpd12:11:082
68609943,0cyclictest3524-21snmpd10:36:082
68609943,0cyclictest3524-21snmpd08:50:222
68609943,0cyclictest3524-21snmpd08:42:222
68609943,0cyclictest3524-21snmpd08:26:072
68609943,0cyclictest3524-21snmpd08:21:072
68609943,0cyclictest3524-21snmpd08:19:072
68609943,0cyclictest3524-21snmpd08:02:062
68609943,0cyclictest3524-21snmpd07:35:212
68609943,0cyclictest3524-21snmpd07:26:062
68609943,0cyclictest3524-21snmpd07:16:062
68599944,0cyclictest0-21swapper/111:52:571
68599944,0cyclictest0-21swapper/109:39:061
68599943,0cyclictest30228-21awk08:56:171
68599943,0cyclictest28275-21awk11:21:161
68599943,0cyclictest15882-21awk08:46:151
68599943,0cyclictest15684-21sort11:11:251
68599943,0cyclictest12031-21awk10:36:161
68549942,0cyclictest29221-21aten_r1power_en08:56:130
339940,0migration/328251-21switchtime08:51:243
339940,0migration/327164-21kthreadcore07:21:203
339940,0migration/325440-21taskset08:31:033
339940,0migration/317216-21timerwakeupswit07:36:253
329940,0watchdog/311898-21cut07:56:183
329940,0watchdog/30-21swapper/308:11:183
329940,0watchdog/30-21swapper/307:51:103
329940,0watchdog/30-21swapper/307:41:093
29815040,0irq/29-eth0-tx-18305-21diskmemload11:16:012
29815040,0irq/29-eth0-tx-0-21swapper/211:56:172
29815040,0irq/29-eth0-tx-0-21swapper/211:31:072
29815040,0irq/29-eth0-tx-0-21swapper/210:16:052
29815040,0irq/29-eth0-tx-0-21swapper/209:36:402
29805040,0irq/28-eth0-rx-15997-21kthreadcore08:21:163
29805040,0irq/28-eth0-rx-0-21swapper/312:17:203
29805040,0irq/28-eth0-rx-0-21swapper/311:56:203
29805040,0irq/28-eth0-rx-0-21swapper/311:26:163
29805040,0irq/28-eth0-rx-0-21swapper/308:06:173
259940,0migration/229240-21aten2.4-expect08:56:132
259940,0migration/228337-21runrttasks08:07:172
259940,0migration/22781-21kthreadcore11:06:162
259940,0migration/227659-21fschecks_count09:51:142
259940,0migration/224201-21fschecks_time11:01:142
259940,0migration/223182-21cpu09:31:132
259940,0migration/212477-21munin-node09:06:142
249940,0watchdog/26329-21cut09:01:182
249940,0watchdog/218588-21telnet09:11:102
249940,0watchdog/213494-21timerwakeupswit07:11:212
179940,0migration/18175-21kthreadcore09:21:181
179940,0migration/1810-21kthreadcore11:41:161
179940,0migration/15548-21irqrtprio09:01:171
179940,0migration/132385-21latency_hist07:50:581
179940,0migration/126272-21fschecks_time08:31:481
179940,0migration/123245-21irqrtprio10:06:151
179940,0migration/12249-21kthreadcore11:06:161
179940,0migration/120977-21runrttasks11:34:551
179940,0migration/120580-21switchtime07:16:231
179940,0migration/120050-21kthreadcore11:16:161
179940,0migration/118146-21kthreadcore10:01:201
179940,0migration/116735-21df_abs10:21:121
179940,0migration/115927-21kthreadcore09:06:161
179940,0migration/113994-21ksmtuned07:57:321
179940,0migration/112754-21kthreadcore09:41:171
179940,0migration/111845-21munin-node07:36:141
179940,0migration/110486-21kthreadcore07:11:141
169940,0watchdog/16443-21cut07:31:171
169940,0watchdog/14493-21ssh10:49:141
169940,0watchdog/126708-21ssh10:41:301
169940,0watchdog/125997-21ssh09:49:021
169940,0watchdog/125229-21kthreadcore11:36:181
169940,0watchdog/118739-21kthreadcore09:26:181
169940,0watchdog/10-21swapper/112:21:141
169940,0watchdog/10-21swapper/112:11:181
169940,0watchdog/10-21swapper/111:46:221
169940,0watchdog/10-21swapper/110:16:101
8305030,0irq/26-0000:00:0-21swapper/207:56:042
68609932,0cyclictest3524-21snmpd07:36:062
68609932,0cyclictest29934-21awk08:11:152
68609932,0cyclictest1405-21awk08:36:142
68599932,0cyclictest3524-21snmpd07:29:341
68599932,0cyclictest28207-21grep08:06:251
68599932,0cyclictest19376-21awk08:26:151
68599932,0cyclictest1278-21awk08:36:141
68599930,0cyclictest22814-21perl08:51:121
68599930,0cyclictest0-21swapper/108:21:041
329930,0watchdog/30-21swapper/309:01:183
329930,0watchdog/30-21swapper/308:26:023
329930,0watchdog/30-21swapper/307:26:213
169930,0watchdog/10-21swapper/112:01:181
169930,0watchdog/10-21swapper/111:27:181
169930,0watchdog/10-21swapper/108:41:141
169920,0watchdog/10-21swapper/107:46:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional