You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 03:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Dec 26, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1251024738,0sleep20-21swapper/219:07:052
1277623930,0sleep10-21swapper/119:10:131
1275223526,0sleep30-21swapper/319:09:593
1265823525,0sleep00-21swapper/019:08:520
8305060,0irq/26-0000:00:1308-21munin-run00:16:062
4160,0ktimersoftd/00-21swapper/023:10:420
339960,0migration/35079-21turbostat.cron21:36:013
339960,0migration/33452-21sh23:02:203
339960,0migration/332175-21sh22:42:143
339960,0migration/33128-21irqcore22:46:253
339960,0migration/329725-21sh22:24:513
339960,0migration/324833-21sh23:31:583
339960,0migration/324206-21sh00:09:493
339960,0migration/319459-21kthreadcore21:41:253
339960,0migration/316061-21unixbench_singl19:31:323
329960,0watchdog/33004-21tune2fs20:11:213
329960,0watchdog/316070-21kthreadcore23:46:263
329960,0watchdog/312227-21sh23:06:463
29815060,0irq/29-eth0-tx-24471-21munin-node21:11:302
29815060,0irq/29-eth0-tx-16662-21fschecks_count22:36:212
29805060,0irq/28-eth0-rx-2753-21seq22:09:553
149960,0migration/029742-21latency19:41:260
149960,0migration/019670-21munin-node19:11:310
149960,0migration/010852-21sh22:12:370
129259960,0cyclictest0-21swapper/223:36:262
129259960,0cyclictest0-21swapper/223:36:262
129249960,0cyclictest0-21swapper/123:36:191
129249960,0cyclictest0-21swapper/123:36:191
129249960,0cyclictest0-21swapper/123:07:091
129239960,0cyclictest0-21swapper/022:56:210
8305050,0irq/26-0000:00:0-21swapper/223:56:072
8305050,0irq/26-0000:00:0-21swapper/220:46:282
4150,0ktimersoftd/00-21swapper/000:33:560
339950,0migration/39094-21taskset19:28:123
339950,0migration/38891-21kthreadcore23:41:263
339950,0migration/38787-21munin-node22:31:243
339950,0migration/37346-21kthreadcore00:16:273
339950,0migration/37066-21sh21:52:133
339950,0migration/34913-21kthreadcore20:56:263
339950,0migration/332295-21fschecks_time20:31:223
339950,0migration/329837-21kthreadcore19:21:233
339950,0migration/329665-21kthreadcore21:11:283
339950,0migration/323799-21taskset20:23:573
339950,0migration/323375-21taskset19:37:213
339950,0migration/32332-21kthreadcore23:56:263
339950,0migration/322896-21kthreadcore20:01:243
339950,0migration/322236-21fschecks_time23:51:243
339950,0migration/320184-21fschecks_count00:26:223
339950,0migration/316762-21fschecks_count22:36:213
339950,0migration/316417-21timerwakeupswit21:01:333
339950,0migration/314468-21taskset20:41:213
339950,0migration/313897-21fschecks_time19:11:193
339950,0migration/312620-21vmstat19:51:313
329950,0watchdog/327486-21kthreadcore19:41:253
329950,0watchdog/324931-21perl20:26:213
329950,0watchdog/318696-21cut22:01:223
329950,0watchdog/315576-21grep23:26:343
329950,0watchdog/315413-21kthreadcore22:16:263
29815050,0irq/29-eth0-tx-7634-21cut23:06:252
29815050,0irq/29-eth0-tx-6768-21ssh22:30:482
29815050,0irq/29-eth0-tx-31424-21munin-node20:31:260
29815050,0irq/29-eth0-tx-26973-21sh21:28:112
29815050,0irq/29-eth0-tx-2686-21munin-node20:56:310
29815050,0irq/29-eth0-tx-23025-21ssh21:45:502
29815050,0irq/29-eth0-tx-22259-21cat00:06:322
29815050,0irq/29-eth0-tx-20066-21ssh22:18:172
29815050,0irq/29-eth0-tx-19744-21munin-node22:56:302
29815050,0irq/29-eth0-tx-19595-21munin-node00:26:282
29815050,0irq/29-eth0-tx-18582-21ntp_offset23:46:282
29815050,0irq/29-eth0-tx-1590-21perl21:16:232
29815050,0irq/29-eth0-tx-15843-21ssh22:35:582
29815050,0irq/29-eth0-tx-11059-21fschecks_time21:21:212
29815050,0irq/29-eth0-tx-0-21swapper/223:43:542
29815050,0irq/29-eth0-tx-0-21swapper/222:52:292
29815050,0irq/29-eth0-tx-0-21swapper/222:23:352
29815050,0irq/29-eth0-tx-0-21swapper/221:54:082
29815050,0irq/29-eth0-tx-0-21swapper/020:41:100
29815050,0irq/29-eth0-tx-0-21swapper/019:21:320
29805050,0irq/28-eth0-rx-4579-21python22:26:303
29805050,0irq/28-eth0-rx-4189-21kthreadcore23:21:253
29805050,0irq/28-eth0-rx-29056-21kthreadcore23:16:263
29805050,0irq/28-eth0-rx-22082-21kthreadcore21:26:273
29805050,0irq/28-eth0-rx-16251-21kthreadcore23:11:273
29805050,0irq/28-eth0-rx-15101-21kthreadcore21:21:253
29805050,0irq/28-eth0-rx-12629-21kthreadcore22:51:273
29805050,0irq/28-eth0-rx-12143-21kthreadcore00:01:253
29805050,0irq/28-eth0-rx-11515-21sendmail_mailtr00:36:323
29805050,0irq/28-eth0-rx-0-21swapper/323:41:063
29805050,0irq/28-eth0-rx-0-21swapper/323:41:063
29805050,0irq/28-eth0-rx-0-21swapper/322:56:223
29805050,0irq/28-eth0-rx-0-21swapper/321:56:263
29805050,0irq/28-eth0-rx-0-21swapper/321:49:153
29805050,0irq/28-eth0-rx-0-21swapper/321:36:223
29805050,0irq/28-eth0-rx-0-21swapper/321:20:223
29805050,0irq/28-eth0-rx-0-21swapper/319:56:223
29805050,0irq/28-eth0-rx-0-21swapper/300:21:203
259950,0migration/28834-21kthreadcore00:01:242
259950,0migration/230987-21sh23:18:432
259950,0migration/215920-21kthreadcore00:21:272
259950,0migration/215837-21switchtime19:31:312
249950,0watchdog/221574-21aten_r1power_vo23:51:222
179950,0migration/129492-21taskset21:46:281
179950,0migration/127132-21kthreadcore21:11:271
179950,0migration/126661-21kthreadcore20:26:251
179950,0migration/126638-21latency_hist23:36:071
179950,0migration/124008-21taskset22:39:091
179950,0migration/114615-21aten_r1power_po21:41:191
179950,0migration/112736-21taskset00:38:311
179950,0migration/110962-21munin-node22:51:211
149950,0migration/09064-21taskset19:27:540
149950,0migration/06344-21kthreadcore00:16:270
149950,0migration/05108-21kernelversion23:41:250
149950,0migration/04139-21kthreadcore21:51:250
149950,0migration/04012-21kthreadcore22:46:260
149950,0migration/031883-21sh21:50:450
149950,0migration/030860-21fschecks_count23:56:210
149950,0migration/026719-21kthreadcore21:11:270
149950,0migration/025962-21fschecks_time00:11:230
149950,0migration/023907-21taskset22:38:550
149950,0migration/023393-21kthreadcore19:16:250
149950,0migration/023230-21latency_hist21:46:070
149950,0migration/020311-21fschecks_time00:26:220
149950,0migration/01992-21taskset20:08:090
149950,0migration/017365-21fschecks_count19:36:220
149950,0migration/015424-21kthreadcore22:16:260
149950,0migration/012113-21munin-node19:51:260
149950,0migration/011680-21kthreadcore23:26:260
149950,0migration/011205-21fschecks_count00:21:220
129249955,0cyclictest6314-21runrttasks23:02:541
129249955,0cyclictest0-21swapper/123:44:591
129249955,0cyclictest0-21swapper/123:30:101
129249955,0cyclictest0-21swapper/123:21:301
129249955,0cyclictest0-21swapper/121:35:521
129249954,0cyclictest3524-21snmpd23:46:501
129249950,0cyclictest0-21swapper/122:50:261
129249950,0cyclictest0-21swapper/100:24:241
129239955,0cyclictest0-21swapper/023:52:290
129239955,0cyclictest0-21swapper/022:27:490
129239955,0cyclictest0-21swapper/022:07:570
129239955,0cyclictest0-21swapper/021:27:160
129239955,0cyclictest0-21swapper/020:36:210
129239953,0cyclictest24333-21kworker/0:023:19:240
129239950,0cyclictest0-21swapper/023:31:300
129239950,0cyclictest0-21swapper/023:25:220
129239950,0cyclictest0-21swapper/021:22:230
129239950,0cyclictest0-21swapper/021:17:300
339940,0migration/331460-21kthreadcore00:31:253
339940,0migration/324137-21kthreadcore20:46:293
339940,0migration/320977-21fschecks_time19:16:213
339940,0migration/31831-21kthreadcore19:46:233
339940,0migration/310098-21kthreadcore20:36:273
329940,0watchdog/30-21swapper/300:11:223
29815040,0irq/29-eth0-tx-9222-21ssh22:48:052
29815040,0irq/29-eth0-tx-17982-21ssh23:31:212
29815040,0irq/29-eth0-tx-0-21swapper/223:11:222
29815040,0irq/29-eth0-tx-0-21swapper/222:11:102
29815040,0irq/29-eth0-tx-0-21swapper/221:56:102
29815040,0irq/29-eth0-tx-0-21swapper/221:31:092
29815040,0irq/29-eth0-tx-0-21swapper/200:16:322
29815040,0irq/29-eth0-tx-0-21swapper/021:01:340
29815040,0irq/29-eth0-tx-0-21swapper/020:46:220
29815040,0irq/29-eth0-tx-0-21swapper/020:21:270
29815040,0irq/29-eth0-tx-0-21swapper/020:01:220
29805040,0irq/28-eth0-rx-0-21swapper/322:11:153
259940,0migration/28346-21kthreadcore00:36:282
259940,0migration/24707-21kthreadcore23:21:252
259940,0migration/232233-21kthreadcore20:51:252
259940,0migration/229035-21fschecks_count00:31:212
259940,0migration/228100-21taskset20:06:192
259940,0migration/222410-21kthreadcore20:21:242
259940,0migration/221654-21kthreadcore21:06:252
249940,0watchdog/29686-21perl23:26:222
249940,0watchdog/23571-21lldpd19:41:092
249940,0watchdog/226613-21kthreadcore20:26:252
249940,0watchdog/216909-21aten_r1power_vo19:36:212
249940,0watchdog/20-21swapper/221:36:212
249940,0watchdog/20-21swapper/220:11:212
179940,0migration/19206-21kthreadcore00:01:241
179940,0migration/17980-21kthreadcore22:11:251
179940,0migration/15846-21taskset22:28:391
179940,0migration/131710-21kthreadcore20:51:251
179940,0migration/127725-21aten_r1power_cu20:06:171
179940,0migration/125438-21kthreadcore22:21:261
179940,0migration/125212-21munin-node22:41:171
179940,0migration/123358-21kthreadcore20:01:241
179940,0migration/123336-21taskset23:16:161
179940,0migration/123113-21kthreadcore00:26:261
179940,0migration/123024-21latency21:06:251
179940,0migration/11225-21munin-node19:21:281
179940,0migration/11086-21kthreadcore00:31:261
169940,0watchdog/19906-21munin-node20:16:211
169940,0watchdog/189782sleep119:26:531
169940,0watchdog/14537-21kthreadcore00:16:261
169940,0watchdog/13762-21kthreadcore23:56:261
169940,0watchdog/128479-21ssh23:52:221
169940,0watchdog/125339-21ssh22:02:581
169940,0watchdog/123816-21ssh00:08:541
169940,0watchdog/112051-21kthreadcore22:31:261
169940,0watchdog/110249-21ssh21:21:131
169940,0watchdog/10-21swapper/123:00:501
149940,0migration/019245-21kthreadcore00:06:290
149940,0migration/018231-21sh22:53:180
149940,0migration/010428-21kthreadcore22:31:250
129259943,0cyclictest3571-21lldpd21:00:402
129259943,0cyclictest3571-21lldpd20:44:402
129259943,0cyclictest3571-21lldpd20:34:402
129259943,0cyclictest3571-21lldpd19:26:092
129259943,0cyclictest3571-21lldpd19:21:092
129259943,0cyclictest3571-21lldpd19:15:092
129259943,0cyclictest3524-21snmpd22:01:182
129259943,0cyclictest3524-21snmpd21:46:182
129259943,0cyclictest3524-21snmpd19:51:002
129259943,0cyclictest29798-21awk23:01:242
129259943,0cyclictest28194-21awk22:06:242
129259943,0cyclictest26236-21awk22:41:212
129249944,0cyclictest0-21swapper/123:11:251
129249943,0cyclictest3571-21lldpd22:06:111
129249943,0cyclictest3571-21lldpd21:16:101
129249943,0cyclictest3571-21lldpd21:01:101
129249943,0cyclictest3571-21lldpd20:41:101
129249943,0cyclictest3571-21lldpd20:32:101
129249943,0cyclictest3571-21lldpd19:11:091
129249943,0cyclictest3524-21snmpd21:51:181
129249943,0cyclictest3524-21snmpd21:27:171
129249943,0cyclictest3524-21snmpd20:36:161
129249943,0cyclictest3524-21snmpd20:11:161
129249943,0cyclictest3524-21snmpd19:51:301
129249943,0cyclictest3524-21snmpd19:33:001
129249943,0cyclictest32261-21awk19:46:211
129249943,0cyclictest25045-21awk19:41:231
129249943,0cyclictest23708-21sadc19:41:061
129249943,0cyclictest21862-21awk20:46:261
129249943,0cyclictest21461-21awk19:16:231
129249943,0cyclictest13783-21awk22:16:241
129249943,0cyclictest10081-21awk21:56:231
129239943,0cyclictest9992-21kworker/0:223:47:160
129239943,0cyclictest9992-21kworker/0:200:05:340
129239943,0cyclictest3571-21lldpd21:39:100
129239943,0cyclictest19389-21kworker/0:223:02:360
129239943,0cyclictest19063-21awk22:01:240
129239943,0cyclictest14330-21awk19:56:200
129239943,0cyclictest11289-21kworker/0:121:32:580
129239943,0cyclictest10112-21awk21:56:230
329930,0watchdog/30-21swapper/321:06:493
329930,0watchdog/30-21swapper/320:51:253
329930,0watchdog/30-21swapper/320:16:213
29805030,0irq/28-eth0-rx-0-21swapper/320:06:173
249930,0watchdog/20-21swapper/220:01:092
249930,0watchdog/20-21swapper/219:56:212
179930,0migration/128427-21kthreadcore00:11:271
169930,0watchdog/10-21swapper/121:36:211
129259932,0cyclictest7339-21awk20:36:242
129259932,0cyclictest10909-21awk20:16:252
129259930,0cyclictest23321-21cut19:16:252
129259930,0cyclictest10851-21perl21:01:222
129259930,0cyclictest0-21swapper/219:55:522
129249932,0cyclictest3524-21snmpd20:56:171
129249932,0cyclictest3524-21snmpd20:22:011
129249932,0cyclictest14370-21awk19:56:201
129239933,0cyclictest9992-21kworker/0:223:36:080
129239933,0cyclictest9992-21kworker/0:223:36:080
129239933,0cyclictest6719-21kworker/0:000:36:120
129239933,0cyclictest22952-21kworker/0:119:46:070
129239933,0cyclictest22952-21kworker/0:119:31:410
129239933,0cyclictest20452-21kworker/0:221:06:120
129239933,0cyclictest20452-21kworker/0:220:51:150
129239933,0cyclictest20452-21kworker/0:220:26:070
129239933,0cyclictest20452-21kworker/0:220:16:150
129239933,0cyclictest19389-21kworker/0:223:11:240
129239933,0cyclictest18988-21kworker/0:222:41:140
129239932,0cyclictest22489-21tr22:21:220
129239930,0cyclictest0-21swapper/020:11:450
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional