You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 04:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu May 21, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1911724839,0sleep10-21swapper/119:19:291
1930523526,0sleep20-21swapper/219:21:422
1912123522,0sleep00-21swapper/019:19:320
1909423228,0sleep30-21swapper/319:19:153
195099990,0cyclictest0-21swapper/200:38:372
339960,0migration/37766-21sh22:41:483
339960,0migration/331883-21sh23:51:483
339960,0migration/330167-21sh00:47:143
339960,0migration/329567-21missed_timers22:33:323
339960,0migration/326936-21sh23:10:493
339960,0migration/326308-21sh00:08:173
339960,0migration/325824-21sh00:07:343
339960,0migration/321273-21sh22:13:133
339960,0migration/318026-21kthreadcore21:33:303
339960,0migration/316395-21sh22:46:473
339960,0migration/315106-21needreboot23:58:333
29805060,0irq/28-eth0-rx-9789-21cut22:23:303
29805060,0irq/28-eth0-rx-31969-21cut21:58:303
29805060,0irq/28-eth0-rx-26997-21kthreadcore23:28:323
29805060,0irq/28-eth0-rx-16563-21kthreadcore22:28:293
195099960,0cyclictest0-21swapper/220:13:262
195089960,0cyclictest0-21swapper/122:53:261
195079960,0cyclictest0-21swapper/022:28:210
4150,0ktimersoftd/00-21swapper/023:20:230
339950,0migration/39522-21munin-node20:23:243
339950,0migration/3936-21fschecks_time23:53:263
339950,0migration/39194-21taskset22:59:273
339950,0migration/38843-21irqrtprio21:28:303
339950,0migration/36433-21kthreadcore23:18:293
339950,0migration/36078-21kthreadcore22:03:293
339950,0migration/35044-21taskset19:56:233
339950,0migration/34828-21kthreadcore21:43:353
339950,0migration/3473-21kthreadcore20:38:283
339950,0migration/33942-21kthreadcore20:18:313
339950,0migration/332509-21kthreadcore00:48:303
339950,0migration/332274-21kthreadcore20:58:293
339950,0migration/331674-21irqcore23:33:283
339950,0migration/331278-21kthreadcore22:53:303
339950,0migration/328827-21kthreadcore19:28:283
339950,0migration/326850-21taskset20:13:083
339950,0migration/326242-21unixbench_singl19:23:323
339950,0migration/325675-21kthreadcore20:33:303
339950,0migration/32404-21kthreadcore22:18:303
339950,0migration/319706-21kthreadcore21:13:303
339950,0migration/319370-21sh00:22:183
339950,0migration/319133-21sh23:08:073
339950,0migration/316930-21kthreadcore20:03:273
339950,0migration/316818-21kthreadcore00:38:303
339950,0migration/312817-21munin-node22:08:233
339950,0migration/311626-21kthreadcore23:38:303
339950,0migration/310419-21kthreadcore20:43:293
329950,0watchdog/34442-21grep21:03:273
329950,0watchdog/316600-21df_inode19:43:233
29815050,0irq/29-eth0-tx-9364-21munin-node21:08:260
29805050,0irq/28-eth0-rx-5263-21grep19:33:303
29805050,0irq/28-eth0-rx-30735-21munin-run21:23:123
29805050,0irq/28-eth0-rx-17066-21cat22:48:123
29805050,0irq/28-eth0-rx-11932-21kthreadcore19:38:293
29805050,0irq/28-eth0-rx-0-21swapper/323:43:303
29805050,0irq/28-eth0-rx-0-21swapper/323:24:103
29805050,0irq/28-eth0-rx-0-21swapper/323:13:343
29805050,0irq/28-eth0-rx-0-21swapper/321:56:343
29805050,0irq/28-eth0-rx-0-21swapper/321:49:473
29805050,0irq/28-eth0-rx-0-21swapper/320:53:323
29805050,0irq/28-eth0-rx-0-21swapper/300:33:323
29805050,0irq/28-eth0-rx-0-21swapper/300:13:263
27150,0ktimersoftd/20-21swapper/223:11:452
195099955,0cyclictest0-21swapper/223:41:042
195099955,0cyclictest0-21swapper/223:01:022
195099955,0cyclictest0-21swapper/222:47:092
195099955,0cyclictest0-21swapper/219:28:112
195099950,0cyclictest0-21swapper/222:13:062
195099950,0cyclictest0-21swapper/200:37:502
195079955,0cyclictest0-21swapper/023:59:390
195079955,0cyclictest0-21swapper/023:25:350
195079955,0cyclictest0-21swapper/022:38:170
195079955,0cyclictest0-21swapper/022:14:290
195079955,0cyclictest0-21swapper/021:42:380
195079955,0cyclictest0-21swapper/020:48:240
195079955,0cyclictest0-21swapper/000:51:120
195079955,0cyclictest0-21swapper/000:43:000
195079954,0cyclictest26862-21sadc20:13:110
179950,0migration/19159-21sh23:58:231
179950,0migration/18605-21switchtime22:58:371
179950,0migration/130290-21munin-node22:33:391
179950,0migration/120478-21fschecks_time19:23:211
179950,0migration/118090-21kthreadcore21:33:301
179950,0migration/111742-21sh00:34:011
179950,0migration/111267-21munin-node23:03:241
149950,0migration/031718-21fschecks_time21:23:270
149950,0migration/03121-21sh22:01:370
149950,0migration/019393-21sh00:22:220
149950,0migration/018563-21sh21:52:310
149950,0migration/01090-21sh22:56:120
8305040,0irq/26-0000:00:8957-21latency_hist23:58:132
8305040,0irq/26-0000:00:0-21swapper/221:08:262
329940,0watchdog/30-21swapper/321:23:233
29815040,0irq/29-eth0-tx-30754-21ssh23:48:422
29815040,0irq/29-eth0-tx-1293-21ssh23:53:272
29815040,0irq/29-eth0-tx-0-21swapper/223:43:322
29815040,0irq/29-eth0-tx-0-21swapper/223:13:392
29815040,0irq/29-eth0-tx-0-21swapper/223:04:012
29815040,0irq/29-eth0-tx-0-21swapper/221:33:332
29815040,0irq/29-eth0-tx-0-21swapper/200:43:232
29815040,0irq/29-eth0-tx-0-21swapper/200:20:122
29815040,0irq/29-eth0-tx-0-21swapper/019:58:240
29805040,0irq/28-eth0-rx-31457-21sendmail_mailqu21:38:333
29805040,0irq/28-eth0-rx-0-21swapper/319:58:223
29805040,0irq/28-eth0-rx-0-21swapper/300:28:303
29805040,0irq/28-eth0-rx-0-21swapper/300:23:293
25226240,0sleep00-21swapper/023:48:300
249940,0watchdog/2487-21ssh22:54:392
195099944,0cyclictest0-21swapper/222:20:592
195099944,0cyclictest0-21swapper/221:21:232
195099943,0cyclictest3571-21lldpd21:44:032
195099943,0cyclictest3524-21snmpd23:34:382
195099943,0cyclictest3524-21snmpd23:31:232
195099943,0cyclictest3524-21snmpd23:19:532
195099943,0cyclictest3524-21snmpd22:51:232
195099943,0cyclictest3524-21snmpd22:13:232
195099943,0cyclictest3524-21snmpd21:28:372
195099943,0cyclictest3524-21snmpd21:23:222
195099943,0cyclictest3524-21snmpd21:13:222
195099943,0cyclictest3524-21snmpd21:03:222
195099943,0cyclictest3524-21snmpd20:54:222
195099943,0cyclictest3524-21snmpd20:37:072
195099943,0cyclictest3524-21snmpd20:25:072
195099943,0cyclictest3524-21snmpd19:59:372
195099943,0cyclictest3524-21snmpd19:45:362
195099943,0cyclictest3524-21snmpd00:28:392
195099943,0cyclictest31889-21awk00:48:282
195099943,0cyclictest31695-21awk19:53:282
195099943,0cyclictest28803-21awk21:58:272
195099943,0cyclictest28391-21awk20:58:272
195099943,0cyclictest24691-21awk22:33:282
195099943,0cyclictest24569-21awk19:48:282
195099943,0cyclictest20298-21awk21:53:302
195099943,0cyclictest16067-21awk22:28:272
195099943,0cyclictest14293-21awk23:23:292
195099943,0cyclictest13990-21awk20:48:272
195099943,0cyclictest13748-21awk20:03:252
195099943,0cyclictest1249-21sadc21:43:122
195099943,0cyclictest1023-21awk22:38:302
195099943,0cyclictest10091-21awk19:38:272
195099940,0cyclictest21809-21cut00:03:302
195089943,0cyclictest3729-21awk00:13:281
195089943,0cyclictest3524-21snmpd22:12:231
195089943,0cyclictest3524-21snmpd00:28:541
195089943,0cyclictest24679-21awk20:33:281
195089943,0cyclictest21889-21sadc00:43:131
195089943,0cyclictest13945-21awk20:48:271
195089943,0cyclictest12341-21awk00:18:281
195089943,0cyclictest10398-21awk21:08:271
195089943,0cyclictest10370-21awk20:23:281
195089940,0cyclictest0-21swapper/100:46:381
195079944,0cyclictest0-21swapper/023:00:310
195079943,0cyclictest7514-21awk22:23:270
195079943,0cyclictest3571-21lldpd22:44:340
195079943,0cyclictest3571-21lldpd00:47:360
195079943,0cyclictest3524-21snmpd23:55:240
195079943,0cyclictest3524-21snmpd23:14:380
195079943,0cyclictest3524-21snmpd20:36:370
195079943,0cyclictest3244-21awk21:03:260
195079943,0cyclictest31102-21awk22:18:270
195079943,0cyclictest2839-21awk19:33:280
195079943,0cyclictest28352-21awk20:58:270
195079943,0cyclictest2818-21awk21:43:340
195079943,0cyclictest20248-21awk21:53:300
195079943,0cyclictest15077-21sadc23:43:130
195079943,0cyclictest13776-21awk22:08:270
195079943,0cyclictest10259-21awk20:23:270
195079943,0cyclictest0-21swapper/019:43:210
195079940,0cyclictest27100-21munin-node20:13:260
179940,0migration/16568-21kthreadcore21:43:361
179940,0migration/16464-21fschecks_time20:43:251
179940,0migration/15320-21fschecks_time23:18:251
179940,0migration/13861-21kthreadcore19:53:311
179940,0migration/130931-21kthreadcore23:13:301
179940,0migration/129796-21pmu-power21:18:331
179940,0migration/129474-21kthreadcore21:58:291
179940,0migration/126485-21kthreadcore19:48:301
179940,0migration/124209-21kthreadcore21:53:321
179940,0migration/122454-21pmu-power20:28:321
179940,0migration/122115-21munin-node23:28:271
179940,0migration/11883-21aten_r1power_cu20:18:251
179940,0migration/117598-21if_err_eth021:13:281
179940,0migration/114759-21taskset21:30:241
179940,0migration/113432-21cpuspeed_turbos23:23:251
179940,0migration/110582-21kthreadcore22:43:291
179940,0migration/110474-21irqrtprio19:38:281
179940,0migration/11012-21rt-features20:58:331
169940,0watchdog/1806-21ssh00:09:161
169940,0watchdog/1730-21ssh21:41:551
169940,0watchdog/17109-21ssh22:39:591
169940,0watchdog/132184-21grep20:13:311
169940,0watchdog/125171-21chrt00:05:481
169940,0watchdog/124821-21ssh22:51:111
169940,0watchdog/123494-21taskset23:47:361
169940,0watchdog/115089-21kthreadcore20:03:271
169940,0watchdog/113768-21ssh23:39:351
169940,0watchdog/10-21swapper/122:28:231
169940,0watchdog/10-21swapper/122:18:311
149940,0migration/07459-21kthreadcore22:03:290
149940,0migration/05156-21taskset19:57:440
149940,0migration/031585-21sh22:37:090
149940,0migration/030664-21taskset21:22:380
149940,0migration/023254-21taskset21:14:530
149940,0migration/022430-21taskset23:44:380
149940,0migration/020675-21fschecks_time00:23:250
149940,0migration/020544-21fschecks_count20:53:320
149940,0migration/01899-21aten_r1power_cu20:18:250
149940,0migration/018722-21pmu-power20:03:300
149940,0migration/015396-21sh21:31:580
149940,0migration/013780-21kthreadcore23:03:290
8305030,0irq/26-0000:00:0-21swapper/220:28:262
329930,0watchdog/30-21swapper/320:49:433
329930,0watchdog/30-21swapper/319:48:313
29815030,0irq/29-eth0-tx-0-21swapper/221:48:292
29815030,0irq/29-eth0-tx-0-21swapper/200:23:162
29815030,0irq/29-eth0-tx-0-21swapper/019:38:250
29805030,0irq/28-eth0-rx-0-21swapper/321:08:233
29805030,0irq/28-eth0-rx-0-21swapper/320:28:283
29805030,0irq/28-eth0-rx-0-21swapper/320:13:283
249930,0watchdog/27237-21kthreadcore19:33:312
249930,0watchdog/25732-21munin-node20:43:232
249930,0watchdog/20-21swapper/222:03:272
249930,0watchdog/20-21swapper/220:08:312
195099932,0cyclictest7490-21awk22:23:272
195099932,0cyclictest3714-21awk00:13:282
195099932,0cyclictest31871-21awk20:38:262
195099932,0cyclictest3128-21irqcore20:18:312
195099932,0cyclictest20276-21tune2fs19:23:212
195099930,0cyclictest0-21swapper/200:08:262
195089933,0cyclictest0-21swapper/120:54:241
195089933,0cyclictest0-21swapper/120:00:001
195089932,0cyclictest7726-21cut22:23:281
195089932,0cyclictest618-21sensors19:28:331
195089932,0cyclictest32644-21cut00:48:301
195089930,0cyclictest31284-21perl23:33:251
195089930,0cyclictest0-21swapper/123:53:291
195079932,0cyclictest3524-21snmpd20:32:030
195079932,0cyclictest31722-21grep20:38:250
195079932,0cyclictest23394-21munin-node19:48:310
195079932,0cyclictest22904-21cut19:23:250
195079932,0cyclictest20637-21awk23:08:280
195079932,0cyclictest18016-21cut22:48:260
195079932,0cyclictest11542-21grep00:33:370
195079930,0cyclictest3243-21tune2fs00:13:260
195079930,0cyclictest26922-21munin-node19:28:240
195079930,0cyclictest23026-21ssh21:33:470
179930,0migration/120321-21df00:23:241
169930,0watchdog/130985-21runrttasks21:23:231
169930,0watchdog/130734-21diskmemload23:50:321
169930,0watchdog/130734-21diskmemload22:03:151
169930,0watchdog/119554-21ssh23:08:231
169930,0watchdog/118296-21ssh21:51:471
169930,0watchdog/10-21swapper/122:13:271
169930,0watchdog/10-21swapper/121:03:351
169930,0watchdog/10-21swapper/120:38:231
169930,0watchdog/10-21swapper/120:08:311
169930,0watchdog/10-21swapper/119:33:311
149930,0migration/04334-21sh00:32:230
149930,0migration/018535-21fschecks_time00:03:260
195089921,0cyclictest16105-21cut19:43:111
195079921,0cyclictest5420-21crond20:43:120
195079921,0cyclictest30139-21latency_hist23:33:130
195079920,0cyclictest0-21swapper/023:28:130
195079920,0cyclictest0-21swapper/000:08:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional