You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 23:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Jul 21, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2767828382,0sleep20-21swapper/207:24:022
28114996060,0cyclictest83050irq/26-0000:00:09:52:312
2772423223,0sleep10-21swapper/107:24:331
2797823026,0sleep00-21swapper/007:27:280
2793222925,0sleep30-21swapper/307:26:553
339970,0migration/311373-21sh12:37:383
8305060,0irq/26-0000:00:31467-21perl08:58:273
8305060,0irq/26-0000:00:31351-21crond10:18:142
8305060,0irq/26-0000:00:21160-21python08:03:373
8305060,0irq/26-0000:00:17666-21tr09:08:323
8305060,0irq/26-0000:00:13730-21cut08:23:333
8305060,0irq/26-0000:00:13090-21cut11:23:142
8305060,0irq/26-0000:00:11270-21iostat_ios09:28:303
339960,0migration/328272-21munin-node08:08:323
339960,0migration/327165-21latency09:53:313
339960,0migration/318883-21sh12:39:373
29815060,0irq/29-eth0-tx-3524-21snmpd09:28:310
29805060,0irq/28-eth0-rx-4424-21perl09:43:283
29805060,0irq/28-eth0-rx-28429-21cut12:28:323
29805060,0irq/28-eth0-rx-21345-21python11:43:393
29805060,0irq/28-eth0-rx-0-21swapper/312:55:413
281149966,0cyclictest0-21swapper/208:23:322
281149960,0cyclictest0-21swapper/211:21:412
281139960,0cyclictest0-21swapper/107:34:351
259960,0migration/218664-21sh12:38:572
149960,0migration/06395-21latency_hist11:38:140
149960,0migration/05643-21latency_hist09:03:130
149960,0migration/031845-21kthreadcore09:18:320
149960,0migration/030244-21fschecks_time08:13:290
149960,0migration/026509-21sh12:08:310
149960,0migration/016650-21latency_hist12:03:130
149960,0migration/016284-21irqrtprio08:03:310
8305050,0irq/26-0000:00:6244-21kthreadcore08:38:343
8305050,0irq/26-0000:00:3975-21fschecks_time07:33:273
8305050,0irq/26-0000:00:29523-21kthreadcore09:38:322
8305050,0irq/26-0000:00:2873-21ksmtuned07:31:513
8305050,0irq/26-0000:00:22648-21kthreadcore08:28:323
8305050,0irq/26-0000:00:21707-21ssh09:33:342
8305050,0irq/26-0000:00:1602-21cut07:53:313
8305050,0irq/26-0000:00:0-21swapper/309:03:273
8305050,0irq/26-0000:00:0-21swapper/308:33:263
8305050,0irq/26-0000:00:0-21swapper/307:43:133
339950,0migration/36085-21kthreadcore12:13:343
339950,0migration/33661-21idleruntime09:23:283
339950,0migration/330513-21kthreadcore11:13:303
339950,0migration/330513-21kthreadcore11:13:303
339950,0migration/329571-21kthreadcore07:48:333
339950,0migration/329320-21munin-node10:13:383
339950,0migration/328249-21kthreadcore10:53:313
339950,0migration/328214-21fschecks_count09:18:273
339950,0migration/324332-21hwlatdetect08:53:293
339950,0migration/321567-21latency_hist11:28:143
339950,0migration/320843-21fschecks_count12:43:283
339950,0migration/31974-21kthreadcore11:33:343
339950,0migration/316365-21sendmail_mailst12:18:373
339950,0migration/315231-21kthreadcore11:23:323
339950,0migration/315182-21kthreadcore07:38:323
339950,0migration/315003-21kthreadcore11:03:303
329950,0watchdog/39908-21ssh10:59:413
329950,0watchdog/38808-21cut11:18:333
329950,0watchdog/35272-21sshd10:01:563
329950,0watchdog/33895-21kthreadcore10:18:323
329950,0watchdog/323746-21kthreadcore09:13:323
329950,0watchdog/320018-21ssh09:50:243
329950,0watchdog/31135-21aten_r1power_vo10:38:253
329950,0watchdog/310382-21kthreadcore07:58:323
329950,0watchdog/30-21swapper/308:48:283
29815050,0irq/29-eth0-tx-3439-21ssh11:15:372
29815050,0irq/29-eth0-tx-3439-21ssh11:15:372
29815050,0irq/29-eth0-tx-18142-21munin-node10:48:272
29815050,0irq/29-eth0-tx-10873-21kthreadcore11:58:332
29815050,0irq/29-eth0-tx-0-21swapper/212:51:522
29815050,0irq/29-eth0-tx-0-21swapper/212:16:042
29815050,0irq/29-eth0-tx-0-21swapper/211:49:292
29815050,0irq/29-eth0-tx-0-21swapper/211:32:382
29815050,0irq/29-eth0-tx-0-21swapper/211:03:242
29815050,0irq/29-eth0-tx-0-21swapper/210:53:282
29815050,0irq/29-eth0-tx-0-21swapper/210:43:162
29815050,0irq/29-eth0-tx-0-21swapper/210:20:042
29815050,0irq/29-eth0-tx-0-21swapper/007:48:320
29815050,0irq/29-eth0-tx-0-21swapper/007:45:160
29805050,0irq/28-eth0-rx-9589-21kthreadcore10:03:323
29805050,0irq/28-eth0-rx-31568-21ssh11:52:393
29805050,0irq/28-eth0-rx-20698-21cat09:33:333
29805050,0irq/28-eth0-rx-12801-21python11:38:383
29805050,0irq/28-eth0-rx-11165-21irqstats10:43:323
29805050,0irq/28-eth0-rx-0-21swapper/312:08:273
29805050,0irq/28-eth0-rx-0-21swapper/312:03:133
29805050,0irq/28-eth0-rx-0-21swapper/311:10:493
29805050,0irq/28-eth0-rx-0-21swapper/310:08:303
281149955,0cyclictest9803-21diskmemload10:59:462
281149955,0cyclictest0-21swapper/212:28:132
281149955,0cyclictest0-21swapper/211:40:462
281149955,0cyclictest0-21swapper/210:37:322
281149955,0cyclictest0-21swapper/208:12:582
281139955,0cyclictest0-21swapper/110:46:551
281139955,0cyclictest0-21swapper/108:47:161
281139954,0cyclictest3524-21snmpd12:20:591
281139950,0cyclictest0-21swapper/111:38:381
281139950,0cyclictest0-21swapper/109:49:041
281139950,0cyclictest0-21swapper/108:52:561
281139950,0cyclictest0-21swapper/107:57:361
281129955,0cyclictest2028-21md1_raid109:09:260
281129955,0cyclictest0-21swapper/010:43:430
281129955,0cyclictest0-21swapper/010:36:180
281129955,0cyclictest0-21swapper/009:45:320
281129955,0cyclictest0-21swapper/009:39:420
281129955,0cyclictest0-21swapper/009:33:520
281129955,0cyclictest0-21swapper/009:13:230
27150,0ktimersoftd/20-21swapper/210:10:062
259950,0migration/26909-21fschecks_time10:03:282
259950,0migration/23504-21latency_hist09:43:132
259950,0migration/230210-21sh11:33:242
259950,0migration/229570-21aten_r1power_po08:13:272
259950,0migration/228296-21kthreadcore08:53:332
259950,0migration/227884-21sh12:46:032
259950,0migration/221979-21sh11:44:302
259950,0migration/21768-21fschecks_time10:38:262
259950,0migration/217179-21fschecks_time10:28:282
249950,0watchdog/24956-21kthreadcore07:53:322
179950,0migration/131403-21munin-node12:08:351
179950,0migration/128800-21munin-node11:13:251
179950,0migration/128800-21munin-node11:13:251
179950,0migration/128147-21needreboot08:08:301
179950,0migration/12217-21taskset09:40:181
179950,0migration/121122-21munin-node11:43:371
179950,0migration/121094-21taskset11:27:191
179950,0migration/116255-21kthreadcore10:08:321
169950,0watchdog/114347-21grep07:38:321
149950,0migration/08674-21kthreadcore07:33:320
149950,0migration/07823-21kthreadcore12:33:330
149950,0migration/07412-21kthreadcore08:18:330
149950,0migration/07094-21kthreadcore08:38:340
149950,0migration/031031-21fschecks_time11:33:290
149950,0migration/030048-21kernelversion11:13:290
149950,0migration/030048-21kernelversion11:13:290
149950,0migration/02952-21kthreadcore10:38:300
149950,0migration/029287-21latency_hist08:13:130
149950,0migration/029024-21kthreadcore08:33:310
149950,0migration/026517-21kthreadcore08:53:320
149950,0migration/024951-21kthreadcore09:53:300
149950,0migration/024237-21sh12:05:550
149950,0migration/021157-21kthreadcore12:23:310
149950,0migration/020779-21kthreadcore10:28:330
149950,0migration/019111-21kthreadcore10:08:330
149950,0migration/017380-21taskset07:39:180
149950,0migration/015584-21kthreadcore11:23:320
149950,0migration/015168-21sh10:25:280
149950,0migration/013617-21munin-node09:48:300
149950,0migration/012145-21df_abs08:23:280
149950,0migration/010998-21sh11:18:380
149950,0migration/010847-21sh11:02:270
149950,0migration/010596-21kthreadcore12:53:330
149950,0migration/010257-21irqrtprio08:43:310
8305040,0irq/26-0000:00:0-21swapper/212:18:192
339940,0migration/38615-21fschecks_time10:23:283
339940,0migration/327371-21kthreadcore10:33:323
339940,0migration/320407-21kthreadcore10:48:313
339940,0migration/31511-21kthreadcore08:13:333
329940,0watchdog/328213-21smartctl09:38:283
329940,0watchdog/320642-21kthreadcore10:28:323
329940,0watchdog/30-21swapper/308:18:283
29815040,0irq/29-eth0-tx-0-21swapper/212:54:002
29815040,0irq/29-eth0-tx-0-21swapper/212:33:272
29815040,0irq/29-eth0-tx-0-21swapper/212:03:172
29815040,0irq/29-eth0-tx-0-21swapper/209:58:252
29805040,0irq/28-eth0-rx-0-21swapper/312:48:303
29805040,0irq/28-eth0-rx-0-21swapper/312:23:263
29805040,0irq/28-eth0-rx-0-21swapper/311:58:233
29805040,0irq/28-eth0-rx-0-21swapper/311:55:403
29805040,0irq/28-eth0-rx-0-21swapper/308:43:133
281149943,0cyclictest3524-21snmpd12:08:282
281149943,0cyclictest3524-21snmpd11:53:582
281149943,0cyclictest3524-21snmpd09:29:572
281149943,0cyclictest3524-21snmpd09:18:262
281149943,0cyclictest3524-21snmpd08:48:262
281149943,0cyclictest3524-21snmpd07:43:252
281149943,0cyclictest31667-21wc07:48:412
281139943,0cyclictest6774-21awk09:03:301
281139943,0cyclictest3571-21lldpd12:55:241
281139943,0cyclictest3571-21lldpd12:33:241
281139943,0cyclictest3571-21lldpd12:14:541
281139943,0cyclictest3524-21snmpd10:38:281
281139943,0cyclictest3524-21snmpd08:58:411
281139943,0cyclictest27844-21awk10:53:301
281139943,0cyclictest24438-21awk08:53:301
281139943,0cyclictest22315-21awk09:53:271
281139943,0cyclictest19049-21awk07:43:311
281139943,0cyclictest17442-21awk10:28:301
281139940,0cyclictest0-21swapper/109:21:091
281129944,0cyclictest0-21swapper/010:21:290
281129943,0cyclictest8593-21awk07:58:300
281129943,0cyclictest3709-21awk09:23:280
281129943,0cyclictest3571-21lldpd07:53:490
281129943,0cyclictest3571-21lldpd07:31:190
281129943,0cyclictest3524-21snmpd12:41:440
281129943,0cyclictest3524-21snmpd12:18:280
281129943,0cyclictest3524-21snmpd11:43:580
281129943,0cyclictest3524-21snmpd11:07:580
281129943,0cyclictest30127-21awk12:48:330
281129943,0cyclictest28196-21awk12:28:310
281129943,0cyclictest2637-21awk12:13:320
281129943,0cyclictest24123-21awk10:13:310
259940,0migration/29991-21irqcore08:43:312
259940,0migration/28180-21kthreadcore09:23:312
259940,0migration/228392-21kthreadcore08:33:312
259940,0migration/223193-21kthreadcore09:13:322
259940,0migration/222698-21kthreadcore08:28:312
259940,0migration/222154-21munin-node09:53:262
259940,0migration/219737-21runrttasks09:08:412
259940,0migration/212063-21kthreadcore10:23:322
259940,0migration/210913-21cpuspeed_turbos07:38:262
249940,0watchdog/2999-21cut07:28:322
249940,0watchdog/28220-21grep07:33:322
249940,0watchdog/22028-21md1_raid108:03:362
249940,0watchdog/219911-21munin-node11:08:332
249940,0watchdog/20-21swapper/212:28:332
249940,0watchdog/20-21swapper/209:03:282
249940,0watchdog/20-21swapper/208:18:322
249940,0watchdog/20-21swapper/207:58:402
179940,0migration/18869-21pmu-power09:23:341
179940,0migration/18508-21hwlatdetect07:58:291
179940,0migration/15554-21kthreadcore09:43:321
179940,0migration/14814-21kthreadcore11:53:341
179940,0migration/130375-21irqrtprio12:48:331
179940,0migration/127358-21kthreadcore07:48:331
179940,0migration/124684-21kthreadcore10:13:341
179940,0migration/122612-21kthreadcore12:23:321
179940,0migration/121001-21sh11:08:291
179940,0migration/120009-21kthreadcore12:03:331
179940,0migration/117440-21taskset09:31:131
179940,0migration/11513-21kthreadcore11:33:341
179940,0migration/115001-21kthreadcore12:38:311
179940,0migration/114535-21kthreadcore08:23:341
169940,0watchdog/18809-21tr11:18:331
169940,0watchdog/17529-21ntp_states08:38:361
169940,0watchdog/17035-21ssh10:21:401
169940,0watchdog/14913-21fschecks_count08:18:281
169940,0watchdog/131138-21tr08:13:321
169940,0watchdog/123522-21munin-node11:48:331
169940,0watchdog/122648-21kthreadcore08:28:321
169940,0watchdog/121235-21perl09:13:281
169940,0watchdog/120365-21ssh12:43:211
169940,0watchdog/117090-21kthreadcore08:03:321
169940,0watchdog/114810-21ssh10:24:241
169940,0watchdog/11140-21switchtime12:28:411
169940,0watchdog/110462-21kthreadcore11:58:331
169940,0watchdog/10-21swapper/111:28:331
169940,0watchdog/10-21swapper/110:33:321
169940,0watchdog/10-21swapper/109:36:081
169940,0watchdog/10-21swapper/107:28:321
149940,0migration/031200-21kthreadcore10:53:320
281149932,0cyclictest3524-21snmpd08:58:262
281139933,0cyclictest3571-21lldpd11:03:201
281139932,0cyclictest3646-21grep10:58:271
281139932,0cyclictest19289-21awk10:48:301
281139930,0cyclictest31724-21kthreadcore08:33:321
281129933,0cyclictest24059-21kworker/0:110:48:150
281129933,0cyclictest22869-21kworker/0:011:53:170
281129933,0cyclictest19198-21kworker/0:210:03:330
281129932,0cyclictest3571-21lldpd11:48:230
281129932,0cyclictest30872-21awk09:58:290
281129932,0cyclictest26706-21sensors12:43:380
281129932,0cyclictest22753-21awk11:28:300
281129932,0cyclictest17120-21awk08:48:320
281129932,0cyclictest10736-21kworker/0:211:08:210
281129930,0cyclictest31070-21diskstats08:58:270
281129930,0cyclictest0-21swapper/008:28:240
259930,0migration/25962-21kthreadcore08:38:342
19130,0ktimersoftd/15964-21sh10:03:191
169930,0watchdog/10-21swapper/109:58:241
169930,0watchdog/10-21swapper/109:08:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional