You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 20:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Dec 29, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2331924736,0sleep00-21swapper/007:08:410
2340623727,0sleep20-21swapper/207:09:432
2351923625,0sleep10-21swapper/107:11:021
2335022824,0sleep30-21swapper/307:09:043
23623991010,0cyclictest3524-21snmpd08:12:040
29805070,0irq/28-eth0-rx-3886-21iostat_ios08:26:423
35160,0ktimersoftd/30-21swapper/310:43:173
339960,0migration/331583-21sh11:51:143
339960,0migration/330505-21sh10:56:313
339960,0migration/327557-21timerwakeupswit09:21:503
339960,0migration/318005-21sh09:52:103
339960,0migration/316991-21sh10:29:293
339960,0migration/314903-21sh12:35:293
339960,0migration/310370-21sh09:14:013
29815060,0irq/29-eth0-tx-0-21swapper/209:34:102
29805060,0irq/28-eth0-rx-30890-21tr10:36:423
29805060,0irq/28-eth0-rx-24800-21taskset12:03:033
29805060,0irq/28-eth0-rx-21582-21memory12:36:443
29805060,0irq/28-eth0-rx-19186-21port_sshpriv07:26:463
236259960,0cyclictest0-21swapper/210:22:252
236249966,0cyclictest0-21swapper/111:24:201
179960,0migration/11730-21aten_r1power_vo11:16:361
149960,0migration/018845-21fschecks_time10:31:410
149960,0migration/016864-21turbostat08:36:240
149960,0migration/016558-21latency11:21:440
8305050,0irq/26-0000:00:24266-21perf12:41:242
8305050,0irq/26-0000:00:19306-21crond11:26:252
4150,0ktimersoftd/00-21swapper/009:26:340
339950,0migration/37094-21sh11:01:263
339950,0migration/37094-21sh11:01:263
339950,0migration/36303-21kthreadcore07:41:453
339950,0migration/3340-21kthreadcore12:26:413
339950,0migration/332445-21munin-node08:01:393
339950,0migration/331274-21cpuspeed_turbos07:16:363
339950,0migration/331218-21kthreadcore09:06:413
339950,0migration/326552-21munin-node09:41:403
339950,0migration/326507-21kthreadcore10:16:423
339950,0migration/325738-21fschecks_time11:11:383
339950,0migration/320817-21if_eth1.311:26:423
339950,0migration/315917-21switchtime07:46:493
339950,0migration/314012-21kthreadcore11:56:433
339950,0migration/312637-21kthreadcore09:31:443
339950,0migration/312053-21smart_sdb10:06:483
329950,0watchdog/36314-21runrttasks09:36:273
329950,0watchdog/332542-21munin-node12:06:443
329950,0watchdog/330245-21aten_r1power_en09:26:353
329950,0watchdog/325970-21grep07:31:433
329950,0watchdog/321806-21cpuspeed_turbos10:51:353
329950,0watchdog/315881-21ntp_offset08:31:473
329950,0watchdog/312554-21diskstats12:16:403
329950,0watchdog/311513-21cut07:21:433
329950,0watchdog/30-21swapper/308:41:113
29815050,0irq/29-eth0-tx-6170-21munin-node08:06:410
29815050,0irq/29-eth0-tx-0-21swapper/009:11:330
29815050,0irq/29-eth0-tx-0-21swapper/009:01:410
29815050,0irq/29-eth0-tx-0-21swapper/007:48:010
29815050,0irq/29-eth0-tx-0-21swapper/007:39:030
29805050,0irq/28-eth0-rx-28515-21rsyslogd10:01:423
29805050,0irq/28-eth0-rx-21043-21ssh12:21:343
29805050,0irq/28-eth0-rx-17630-21ssh11:22:263
29805050,0irq/28-eth0-rx-15049-21diskstats10:11:383
29805050,0irq/28-eth0-rx-0-21swapper/311:51:403
29805050,0irq/28-eth0-rx-0-21swapper/311:42:193
29805050,0irq/28-eth0-rx-0-21swapper/311:38:313
29805050,0irq/28-eth0-rx-0-21swapper/311:34:283
29805050,0irq/28-eth0-rx-0-21swapper/311:16:413
29805050,0irq/28-eth0-rx-0-21swapper/311:06:373
29805050,0irq/28-eth0-rx-0-21swapper/311:06:373
29805050,0irq/28-eth0-rx-0-21swapper/310:31:283
29805050,0irq/28-eth0-rx-0-21swapper/309:56:413
27150,0ktimersoftd/20-21swapper/209:26:342
27150,0ktimersoftd/20-21swapper/207:56:442
236259955,0cyclictest0-21swapper/211:44:052
236259955,0cyclictest0-21swapper/210:41:112
236259955,0cyclictest0-21swapper/210:34:242
236259955,0cyclictest0-21swapper/210:15:482
236259955,0cyclictest0-21swapper/209:14:372
236259950,0cyclictest0-21swapper/209:53:242
236249955,0cyclictest0-21swapper/110:21:441
236249955,0cyclictest0-21swapper/109:26:531
236249955,0cyclictest0-21swapper/109:24:311
236249950,0cyclictest0-21swapper/112:12:251
236249950,0cyclictest0-21swapper/111:36:281
236249950,0cyclictest0-21swapper/111:29:411
236239955,0cyclictest0-21swapper/011:53:150
236239950,0cyclictest0-21swapper/011:32:260
236239950,0cyclictest0-21swapper/011:12:250
236239950,0cyclictest0-21swapper/010:58:520
179950,0migration/15917-21kthreadcore07:41:451
179950,0migration/13549-21taskset11:33:201
179950,0migration/13181-21cpuspeed_turbos09:11:371
179950,0migration/12806-21idleruntime-cro12:11:241
179950,0migration/115412-21sh11:05:251
179950,0migration/115412-21sh11:05:251
179950,0migration/112167-21munin-node09:51:401
169950,0watchdog/112621-21munin-node12:31:441
149950,0migration/05255-21kthreadcore08:26:430
149950,0migration/03295-21kthreadcore11:16:410
149950,0migration/031012-21idleruntime12:26:390
149950,0migration/030469-21kthreadcore08:21:410
149950,0migration/029883-21fschecks_time10:01:390
149950,0migration/028179-21kthreadcore07:11:420
149950,0migration/027242-21fschecks_time12:06:380
149950,0migration/026998-21missed_timers09:21:440
149950,0migration/026488-21kthreadcore11:46:420
149950,0migration/026436-21kthreadcore08:41:440
149950,0migration/024122-21aten_r1power_en07:56:360
149950,0migration/021457-21latency_hist10:51:250
149950,0migration/02055-21taskset10:38:290
149950,0migration/020363-21taskset08:58:460
149950,0migration/018944-21taskset07:26:430
149950,0migration/017387-21latency_hist12:01:240
149950,0migration/017167-21kthreadcore11:41:450
149950,0migration/015542-21kthreadcore09:51:430
149950,0migration/013618-21taskset12:32:230
149950,0migration/013348-21irqrtprio09:16:420
149950,0migration/011499-21kthreadcore07:21:430
149950,0migration/010979-21kthreadcore08:51:420
149950,0migration/010218-21sh12:12:350
8305040,0irq/26-0000:00:10868-21sh08:31:412
339940,0migration/322117-21irqcore09:01:413
339940,0migration/318859-21processes10:46:453
329940,0watchdog/315184-21kthreadcore08:56:433
329940,0watchdog/30-21swapper/310:21:393
329940,0watchdog/30-21swapper/309:16:433
29815040,0irq/29-eth0-tx-7179-21ssh11:01:382
29815040,0irq/29-eth0-tx-7179-21ssh11:01:382
29815040,0irq/29-eth0-tx-31552-21hwlatdetect10:56:422
29815040,0irq/29-eth0-tx-28505-21ssh11:31:342
29815040,0irq/29-eth0-tx-27926-21ssh09:22:152
29815040,0irq/29-eth0-tx-21743-21perl12:21:392
29815040,0irq/29-eth0-tx-2116-21telnet09:46:352
29815040,0irq/29-eth0-tx-15927-21ssh11:58:162
29815040,0irq/29-eth0-tx-14143-21cat12:16:442
29815040,0irq/29-eth0-tx-12802-21ssh10:07:472
29815040,0irq/29-eth0-tx-0-21swapper/211:19:422
29815040,0irq/29-eth0-tx-0-21swapper/211:11:332
29815040,0irq/29-eth0-tx-0-21swapper/210:52:432
29815040,0irq/29-eth0-tx-0-21swapper/008:46:430
29815040,0irq/29-eth0-tx-0-21swapper/008:16:350
29815040,0irq/29-eth0-tx-0-21swapper/007:41:380
29805040,0irq/28-eth0-rx-21266-21fschecks_time08:16:383
29805040,0irq/28-eth0-rx-0-21swapper/312:11:423
29805040,0irq/28-eth0-rx-0-21swapper/309:46:523
29805040,0irq/28-eth0-rx-0-21swapper/308:46:353
29805040,0irq/28-eth0-rx-0-21swapper/308:06:423
259940,0migration/28903-21munin-node08:26:482
259940,0migration/27995-21kthreadcore11:36:432
259940,0migration/232480-21munin-node12:06:432
259940,0migration/212571-21runrttasks07:22:572
249940,0watchdog/29615-21diskstats10:26:392
249940,0watchdog/232409-21munin-node11:51:392
249940,0watchdog/231565-21tail08:46:352
249940,0watchdog/223027-21seq11:46:312
249940,0watchdog/20-21swapper/211:06:272
249940,0watchdog/20-21swapper/211:06:272
236259944,0cyclictest0-21swapper/209:06:542
236259943,0cyclictest4353-21awk12:11:412
236259943,0cyclictest3571-21lldpd10:17:022
236259943,0cyclictest3571-21lldpd08:51:312
236259943,0cyclictest3524-21snmpd12:32:362
236259943,0cyclictest3524-21snmpd12:27:512
236259943,0cyclictest3524-21snmpd12:02:212
236259943,0cyclictest3524-21snmpd10:48:052
236259943,0cyclictest3524-21snmpd10:43:352
236259943,0cyclictest3524-21snmpd09:59:202
236259943,0cyclictest3524-21snmpd09:03:492
236259943,0cyclictest3524-21snmpd08:57:492
236259943,0cyclictest3524-21snmpd08:44:042
236259943,0cyclictest3524-21snmpd08:21:492
236259943,0cyclictest3524-21snmpd08:06:192
236259943,0cyclictest3524-21snmpd07:41:192
236259943,0cyclictest3524-21snmpd07:35:342
236259943,0cyclictest30178-21awk10:01:412
236259943,0cyclictest26714-21awk09:41:412
236259943,0cyclictest17876-21awk07:51:382
236259943,0cyclictest17432-21awk09:36:412
236259943,0cyclictest14289-21awk07:26:412
236259943,0cyclictest12975-21awk09:16:412
236259943,0cyclictest11844-21awk11:21:412
236249944,0cyclictest0-21swapper/112:24:141
236249943,0cyclictest3524-21snmpd12:05:361
236249943,0cyclictest3524-21snmpd08:56:491
236249943,0cyclictest31707-21awk10:56:431
236249943,0cyclictest27581-21sadc08:21:241
236249943,0cyclictest24635-21awk10:16:401
236249943,0cyclictest24167-21awk11:46:401
236249943,0cyclictest13179-21awk12:16:421
236239943,0cyclictest6722-21awk10:06:400
236239943,0cyclictest3524-21snmpd11:30:210
236239943,0cyclictest3524-21snmpd09:45:350
236239943,0cyclictest3524-21snmpd08:06:040
236239943,0cyclictest32225-21sadc10:21:240
236239943,0cyclictest22132-21awk12:21:410
236239943,0cyclictest18143-21awk08:36:400
236239943,0cyclictest17614-21kworker/0:209:38:070
236239943,0cyclictest16669-21awk12:36:400
236239943,0cyclictest13692-21awk10:46:390
179940,0migration/1965-21kthreadcore08:01:401
179940,0migration/18888-21kthreadcore08:06:421
179940,0migration/14759-21pmu-power07:16:451
179940,0migration/130749-21runrttasks07:15:571
179940,0migration/129515-21kthreadcore08:21:411
179940,0migration/129446-21irqcore09:06:401
179940,0migration/126392-21kthreadcore08:41:441
179940,0migration/125089-21kthreadcore07:31:421
179940,0migration/124151-21kthreadcore09:01:421
179940,0migration/120321-21cpuspeed_turbos09:56:371
179940,0migration/117178-21aten_r1power_fr08:36:371
179940,0migration/116374-21taskset07:48:501
179940,0migration/113337-21kthreadcore08:31:441
179940,0migration/112487-21latency_hist10:46:251
179940,0migration/112035-21kthreadcore08:51:421
179940,0migration/111463-21kthreadcore11:56:421
169940,0watchdog/19559-21ssh09:48:231
169940,0watchdog/19511-21grep09:31:431
169940,0watchdog/131563-21aten2.4-expect08:46:351
169940,0watchdog/120494-21munin-node10:11:431
169940,0watchdog/116279-21taskset09:36:271
169940,0watchdog/11561-21ssh10:37:191
169940,0watchdog/115349-21if_eth1.311:41:431
169940,0watchdog/10-21swapper/112:36:481
169940,0watchdog/10-21swapper/112:26:361
169940,0watchdog/10-21swapper/111:51:431
169940,0watchdog/10-21swapper/110:29:151
169940,0watchdog/10-21swapper/109:41:391
169940,0watchdog/10-21swapper/109:17:271
169940,0watchdog/10-21swapper/108:11:431
169940,0watchdog/10-21swapper/107:26:431
169940,0watchdog/10-21swapper/107:21:431
149940,0migration/06245-21needreboot10:21:420
149940,0migration/024152-21kthreadcore07:31:420
149940,0migration/023217-21kthreadcore09:56:420
149940,0migration/016721-21fschecks_count11:06:370
149940,0migration/016721-21fschecks_count11:06:370
149940,0migration/016148-21kthreadcore12:16:450
329930,0watchdog/30-21swapper/308:51:513
329930,0watchdog/30-21swapper/308:41:393
329930,0watchdog/30-21swapper/307:57:073
29805030,0irq/28-eth0-rx-0-21swapper/308:21:353
29805030,0irq/28-eth0-rx-0-21swapper/308:11:423
29805030,0irq/28-eth0-rx-0-21swapper/307:51:353
29805030,0irq/28-eth0-rx-0-21swapper/307:36:273
29805030,0irq/28-eth0-rx-0-21swapper/307:11:353
259930,0migration/219902-21kthreadcore08:36:422
259930,0migration/21377-21kthreadcore07:16:412
249930,0watchdog/29690-21kthreadcore08:06:432
249930,0watchdog/214961-21kthreadcore08:11:432
236259932,0cyclictest6380-21cut07:41:452
236259932,0cyclictest3524-21snmpd07:11:332
236259932,0cyclictest20500-21wc08:16:242
236259932,0cyclictest10795-21awk07:46:402
236249933,0cyclictest2098-21sadc07:41:231
236249932,0cyclictest4857-21awk10:41:421
236249932,0cyclictest32061-21ssh11:12:291
236249932,0cyclictest30203-21awk10:01:411
236249932,0cyclictest27077-21kthreadcore10:51:421
236249932,0cyclictest19188-21awk10:31:421
236239933,0cyclictest3571-21lldpd09:06:320
236239933,0cyclictest17614-21kworker/0:212:01:420
236239933,0cyclictest17614-21kworker/0:211:01:360
236239933,0cyclictest17614-21kworker/0:211:01:360
236239933,0cyclictest17614-21kworker/0:210:42:230
236239933,0cyclictest17614-21kworker/0:210:26:290
236239933,0cyclictest17614-21kworker/0:210:11:310
236239933,0cyclictest17614-21kworker/0:209:46:250
236239933,0cyclictest17614-21kworker/0:209:31:370
236239932,0cyclictest5015-21date11:36:250
236239932,0cyclictest18019-21awk07:51:390
236239930,0cyclictest31036-21munin-node07:16:490
179930,0migration/19289-21kthreadcore10:06:421
169930,0watchdog/16314-21runrttasks08:26:431
169930,0watchdog/129584-21cut07:56:431
169930,0watchdog/117249-21ssh11:06:391
169930,0watchdog/117249-21ssh11:06:391
236249921,0cyclictest16802-21cut07:51:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional