You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 20:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sun Jun 14, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3203326867,0sleep10-21swapper/107:22:441
3219824030,0sleep20-21swapper/207:24:422
3190323928,0sleep00-21swapper/007:21:150
3185323828,0sleep30-21swapper/307:20:423
32316991212,0cyclictest3154-21sensors09:35:340
323169999,0cyclictest3524-21snmpd11:23:320
339960,0migration/35668-21sh10:53:203
339960,0migration/329295-21sh10:48:153
339960,0migration/326989-21sh11:41:483
339960,0migration/325463-21sh12:37:413
339960,0migration/320384-21aten_r1power_en09:30:243
339960,0migration/320346-21sh11:56:123
339960,0migration/318446-21sh08:45:123
339960,0migration/315062-21munin-node11:15:333
339960,0migration/313486-21sh09:43:083
323189966,0cyclictest0-21swapper/212:10:332
323189960,0cyclictest0-21swapper/208:35:312
29815060,0irq/29-eth0-tx-21846-21munin-node07:40:370
29815060,0irq/29-eth0-tx-15233-21munin-node09:05:260
29805060,0irq/28-eth0-rx-4470-21netstat12:05:323
29805060,0irq/28-eth0-rx-1865-21iostat12:25:283
29805060,0irq/28-eth0-rx-17409-21df_inode10:05:263
29805060,0irq/28-eth0-rx-1650-21ntp_states10:30:333
29805060,0irq/28-eth0-rx-12231-21diskstats09:25:263
149960,0migration/03497-21unixbench-2d08:30:370
149960,0migration/026013-21sh12:39:100
149960,0migration/020812-21sh11:57:310
149960,0migration/014560-21sh12:12:510
4150,0ktimersoftd/00-21swapper/012:25:140
339950,0migration/39933-21kthreadcore12:10:303
339950,0migration/3822-21runrttasks08:10:263
339950,0migration/3822-21runrttasks08:10:263
339950,0migration/35226-21kthreadcore12:45:293
339950,0migration/33560-21taskset07:48:213
339950,0migration/330677-21rt-features12:20:343
339950,0migration/326630-21gltestperf10:10:273
339950,0migration/324794-21kthreadcore12:00:313
339950,0migration/323863-21kthreadcore08:25:303
339950,0migration/322025-21sendmail_mailtr12:15:373
339950,0migration/321143-21kthreadcore11:20:323
339950,0migration/320626-21kthreadcore09:05:313
339950,0migration/32047-21runrttasks10:15:243
339950,0migration/317811-21ntp_kernel_pll_12:50:333
339950,0migration/316286-21kthreadcore09:45:303
339950,0migration/31566-21kthreadcore09:55:293
339950,0migration/314062-21munin-node10:40:303
339950,0migration/313625-21kthreadcore12:30:303
339950,0migration/31319-21runrttasks12:41:383
339950,0migration/311868-21munin-node10:20:333
339950,0migration/311468-21cpu11:35:253
339950,0migration/310518-21runrttasks10:35:333
323189955,0cyclictest0-21swapper/211:49:452
323189955,0cyclictest0-21swapper/211:21:412
323189955,0cyclictest0-21swapper/211:15:032
323189955,0cyclictest0-21swapper/211:07:392
323179950,0cyclictest0-21swapper/109:45:321
323169954,0cyclictest19741-21if_err_eth1.208:45:280
323169950,0cyclictest0-21swapper/012:04:450
323169950,0cyclictest0-21swapper/010:02:340
329950,0watchdog/329749-21aten2.4-expect09:15:233
329950,0watchdog/328467-21ssh11:45:163
329950,0watchdog/323965-21telnet11:05:243
329950,0watchdog/319320-21grep08:00:273
29815050,0irq/29-eth0-tx-9777-21ssh12:30:252
29815050,0irq/29-eth0-tx-7747-21munin-node08:15:400
29815050,0irq/29-eth0-tx-29008-21if_err_eth1.210:30:282
29815050,0irq/29-eth0-tx-12619-21expr12:50:272
29815050,0irq/29-eth0-tx-10899-21cpuspeed_turbos10:20:292
29815050,0irq/29-eth0-tx-0-21swapper/212:20:302
29815050,0irq/29-eth0-tx-0-21swapper/210:52:562
29815050,0irq/29-eth0-tx-0-21swapper/210:41:312
29815050,0irq/29-eth0-tx-0-21swapper/009:15:250
29815050,0irq/29-eth0-tx-0-21swapper/007:47:330
29805050,0irq/28-eth0-rx-32036-21kthreadcore11:25:303
29805050,0irq/28-eth0-rx-18109-21chrt07:59:243
29805050,0irq/28-eth0-rx-0-21swapper/311:12:113
29805050,0irq/28-eth0-rx-0-21swapper/311:03:433
29805050,0irq/28-eth0-rx-0-21swapper/310:25:303
29805050,0irq/28-eth0-rx-0-21swapper/310:01:453
29805050,0irq/28-eth0-rx-0-21swapper/308:35:293
259950,0migration/29889-21irqrtprio10:00:292
259950,0migration/29819-21sh11:32:032
259950,0migration/29157-21ntp_offset12:45:322
259950,0migration/231619-21ntp_kernel_pll_08:05:322
259950,0migration/222844-21munin-node10:45:262
259950,0migration/220759-21kthreadcore12:35:312
249950,0watchdog/227438-21kthreadcore12:00:322
249950,0watchdog/222785-21kthreadcore08:45:312
179950,0migration/15826-21munin-node08:35:291
179950,0migration/124352-21munin-node12:35:361
179950,0migration/121527-21kthreadcore11:20:321
179950,0migration/116731-21munin-node12:15:281
179950,0migration/115349-21aten_r1power_fr11:00:241
179950,0migration/114617-21taskset09:00:491
179950,0migration/112024-21sh10:38:251
169950,0watchdog/132688-21ssh12:25:001
169950,0watchdog/119319-21gltestperf08:00:271
169950,0watchdog/10-21swapper/110:10:321
149950,0migration/07064-21df_abs10:55:260
149950,0migration/06157-21kthreadcore08:35:290
149950,0migration/05647-21kthreadcore12:45:290
149950,0migration/04883-21kthreadcore11:10:290
149950,0migration/04746-21kthreadcore08:10:310
149950,0migration/04746-21kthreadcore08:10:310
149950,0migration/04544-21kthreadcore09:55:300
149950,0migration/04529-21kthreadcore11:30:290
149950,0migration/032479-21kthreadcore12:05:300
149950,0migration/029456-21latency_hist09:15:120
149950,0migration/029018-21kthreadcore09:50:300
149950,0migration/02901-21kthreadcore10:50:290
149950,0migration/028250-21taskset09:33:330
149950,0migration/028204-21cpuspeed_turbos10:30:250
149950,0migration/02772-21kthreadcore08:55:290
149950,0migration/027333-21kthreadcore10:10:300
149950,0migration/027010-21irqrtprio08:05:280
149950,0migration/026691-21fschecks_time08:50:260
149950,0migration/02315-21taskset12:44:200
149950,0migration/019161-21runrttasks11:39:000
149950,0migration/019068-21kthreadcore08:20:320
149950,0migration/018983-21kthreadcore07:35:310
149950,0migration/017329-21df_abs10:05:260
149950,0migration/016285-21kthreadcore09:25:310
149950,0migration/014888-21kthreadcore10:40:320
339940,0migration/39625-21kthreadcore07:50:303
339940,0migration/310127-21kthreadcore08:15:313
323189943,0cyclictest3250-21irqbalance12:15:292
323189943,0cyclictest3250-21irqbalance09:29:092
323189943,0cyclictest3250-21irqbalance09:02:092
323189943,0cyclictest3250-21irqbalance08:40:192
323189943,0cyclictest3250-21irqbalance08:20:292
323189943,0cyclictest3250-21irqbalance08:00:182
323189943,0cyclictest3250-21irqbalance07:26:082
323189943,0cyclictest26959-21awk08:50:282
323189943,0cyclictest23456-21awk09:10:262
323189943,0cyclictest22974-21awk07:40:282
323189943,0cyclictest21047-21awk11:40:292
323189943,0cyclictest15779-21awk07:35:282
323189943,0cyclictest15658-21awk09:45:282
323189943,0cyclictest12329-21awk07:55:282
323189943,0cyclictest0-21swapper/211:00:222
323179944,0cyclictest0-21swapper/109:10:231
323179943,0cyclictest7740-21awk10:55:281
323179943,0cyclictest5646-21awk09:20:281
323179943,0cyclictest3571-21lldpd10:20:331
323179943,0cyclictest3571-21lldpd09:41:321
323179943,0cyclictest3571-21lldpd07:50:301
323179943,0cyclictest3524-21snmpd10:01:481
323179943,0cyclictest3524-21snmpd09:50:481
323179943,0cyclictest3524-21snmpd09:26:481
323179943,0cyclictest3524-21snmpd09:15:171
323179943,0cyclictest3524-21snmpd08:51:471
323179943,0cyclictest3524-21snmpd08:28:471
323179943,0cyclictest3524-21snmpd07:44:021
323179943,0cyclictest3524-21snmpd07:30:321
323179943,0cyclictest20997-21awk11:40:281
323179943,0cyclictest19858-21awk08:45:291
323169944,0cyclictest0-21swapper/012:31:520
323169944,0cyclictest0-21swapper/011:41:250
323169944,0cyclictest0-21swapper/011:15:240
323169944,0cyclictest0-21swapper/010:25:160
323169943,0cyclictest5343-21awk10:35:280
323169943,0cyclictest3571-21lldpd12:21:050
323169943,0cyclictest3571-21lldpd09:50:020
323169943,0cyclictest3524-21snmpd11:47:340
323169943,0cyclictest3524-21snmpd09:41:030
323169943,0cyclictest3524-21snmpd07:52:020
323169943,0cyclictest27395-21awk11:25:270
323169943,0cyclictest25053-21awk11:05:280
323169943,0cyclictest23236-21awk08:25:280
323169943,0cyclictest16370-21awk11:00:290
323169943,0cyclictest11553-21sadc09:25:120
323169943,0cyclictest0-21swapper/009:00:260
329940,0watchdog/311514-21seq09:24:553
329940,0watchdog/30-21swapper/311:50:323
329940,0watchdog/30-21swapper/309:10:353
329940,0watchdog/30-21swapper/308:30:273
329940,0watchdog/30-21swapper/307:40:233
29815040,0irq/29-eth0-tx-7918-21ssh12:27:012
29815040,0irq/29-eth0-tx-5870-21ssh11:50:282
29815040,0irq/29-eth0-tx-30196-21ssh09:50:592
29815040,0irq/29-eth0-tx-19257-21ssh10:25:192
29815040,0irq/29-eth0-tx-11190-21ssh11:35:152
29815040,0irq/29-eth0-tx-0-21swapper/212:40:202
29815040,0irq/29-eth0-tx-0-21swapper/211:16:482
29815040,0irq/29-eth0-tx-0-21swapper/210:35:212
29815040,0irq/29-eth0-tx-0-21swapper/210:15:242
29815040,0irq/29-eth0-tx-0-21swapper/210:05:322
29815040,0irq/29-eth0-tx-0-21swapper/209:55:142
29815040,0irq/29-eth0-tx-0-21swapper/209:35:262
29805040,0irq/28-eth0-rx-0-21swapper/311:30:293
29805040,0irq/28-eth0-rx-0-21swapper/310:55:263
29805040,0irq/28-eth0-rx-0-21swapper/309:51:223
29805040,0irq/28-eth0-rx-0-21swapper/309:35:123
29805040,0irq/28-eth0-rx-0-21swapper/307:27:423
259940,0migration/28939-21irqrtprio07:30:292
259940,0migration/26629-21kthreadcore07:50:292
259940,0migration/232137-21kthreadcore11:25:302
259940,0migration/231971-21irqcore12:05:292
259940,0migration/230017-21runrttasks08:30:252
259940,0migration/224552-21kthreadcore08:25:302
259940,0migration/220142-21kthreadcore09:05:302
259940,0migration/212535-21latency10:55:322
259940,0migration/211462-21kthreadcore08:15:322
259940,0migration/210740-21kthreadcore09:40:302
249940,0watchdog/26756-21munin-node08:55:312
249940,0watchdog/229203-21kthreadcore10:10:322
249940,0watchdog/20-21swapper/211:55:322
249940,0watchdog/20-21swapper/209:30:312
249940,0watchdog/20-21swapper/208:10:312
249940,0watchdog/20-21swapper/208:10:312
249940,0watchdog/20-21swapper/207:45:312
19140,0ktimersoftd/10-21swapper/112:47:001
179940,0migration/18713-21sh08:15:271
179940,0migration/15351-21kthreadcore09:55:301
179940,0migration/1519-21kthreadcore10:30:311
179940,0migration/15009-21kthreadcore08:55:301
179940,0migration/14450-21sh11:49:581
179940,0migration/14045-21kthreadcore07:25:291
179940,0migration/132253-21runrttasks08:06:141
179940,0migration/128188-21ntp_kernel_pll_12:00:341
179940,0migration/12801-21missed_timers09:35:311
179940,0migration/126791-21fschecks_count11:25:251
179940,0migration/11904-21kthreadcore07:45:311
179940,0migration/118526-21kthreadcore09:05:301
179940,0migration/115535-21fschecks_time07:35:261
179940,0migration/114553-21kthreadcore07:55:301
179940,0migration/113718-21cpuspeed_turbos11:55:261
179940,0migration/113509-21kthreadcore08:40:301
179940,0migration/112284-21kthreadcore11:15:301
169940,0watchdog/1988-21taskset12:40:441
169940,0watchdog/17745-21kthreadcore10:15:321
169940,0watchdog/131602-21rm11:08:201
169940,0watchdog/130779-21aten_r1power_en12:05:241
169940,0watchdog/127268-21ssh10:29:121
169940,0watchdog/12662-21aten2.4-expect11:30:241
169940,0watchdog/122454-21perl10:45:241
169940,0watchdog/120476-21ssh10:42:481
169940,0watchdog/118899-21ssh11:38:161
169940,0watchdog/116498-21irqstats08:20:311
169940,0watchdog/10-21swapper/112:29:281
169940,0watchdog/10-21swapper/110:50:281
149940,0migration/07671-21kthreadcore10:15:320
149940,0migration/024703-21kthreadcore10:45:280
149940,0migration/017568-21timerandwakeup07:55:370
149940,0migration/016990-21diskmemload10:20:390
323189932,0cyclictest5757-21awk09:20:292
323179932,0cyclictest3524-21snmpd10:07:031
323179932,0cyclictest3316-21kthreadcore11:10:291
323179932,0cyclictest22000-21tr09:30:301
323169933,0cyclictest0-21swapper/012:51:440
323169932,0cyclictest5344-21tr07:25:290
323169930,0cyclictest7456-21munin-node07:30:330
323169930,0cyclictest5542-21perl11:50:260
323169930,0cyclictest21822-21ntpq12:15:350
323169930,0cyclictest0-21swapper/008:00:310
329930,0watchdog/30-21swapper/308:56:193
329930,0watchdog/30-21swapper/308:50:233
329930,0watchdog/30-21swapper/308:45:313
329930,0watchdog/30-21swapper/308:24:233
329930,0watchdog/30-21swapper/307:31:273
29815030,0irq/29-eth0-tx-0-21swapper/008:40:250
29805030,0irq/28-eth0-rx-0-21swapper/309:00:313
249930,0watchdog/20-21swapper/209:15:232
179930,0migration/116640-21sh12:32:151
169930,0watchdog/10-21swapper/112:50:241
169930,0watchdog/10-21swapper/112:10:321
169930,0watchdog/10-21swapper/111:50:321
169930,0watchdog/10-21swapper/108:30:231
169930,0watchdog/10-21swapper/108:10:311
169930,0watchdog/10-21swapper/108:10:311
329920,0watchdog/30-21swapper/308:05:153
329920,0watchdog/30-21swapper/307:35:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional