You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-28 - 14:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Sun Dec 28, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2579423726,0sleep30-21swapper/307:08:393
2588923626,0sleep20-21swapper/207:09:462
2598423127,0sleep00-21swapper/007:10:520
2587722824,0sleep10-21swapper/107:09:371
260959976,0cyclictest23226-21crond09:21:180
339960,0migration/33618-21latency10:36:413
339960,0migration/319243-21sh11:58:243
329960,0watchdog/331049-21ssh12:21:473
329960,0watchdog/315308-21ssh10:46:183
29815060,0irq/29-eth0-tx-19562-21munin-node08:36:370
29805060,0irq/28-eth0-rx-31987-21sh10:53:203
29805060,0irq/28-eth0-rx-25616-21sed09:36:473
29805060,0irq/28-eth0-rx-11336-21sed09:31:373
149960,0migration/020048-21kthreadcore12:16:400
149960,0migration/014885-21sh10:45:180
149960,0migration/01292-21sh11:48:410
8305050,0irq/26-0000:00:9486-21munin-run09:31:182
339950,0migration/37378-21sh09:26:563
339950,0migration/35096-21taskset09:11:173
339950,0migration/34005-21runrttasks11:15:173
339950,0migration/33555-21missed_timers07:36:413
339950,0migration/331551-21kthreadcore09:41:373
339950,0migration/329465-21kthreadcore08:41:363
339950,0migration/329465-21kthreadcore08:41:363
339950,0migration/329163-21timerwakeupswit07:31:443
339950,0migration/324974-21kthreadcore08:16:373
339950,0migration/319555-21taskset08:36:253
339950,0migration/318961-21aten_r1power_vo12:36:353
339950,0migration/316537-21fschecks_time08:11:323
339950,0migration/316299-21fschecks_time07:26:323
339950,0migration/315223-21kthreadcore10:26:353
339950,0migration/315056-21taskset11:36:473
339950,0migration/314324-21diskmemload12:14:313
339950,0migration/313623-21latency_hist11:21:193
339950,0migration/313571-21kthreadcore11:01:403
329950,0watchdog/330986-21cut10:16:383
329950,0watchdog/329563-21grep07:56:383
329950,0watchdog/319551-21df_abs11:06:343
329950,0watchdog/316312-21perl10:46:343
329950,0watchdog/312996-21grep12:31:393
329950,0watchdog/30-21swapper/309:01:383
329950,0watchdog/30-21swapper/308:06:343
329950,0watchdog/30-21swapper/307:16:373
29815050,0irq/29-eth0-tx-0-21swapper/007:46:390
29805050,0irq/28-eth0-rx-9409-21perl10:06:343
29805050,0irq/28-eth0-rx-6851-21kthreadcore11:51:373
29805050,0irq/28-eth0-rx-5138-21head08:26:303
29805050,0irq/28-eth0-rx-3552-21lldpd10:11:413
29805050,0irq/28-eth0-rx-3524-21snmpd09:51:483
29805050,0irq/28-eth0-rx-32099-21fschecks_count11:31:343
29805050,0irq/28-eth0-rx-32028-21munin-node10:01:333
29805050,0irq/28-eth0-rx-29902-21ssh11:27:563
29805050,0irq/28-eth0-rx-21740-21kthreadcore11:41:383
29805050,0irq/28-eth0-rx-1299-21ssh10:56:323
29805050,0irq/28-eth0-rx-11305-21munin-node11:16:453
29805050,0irq/28-eth0-rx-0-21swapper/312:26:393
29805050,0irq/28-eth0-rx-0-21swapper/312:16:513
29805050,0irq/28-eth0-rx-0-21swapper/310:31:373
29805050,0irq/28-eth0-rx-0-21swapper/310:21:403
29805050,0irq/28-eth0-rx-0-21swapper/310:00:533
29805050,0irq/28-eth0-rx-0-21swapper/309:51:113
29805050,0irq/28-eth0-rx-0-21swapper/309:21:393
29805050,0irq/28-eth0-rx-0-21swapper/309:19:433
29805050,0irq/28-eth0-rx-0-21swapper/309:16:053
29805050,0irq/28-eth0-rx-0-21swapper/307:51:413
260979955,0cyclictest0-21swapper/211:40:192
260979955,0cyclictest0-21swapper/209:11:572
260979954,0cyclictest11168-21cut11:01:362
260979950,0cyclictest0-21swapper/212:30:082
260979950,0cyclictest0-21swapper/212:11:322
260979950,0cyclictest0-21swapper/212:04:072
260979950,0cyclictest0-21swapper/211:57:492
260979950,0cyclictest0-21swapper/211:28:292
260979950,0cyclictest0-21swapper/210:48:272
260979950,0cyclictest0-21swapper/210:13:552
260979950,0cyclictest0-21swapper/209:56:442
260979950,0cyclictest0-21swapper/209:31:492
260969954,0cyclictest0-21swapper/112:12:331
260969950,0cyclictest0-21swapper/109:36:471
260959950,0cyclictest0-21swapper/012:21:320
260959950,0cyclictest0-21swapper/011:45:250
179950,0migration/19853-21sh11:52:191
179950,0migration/15401-21sh12:09:461
179950,0migration/13820-21fschecks_time10:21:341
179950,0migration/132036-21sh09:25:181
179950,0migration/127100-21needreboot10:31:391
179950,0migration/123650-21munin-node09:01:331
179950,0migration/123282-21kthreadcore10:11:411
179950,0migration/117087-21sh12:32:571
179950,0migration/116845-21munin-node08:11:341
169950,0watchdog/15178-21sh10:38:341
169950,0watchdog/14911-21aten_r1power_en07:41:301
169950,0watchdog/127316-21grep11:26:381
149950,0migration/09688-21taskset11:00:500
149950,0migration/09165-21fschecks_time07:21:530
149950,0migration/0890-21kthreadcore11:11:390
149950,0migration/0847-21munin-node08:41:440
149950,0migration/0847-21munin-node08:41:440
149950,0migration/0827-21taskset07:16:180
149950,0migration/08072-21kthreadcore07:41:360
149950,0migration/07119-21fschecks_time12:11:340
149950,0migration/07115-21timerwakeupswit09:26:440
149950,0migration/05193-21kthreadcore08:46:370
149950,0migration/03172-21kthreadcore08:01:390
149950,0migration/031643-21kthreadcore12:06:370
149950,0migration/030844-21kthreadcore07:56:380
149950,0migration/030507-21cpuspeed_turbos08:21:320
149950,0migration/029007-21kthreadcore10:16:370
149950,0migration/028356-21kthreadcore08:16:380
149950,0migration/027614-21kthreadcore09:01:390
149950,0migration/025505-21kthreadcore10:31:380
149950,0migration/022826-21latency_hist09:56:190
149950,0migration/022608-21latency_hist07:31:190
149950,0migration/019157-21aten_r1power_cu11:06:330
149950,0migration/019133-21aten_r1power_vo09:36:320
149950,0migration/018150-21kthreadcore10:46:380
149950,0migration/017983-21latency10:26:360
149950,0migration/016100-21latency11:01:410
149950,0migration/01589-21kthreadcore11:31:380
149950,0migration/015520-21kthreadcore11:56:370
149950,0migration/015155-21munin-node08:06:460
149950,0migration/014308-21kthreadcore10:06:380
8305040,0irq/26-0000:00:24748-21ssh09:21:362
329940,0watchdog/30-21swapper/312:01:343
329940,0watchdog/30-21swapper/308:55:063
329940,0watchdog/30-21swapper/308:21:343
29815040,0irq/29-eth0-tx-2760-21kthreadcore10:56:372
29815040,0irq/29-eth0-tx-26300-21kthreadcore10:31:382
29815040,0irq/29-eth0-tx-25235-21fschecks_time12:21:342
29815040,0irq/29-eth0-tx-19043-21latency_hist11:06:192
29815040,0irq/29-eth0-tx-13993-21munin-node09:51:412
29815040,0irq/29-eth0-tx-13665-21ssh11:21:252
29815040,0irq/29-eth0-tx-11705-21ssh11:17:162
29815040,0irq/29-eth0-tx-0-21swapper/212:31:212
29815040,0irq/29-eth0-tx-0-21swapper/212:16:392
29815040,0irq/29-eth0-tx-0-21swapper/212:06:362
29815040,0irq/29-eth0-tx-0-21swapper/211:44:332
29815040,0irq/29-eth0-tx-0-21swapper/211:12:342
29815040,0irq/29-eth0-tx-0-21swapper/210:37:072
29815040,0irq/29-eth0-tx-0-21swapper/210:26:192
29815040,0irq/29-eth0-tx-0-21swapper/210:23:182
29815040,0irq/29-eth0-tx-0-21swapper/209:46:472
29815040,0irq/29-eth0-tx-0-21swapper/209:36:332
29815040,0irq/29-eth0-tx-0-21swapper/209:16:302
29815040,0irq/29-eth0-tx-0-21swapper/008:28:330
29805040,0irq/28-eth0-rx-0-21swapper/312:06:243
29805040,0irq/28-eth0-rx-0-21swapper/311:46:353
29805040,0irq/28-eth0-rx-0-21swapper/308:46:363
260979943,0cyclictest559-21awk10:01:372
260979943,0cyclictest3861-21awk11:51:342
260979943,0cyclictest3571-21lldpd08:45:102
260979943,0cyclictest3571-21lldpd08:45:102
260979943,0cyclictest3524-21snmpd12:38:502
260979943,0cyclictest3524-21snmpd08:53:022
260979943,0cyclictest3524-21snmpd08:50:172
260979943,0cyclictest330-21awk11:31:362
260979943,0cyclictest31341-21awk08:21:362
260979943,0cyclictest29317-21awk09:41:352
260979943,0cyclictest27591-21awk07:56:362
260979943,0cyclictest26513-21sadc08:41:192
260979943,0cyclictest23880-21awk07:31:342
260979943,0cyclictest13498-21awk08:31:412
260979941,0cyclictest0-21swapper/211:46:302
260969943,0cyclictest6150-21awk09:46:341
260969943,0cyclictest3524-21snmpd12:39:501
260969943,0cyclictest2122-21irqcore12:26:391
260969943,0cyclictest20225-21awk11:06:371
260969943,0cyclictest16479-21awk12:16:381
260969943,0cyclictest15193-21awk09:51:361
260969943,0cyclictest13261-21awk10:26:331
260969940,0cyclictest0-21swapper/111:04:451
260959944,0cyclictest0-21swapper/011:38:480
260959943,0cyclictest3571-21lldpd10:25:410
260959943,0cyclictest25683-21awk10:51:370
260959943,0cyclictest23687-21kworker/0:212:37:270
260959943,0cyclictest21845-21awk12:01:380
260959943,0cyclictest13402-21awk08:31:400
260959943,0cyclictest10364-21sort09:31:340
260959943,0cyclictest0-21swapper/008:56:300
260959941,0cyclictest0-21swapper/007:38:240
259940,0migration/28015-21runrttasks07:19:362
259940,0migration/22632-21irqcore08:01:382
259940,0migration/216480-21forks08:56:312
249940,0watchdog/29175-21fschecks_count08:06:342
249940,0watchdog/27660-21ssh10:41:342
249940,0watchdog/26314-21runrttasks08:11:502
249940,0watchdog/24298-21gzip09:06:422
249940,0watchdog/230987-21kthreadcore10:16:382
249940,0watchdog/225008-21entropy10:51:342
249940,0watchdog/223759-21cut08:16:342
249940,0watchdog/214925-21sensors10:06:422
249940,0watchdog/212868-21kthreadcore07:21:572
249940,0watchdog/20-21swapper/209:01:342
19140,0ktimersoftd/10-21swapper/110:03:351
179940,0migration/1351-21kthreadcore08:21:381
179940,0migration/131378-21munin-node07:36:381
179940,0migration/128194-21kthreadcore12:21:381
179940,0migration/126197-21kthreadcore07:31:371
179940,0migration/125166-21kthreadcore08:36:381
179940,0migration/118656-21kthreadcore09:16:371
179940,0migration/11644-21sh10:18:561
179940,0migration/114611-21munin-node10:06:391
179940,0migration/114413-21fschecks_time11:21:331
179940,0migration/112728-21df_abs08:31:371
179940,0migration/11226-21taskset08:45:411
179940,0migration/11226-21taskset08:45:411
179940,0migration/111624-21sh11:17:041
179940,0migration/110041-21kthreadcore09:11:371
169940,0watchdog/19731-21ssh09:31:221
169940,0watchdog/15108-21diskmemload10:00:341
169940,0watchdog/15080-21chrt08:26:301
169940,0watchdog/14179-21ssh09:45:021
169940,0watchdog/130834-21ssh10:51:421
169940,0watchdog/12456-21iostat08:01:381
169940,0watchdog/123616-21python11:41:421
169940,0watchdog/1223502sleep107:28:541
169940,0watchdog/120935-21aten_r1power_vo12:01:341
169940,0watchdog/115329-21chrt11:37:261
169940,0watchdog/111937-21kthreadcore07:21:571
169940,0watchdog/10-21swapper/111:31:381
169940,0watchdog/10-21swapper/111:11:341
169940,0watchdog/10-21swapper/110:46:381
169940,0watchdog/10-21swapper/110:41:381
169940,0watchdog/10-21swapper/108:16:341
169940,0watchdog/10-21swapper/107:16:371
149940,0migration/08089-21kthreadcore09:46:360
149940,0migration/04498-21kthreadcore11:51:360
149940,0migration/030163-21sh11:28:330
149940,0migration/029486-21iostat09:41:360
149940,0migration/023991-21sh09:21:330
149940,0migration/02261-21kthreadcore10:01:390
149940,0migration/016724-21sh12:32:040
8305030,0irq/26-0000:00:0-21swapper/307:11:303
329930,0watchdog/30-21swapper/308:56:303
329930,0watchdog/30-21swapper/307:46:383
329930,0watchdog/30-21swapper/307:41:303
329930,0watchdog/30-21swapper/307:21:573
29805030,0irq/28-eth0-rx-0-21swapper/308:31:373
29805030,0irq/28-eth0-rx-0-21swapper/308:01:333
260979933,0cyclictest3571-21lldpd07:26:382
260979933,0cyclictest0-21swapper/207:46:302
260979932,0cyclictest6035-21awk07:41:342
260979932,0cyclictest32233-21needreboot07:11:382
260969932,0cyclictest6901-21sensors09:26:411
260969932,0cyclictest31362-21grep07:11:371
260969932,0cyclictest27375-21awk11:46:331
260969932,0cyclictest26820-21df_abs07:56:331
260969932,0cyclictest13423-21ps11:56:371
260969930,0cyclictest4421-21kthreadcore10:56:371
260969930,0cyclictest0-21swapper/107:51:281
260959933,0cyclictest27421-21kworker/0:011:16:230
260959933,0cyclictest27421-21kworker/0:010:36:200
260959933,0cyclictest23687-21kworker/0:212:26:230
260959933,0cyclictest22786-21kworker/0:210:11:320
260959933,0cyclictest22786-21kworker/0:209:51:220
260959933,0cyclictest22786-21kworker/0:209:11:200
260959933,0cyclictest22786-21kworker/0:209:06:320
260959933,0cyclictest22786-21kworker/0:208:51:220
260959933,0cyclictest13317-21kworker/0:007:51:300
260959933,0cyclictest13317-21kworker/0:007:31:200
260959933,0cyclictest13317-21kworker/0:007:16:220
260959932,0cyclictest17542-21kthreadcore08:11:360
260959932,0cyclictest14670-21tail11:21:330
249930,0watchdog/20-21swapper/208:26:302
179930,0migration/113593-21kthreadcore08:51:371
169930,0watchdog/10-21swapper/109:06:381
169930,0watchdog/10-21swapper/108:56:301
169930,0watchdog/10-21swapper/108:46:461
169930,0watchdog/10-21swapper/108:06:341
169930,0watchdog/10-21swapper/107:46:381
260979921,0cyclictest29962-21latency_hist07:36:192
249920,0watchdog/20-21swapper/207:51:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional