You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-30 - 10:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Tue Dec 30, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
571924637,0sleep20-21swapper/219:07:012
598123626,0sleep10-21swapper/119:10:041
575023026,0sleep00-21swapper/019:07:230
521522723,0sleep30-21swapper/319:06:503
6171991818,0cyclictest3524-21snmpd23:12:581
6171991313,0cyclictest3524-21snmpd21:21:221
617099109,0cyclictest0-21swapper/021:11:430
61719960,0cyclictest0-21swapper/100:01:101
61709960,0cyclictest0-21swapper/022:18:020
339960,0migration/36417-21kthreadcore19:31:453
339960,0migration/35499-21sh00:39:543
339960,0migration/324531-21sh00:12:023
339960,0migration/319148-21sh23:35:293
339960,0migration/315721-21sh00:07:173
339960,0migration/313718-21kthreadcore00:26:453
29815060,0irq/29-eth0-tx-24500-21munin-node19:46:400
29805060,0irq/28-eth0-rx-28050-21ntpdc21:31:473
149960,0migration/029000-21sh22:10:500
8305050,0irq/26-0000:00:20588-21idleruntime-cro19:21:263
8305050,0irq/26-0000:00:17282-21latency_hist19:41:262
61729955,0cyclictest0-21swapper/222:39:442
61729955,0cyclictest0-21swapper/220:26:492
61729955,0cyclictest0-21swapper/219:26:262
61729950,0cyclictest0-21swapper/221:45:292
61729950,0cyclictest0-21swapper/221:17:072
61719955,0cyclictest0-21swapper/123:35:091
61709955,0cyclictest0-21swapper/023:33:140
61709955,0cyclictest0-21swapper/021:52:390
61709955,0cyclictest0-21swapper/021:46:200
61709955,0cyclictest0-21swapper/020:36:300
4150,0ktimersoftd/00-21swapper/020:26:290
339950,0migration/39476-21kthreadcore20:41:453
339950,0migration/37771-21kthreadcore23:46:443
339950,0migration/34645-21munin-node21:21:423
339950,0migration/34347-21kthreadcore21:56:463
339950,0migration/33432-21kthreadcore22:31:453
339950,0migration/332537-21kernelversion23:06:443
339950,0migration/330068-21kthreadcore21:16:453
339950,0migration/329315-21kthreadcore20:31:433
339950,0migration/328434-21ksmtuned20:56:273
339950,0migration/326595-21latency22:06:483
339950,0migration/326390-21kthreadcore20:51:453
339950,0migration/321841-21latency_hist23:01:263
339950,0migration/319952-21kthreadcore21:11:443
339950,0migration/31642-21sh21:54:543
339950,0migration/314959-21gltestperf20:46:433
339950,0migration/314223-21kthreadcore22:01:453
339950,0migration/313359-21taskset19:16:233
339950,0migration/312739-21kthreadcore19:36:463
329950,0watchdog/35412-21kthreadcore20:16:453
329950,0watchdog/328904-21kthreadcore23:21:463
329950,0watchdog/327001-21munin-node00:16:423
329950,0watchdog/326879-21port_sshpriv19:21:493
329950,0watchdog/30-21swapper/322:46:183
29815050,0irq/29-eth0-tx-689-21ssh21:52:472
29815050,0irq/29-eth0-tx-3524-21snmpd00:38:572
29815050,0irq/29-eth0-tx-3155-21munin-node00:21:432
29815050,0irq/29-eth0-tx-31472-21ssh00:00:222
29815050,0irq/29-eth0-tx-28804-21ssh23:02:052
29815050,0irq/29-eth0-tx-2846-21munin-node19:31:490
29815050,0irq/29-eth0-tx-18383-21munin-node22:41:452
29815050,0irq/29-eth0-tx-0-21swapper/223:44:072
29815050,0irq/29-eth0-tx-0-21swapper/222:13:302
29815050,0irq/29-eth0-tx-0-21swapper/200:34:022
29815050,0irq/29-eth0-tx-0-21swapper/200:12:472
29815050,0irq/29-eth0-tx-0-21swapper/021:01:180
29805050,0irq/28-eth0-rx-7268-21if_eth022:16:413
29805050,0irq/28-eth0-rx-21184-21ntp_offset22:21:503
29805050,0irq/28-eth0-rx-20470-21ntp_kernel_pll_23:51:483
29805050,0irq/28-eth0-rx-17960-21irqrtprio23:16:463
29805050,0irq/28-eth0-rx-14867-21kthreadcore22:56:463
29805050,0irq/28-eth0-rx-1282-21kthreadcore22:11:453
29805050,0irq/28-eth0-rx-0-21swapper/323:56:573
29805050,0irq/28-eth0-rx-0-21swapper/323:26:403
29805050,0irq/28-eth0-rx-0-21swapper/323:12:393
29805050,0irq/28-eth0-rx-0-21swapper/322:48:033
29805050,0irq/28-eth0-rx-0-21swapper/322:41:013
29805050,0irq/28-eth0-rx-0-21swapper/322:26:333
29805050,0irq/28-eth0-rx-0-21swapper/321:46:373
29805050,0irq/28-eth0-rx-0-21swapper/321:36:283
29805050,0irq/28-eth0-rx-0-21swapper/321:26:423
29805050,0irq/28-eth0-rx-0-21swapper/300:31:413
29805050,0irq/28-eth0-rx-0-21swapper/300:21:333
27150,0ktimersoftd/20-21swapper/222:17:582
259950,0migration/2905-21missed_timers22:46:472
259950,0migration/2843-21df_abs22:31:402
259950,0migration/26232-21sh21:38:092
259950,0migration/25202-21latency_hist23:46:272
259950,0migration/227947-21sh23:40:162
259950,0migration/216227-21sh00:08:312
259950,0migration/216098-21latency20:21:452
259950,0migration/215171-21sh23:14:012
259950,0migration/212475-21latency_hist21:26:272
259950,0migration/212218-21kthreadcore20:41:462
259950,0migration/210366-21sh21:59:082
249950,0watchdog/224262-21crond19:51:212
249950,0watchdog/213544-21fschecks_count22:56:422
19150,0ktimersoftd/10-21swapper/100:39:081
179950,0migration/13011-21latency_hist00:21:271
179950,0migration/130033-21kthreadcore22:46:451
179950,0migration/128413-21df_abs19:26:411
179950,0migration/116207-21taskset21:45:021
179950,0migration/110759-21kthreadcore00:06:451
169950,0watchdog/126735-21kthreadcore20:06:451
169950,0watchdog/116236-21kthreadcore22:01:461
169950,0watchdog/110269-21ssh21:58:541
149950,0migration/09502-21aten_r1power_cu22:36:390
149950,0migration/09122-21kthreadcore20:41:450
149950,0migration/08020-21kthreadcore19:11:450
149950,0migration/05697-21kthreadcore22:51:450
149950,0migration/05653-21sh22:16:030
149950,0migration/04777-21irqcore21:21:420
149950,0migration/03645-21fschecks_count20:16:410
149950,0migration/03039-21latency_hist00:21:270
149950,0migration/027745-21taskset19:26:170
149950,0migration/027050-21kthreadcore23:56:480
149950,0migration/026678-21kthreadcore23:01:450
149950,0migration/025878-21kthreadcore22:26:450
149950,0migration/025042-21kthreadcore23:36:460
149950,0migration/023114-21if_eth1.321:31:430
149950,0migration/021529-21timerandwakeup22:21:550
149950,0migration/020407-21kthreadcore21:46:430
149950,0migration/01785-21latency_hist23:26:270
149950,0migration/016017-21kthreadcore22:56:460
149950,0migration/014948-21kthreadcore21:26:470
149950,0migration/014280-21latency_hist23:51:270
149950,0migration/012213-21kthreadcore19:56:450
8305040,0irq/26-0000:00:3215-21date21:01:272
61729944,0cyclictest0-21swapper/200:16:322
61729943,0cyclictest3524-21snmpd19:38:262
61729943,0cyclictest29581-21awk20:56:432
61729943,0cyclictest22404-21awk20:51:432
61729943,0cyclictest14890-21awk20:01:422
61719943,0cyclictest4050-21awk19:31:431
61719943,0cyclictest3571-21lldpd22:11:411
61719943,0cyclictest3524-21snmpd23:47:131
61719943,0cyclictest3524-21snmpd22:16:581
61719943,0cyclictest3524-21snmpd21:50:581
61719943,0cyclictest3524-21snmpd21:08:271
61719943,0cyclictest3524-21snmpd21:05:271
61719943,0cyclictest3524-21snmpd20:49:421
61719943,0cyclictest32332-21awk21:36:451
61719943,0cyclictest25900-21awk20:31:411
61719943,0cyclictest25534-21awk19:46:411
61719943,0cyclictest25147-21awk22:26:441
61719943,0cyclictest18658-21awk20:26:441
61719943,0cyclictest15483-21awk23:51:431
61719942,0cyclictest31755-21cut21:51:451
61709944,0cyclictest0-21swapper/022:32:510
61709944,0cyclictest0-21swapper/000:31:530
61709943,0cyclictest6368-21kworker/0:200:01:360
61709943,0cyclictest3524-21snmpd23:16:430
61709943,0cyclictest3524-21snmpd00:15:290
61709943,0cyclictest32728-21awk19:51:410
61709943,0cyclictest29040-21awk19:26:430
61709943,0cyclictest27733-21awk21:16:430
61709943,0cyclictest27222-21cut00:16:430
61709940,0cyclictest3285-21munin-node21:01:430
61709940,0cyclictest17428-21idleruntime-cro00:11:270
61709940,0cyclictest0-21swapper/020:51:390
339940,0migration/37954-21irqcore19:56:443
339940,0migration/34539-21irqcore21:01:473
339940,0migration/325231-21kthreadcore20:06:453
329940,0watchdog/3298050irq/28-eth0-rx-21:41:383
329940,0watchdog/317959-21munin-node20:26:413
329940,0watchdog/31358-21kthreadcore20:36:453
329940,0watchdog/310900-21df21:06:413
329940,0watchdog/30-21swapper/323:41:463
329940,0watchdog/30-21swapper/320:11:293
329940,0watchdog/30-21swapper/319:42:013
329940,0watchdog/30-21swapper/319:26:453
329940,0watchdog/30-21swapper/300:01:383
29815040,0irq/29-eth0-tx-15020-21munin-node22:21:412
29815040,0irq/29-eth0-tx-0-21swapper/223:31:302
29815040,0irq/29-eth0-tx-0-21swapper/223:26:272
29815040,0irq/29-eth0-tx-0-21swapper/223:21:402
29815040,0irq/29-eth0-tx-0-21swapper/223:16:312
29815040,0irq/29-eth0-tx-0-21swapper/223:06:352
29815040,0irq/29-eth0-tx-0-21swapper/222:51:392
29815040,0irq/29-eth0-tx-0-21swapper/222:26:412
29815040,0irq/29-eth0-tx-0-21swapper/222:01:452
29815040,0irq/29-eth0-tx-0-21swapper/221:46:282
29815040,0irq/29-eth0-tx-0-21swapper/221:13:562
29815040,0irq/29-eth0-tx-0-21swapper/200:26:362
29815040,0irq/29-eth0-tx-0-21swapper/020:11:500
29805040,0irq/28-eth0-rx-0-21swapper/323:36:353
29805040,0irq/28-eth0-rx-0-21swapper/322:51:453
29805040,0irq/28-eth0-rx-0-21swapper/320:06:093
259940,0migration/232398-21fschecks_count20:36:422
259940,0migration/232187-21sh00:01:342
259940,0migration/231700-21aten_r1power_cu19:51:372
259940,0migration/227959-21kthreadcore20:31:432
259940,0migration/224975-21kthreadcore22:06:472
259940,0migration/222152-21cpuspeed_turbos21:31:392
259940,0migration/217323-21kthreadcore21:26:482
249940,0watchdog/27608-21kthreadcore19:31:452
249940,0watchdog/226737-21kthreadcore20:06:452
249940,0watchdog/219694-21kthreadcore23:51:462
249940,0watchdog/211909-21kthreadcore19:56:452
249940,0watchdog/20-21swapper/221:06:412
249940,0watchdog/20-21swapper/220:11:412
249940,0watchdog/20-21swapper/219:22:452
179940,0migration/18575-21kthreadcore21:21:441
179940,0migration/18045-21irqrtprio19:56:441
179940,0migration/15053-21kthreadcore23:26:431
179940,0migration/13296-21kthreadcore19:51:441
179940,0migration/132763-21fschecks_time20:36:421
179940,0migration/132701-21kthreadcore23:41:461
179940,0migration/13005-21latency_hist20:16:261
179940,0migration/129516-21munin-node20:56:431
179940,0migration/126732-21munin-node00:16:411
179940,0migration/124860-21kthreadcore00:31:471
179940,0migration/123269-21sh22:25:331
179940,0migration/121735-21idleruntime22:06:441
179940,0migration/120444-21kthreadcore19:41:431
179940,0migration/120109-21cpuspeed_turbos23:36:401
179940,0migration/119739-21taskset22:56:581
179940,0migration/119024-21sensors_fan21:26:521
179940,0migration/117757-21aten_r1power_cu00:11:401
179940,0migration/114895-21irqcore19:16:441
179940,0migration/113706-21taskset20:45:281
179940,0migration/112790-21fschecks_time00:26:411
179940,0migration/111862-21kthreadcore19:11:461
179940,0migration/110335-21fschecks_time22:36:421
169940,0watchdog/19519-21grep22:51:461
169940,0watchdog/16746-21ssh00:02:101
169940,0watchdog/14582-21kthreadcore22:31:461
169940,0watchdog/128206-21munin-node20:11:411
169940,0watchdog/126954-21ssh22:46:181
169940,0watchdog/110135-21munin-node19:36:411
169940,0watchdog/10-21swapper/123:21:461
169940,0watchdog/10-21swapper/123:01:541
169940,0watchdog/10-21swapper/120:51:451
1424240,0sleep00-21swapper/023:26:000
149940,0migration/08102-21kthreadcore23:46:440
149940,0migration/032661-21kthreadcore00:36:490
149940,0migration/028335-21hwlatdetect22:46:430
149940,0migration/024978-21unixbench-2d22:41:530
149940,0migration/014601-21kthreadcore00:26:460
149940,0migration/010106-21kthreadcore23:11:450
61729932,0cyclictest7589-21awk19:11:442
61729932,0cyclictest3524-21snmpd20:46:422
61719932,0cyclictest32015-21awk23:06:421
61719932,0cyclictest19621-21grep20:01:451
61719932,0cyclictest10792-21tune2fs20:21:401
61719930,0cyclictest22352-21entropy21:31:401
61709933,0cyclictest9111-21kworker/0:123:41:280
61709933,0cyclictest9111-21kworker/0:123:06:320
61709933,0cyclictest9111-21kworker/0:121:57:160
61709933,0cyclictest4063-21kworker/0:021:36:420
61709933,0cyclictest4063-21kworker/0:021:06:280
61709933,0cyclictest4063-21kworker/0:020:31:370
61709932,0cyclictest3524-21snmpd22:01:310
61709932,0cyclictest3524-21snmpd19:16:410
61709930,0cyclictest0-21swapper/020:46:460
61709930,0cyclictest0-21swapper/020:06:390
61709930,0cyclictest0-21swapper/020:01:430
61709930,0cyclictest0-21swapper/019:41:420
339930,0migration/310475-21aten_r1power_vo20:21:393
329930,0watchdog/30-21swapper/319:55:053
329930,0watchdog/30-21swapper/319:46:373
29815030,0irq/29-eth0-tx-10191-21aten2.4-expect19:36:390
29815030,0irq/29-eth0-tx-0-21swapper/020:21:380
249930,0watchdog/20-21swapper/220:16:412
249930,0watchdog/20-21swapper/219:16:292
169930,0watchdog/10-21swapper/123:16:461
169930,0watchdog/10-21swapper/121:11:411
169930,0watchdog/10-21swapper/119:22:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional