You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-21 - 00:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Sat Dec 20, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2506223927,0sleep30-21swapper/307:09:073
2487723127,0sleep20-21swapper/207:06:582
2499622925,0sleep10-21swapper/107:08:171
2499522824,0sleep00-21swapper/007:08:160
4160,0ktimersoftd/00-21swapper/009:45:160
35160,0ktimersoftd/30-21swapper/309:40:433
339960,0migration/38762-21kthreadcore12:10:583
339960,0migration/330312-21munin-node12:21:053
339960,0migration/323688-21sh12:20:173
339960,0migration/323205-21munin-node09:55:553
339960,0migration/317639-21sh12:33:473
339960,0migration/311488-21kthreadcore07:20:583
252679960,0cyclictest12492-21cut10:05:591
252669965,0cyclictest21717-21kthreadcore09:35:560
149960,0migration/019298-21taskset11:58:240
149960,0migration/012960-21sh10:41:230
8305050,0irq/26-0000:00:7767-21idleruntime-cro08:50:392
35150,0ktimersoftd/30-21swapper/310:10:403
339950,0migration/39976-21kthreadcore08:50:583
339950,0migration/39416-21taskset11:00:343
339950,0migration/39129-21kthreadcore11:15:593
339950,0migration/38289-21kthreadcore09:10:583
339950,0migration/33651-21timerandwakeup12:06:033
339950,0migration/331452-21kthreadcore07:35:573
339950,0migration/331366-21aten_r1power_po11:30:523
339950,0migration/329908-21fschecks_count08:20:533
339950,0migration/329673-21kthreadcore11:45:593
339950,0migration/32887-21kthreadcore07:15:563
339950,0migration/327363-21kthreadcore07:10:563
339950,0migration/324075-21kthreadcore08:36:003
339950,0migration/323172-21cpuspeed_turbos09:20:523
339950,0migration/321661-21taskset07:30:173
339950,0migration/320484-21kthreadcore08:55:593
339950,0migration/320178-21kthreadcore07:50:573
339950,0migration/318033-21kthreadcore10:45:573
339950,0migration/317079-21kthreadcore08:30:593
339950,0migration/315012-21aten_r1power_fr08:10:523
339950,0migration/313298-21aten_r1power_en09:50:543
329950,0watchdog/38874-21kthreadcore07:40:583
329950,0watchdog/37816-21sh10:05:423
329950,0watchdog/36824-21kthreadcore08:25:583
329950,0watchdog/36687-21sort10:40:543
329950,0watchdog/34559-21kthreadcore08:45:583
329950,0watchdog/329161-21cut07:55:583
329950,0watchdog/327191-21cut10:50:583
329950,0watchdog/325918-21aten_r1power_cu08:40:503
329950,0watchdog/321573-21sed12:00:543
329950,0watchdog/315124-21kthreadcore11:55:583
329950,0watchdog/31226-21fschecks_count12:25:553
329950,0watchdog/30-21swapper/310:25:583
29815050,0irq/29-eth0-tx-9772-21munin-node11:00:542
29815050,0irq/29-eth0-tx-9768-21ssh12:30:502
29815050,0irq/29-eth0-tx-485-21kthreadcore11:10:582
29815050,0irq/29-eth0-tx-23576-21tr12:00:572
29815050,0irq/29-eth0-tx-22410-21grep10:30:582
29815050,0irq/29-eth0-tx-21106-21grep11:41:002
29815050,0irq/29-eth0-tx-21031-21ssh11:23:202
29815050,0irq/29-eth0-tx-18874-21grep09:35:522
29815050,0irq/29-eth0-tx-17693-21ntpq11:56:002
29815050,0irq/29-eth0-tx-16853-21munin-node10:10:572
29815050,0irq/29-eth0-tx-15150-21munin-node12:16:062
29815050,0irq/29-eth0-tx-14758-21munin-node07:26:040
29815050,0irq/29-eth0-tx-11851-21df10:25:532
29815050,0irq/29-eth0-tx-0-21swapper/212:26:002
29815050,0irq/29-eth0-tx-0-21swapper/211:35:552
29815050,0irq/29-eth0-tx-0-21swapper/210:02:052
29815050,0irq/29-eth0-tx-0-21swapper/209:54:482
29815050,0irq/29-eth0-tx-0-21swapper/209:20:562
29815050,0irq/29-eth0-tx-0-21swapper/209:16:402
29815050,0irq/29-eth0-tx-0-21swapper/008:50:570
29815050,0irq/29-eth0-tx-0-21swapper/007:18:200
29805050,0irq/28-eth0-rx-9120-21sed11:51:093
29805050,0irq/28-eth0-rx-8425-21ssh09:29:563
29805050,0irq/28-eth0-rx-31691-21kthreadcore11:10:573
29805050,0irq/28-eth0-rx-28787-21ssh10:34:433
29805050,0irq/28-eth0-rx-28080-21kthreadcore11:26:003
29805050,0irq/28-eth0-rx-24311-21latency09:35:573
29805050,0irq/28-eth0-rx-22067-21ssh09:19:453
29805050,0irq/28-eth0-rx-19928-21if_eth112:35:583
29805050,0irq/28-eth0-rx-11356-21sed11:00:583
29805050,0irq/28-eth0-rx-0-21swapper/311:41:523
29805050,0irq/28-eth0-rx-0-21swapper/311:38:513
29805050,0irq/28-eth0-rx-0-21swapper/311:20:583
29805050,0irq/28-eth0-rx-0-21swapper/311:06:573
29805050,0irq/28-eth0-rx-0-21swapper/310:22:573
29805050,0irq/28-eth0-rx-0-21swapper/310:15:553
29805050,0irq/28-eth0-rx-0-21swapper/309:46:473
27150,0ktimersoftd/20-21swapper/210:08:472
252689955,0cyclictest0-21swapper/210:20:542
252689950,0cyclictest0-21swapper/210:46:362
252689950,0cyclictest0-21swapper/209:56:472
252679955,0cyclictest0-21swapper/111:39:371
252679955,0cyclictest0-21swapper/111:22:171
252679955,0cyclictest0-21swapper/111:20:231
252679955,0cyclictest0-21swapper/111:06:031
252679955,0cyclictest0-21swapper/107:25:571
252679950,0cyclictest0-21swapper/111:04:091
252679950,0cyclictest0-21swapper/110:38:271
252679950,0cyclictest0-21swapper/109:17:341
252669955,0cyclictest0-21swapper/009:22:130
252669950,0cyclictest0-21swapper/012:27:470
252669950,0cyclictest0-21swapper/012:21:470
252669950,0cyclictest0-21swapper/010:48:180
259950,0migration/231560-21taskset07:55:592
259950,0migration/231539-21sh12:22:392
259950,0migration/229463-21sh10:35:472
259950,0migration/224615-21kthreadcore09:00:562
259950,0migration/223433-21irqcore08:15:552
259950,0migration/215855-21gltestperf08:10:542
249950,0watchdog/27964-21kthreadcore11:15:582
249950,0watchdog/219253-21perl07:50:542
249950,0watchdog/211198-21unixbench_singl09:11:062
179950,0migration/18555-21missed_timers10:21:011
179950,0migration/17323-21timerandwakeup12:26:061
179950,0migration/13161-21missed_timers12:05:581
179950,0migration/126039-21aten_r1power_po08:40:501
179950,0migration/118858-21munin-node09:35:521
169950,0watchdog/130541-21cut07:10:571
169950,0watchdog/124008-21cut11:25:581
169950,0watchdog/113209-21kthreadcore08:05:581
169950,0watchdog/10-21swapper/112:15:581
149950,0migration/07403-21kthreadcore09:10:580
149950,0migration/07283-21kthreadcore09:45:570
149950,0migration/06715-21kthreadcore10:20:590
149950,0migration/05073-21sh12:08:450
149950,0migration/032710-21irqrtprio11:30:570
149950,0migration/032039-21taskset07:11:170
149950,0migration/031843-21missed_timers10:16:000
149950,0migration/031022-21sh10:51:380
149950,0migration/029304-21sh11:26:510
149950,0migration/028768-21sh10:34:400
149950,0migration/025171-21switchtime11:06:050
149950,0migration/025169-21kthreadcore09:55:580
149950,0migration/025064-21kthreadcore09:00:560
149950,0migration/023499-21taskset12:19:520
149950,0migration/022908-21kthreadcore07:50:580
149950,0migration/022109-21kthreadcore10:10:570
149950,0migration/019818-21if_eth108:35:570
149950,0migration/019576-21fschecks_time12:35:560
149950,0migration/019233-21kthreadcore08:55:580
149950,0migration/015742-21missed_timers11:01:020
149950,0migration/013420-21kthreadcore08:30:580
149950,0migration/012037-21kthreadcore09:30:580
149950,0migration/011863-21fschecks_count07:45:530
149950,0migration/010833-21idleruntime12:30:570
339940,0migration/33338-21kthreadcore10:00:583
339940,0migration/324139-21kthreadcore09:00:563
339940,0migration/310821-21kthreadcore08:05:573
329940,0watchdog/314423-21grep07:45:583
329940,0watchdog/31215-21kthreadcore09:05:583
329940,0watchdog/30-21swapper/310:35:583
329940,0watchdog/30-21swapper/308:15:543
29815040,0irq/29-eth0-tx-7013-21fschecks_time12:10:532
29815040,0irq/29-eth0-tx-6721-21kthreadcore09:45:572
29815040,0irq/29-eth0-tx-0-21swapper/212:35:532
29815040,0irq/29-eth0-tx-0-21swapper/212:05:522
29815040,0irq/29-eth0-tx-0-21swapper/211:50:412
29815040,0irq/29-eth0-tx-0-21swapper/211:30:522
29815040,0irq/29-eth0-tx-0-21swapper/211:25:442
29815040,0irq/29-eth0-tx-0-21swapper/210:15:512
29815040,0irq/29-eth0-tx-0-21swapper/209:25:542
29815040,0irq/29-eth0-tx-0-21swapper/008:25:520
29815040,0irq/29-eth0-tx-0-21swapper/008:15:560
29815040,0irq/29-eth0-tx-0-21swapper/008:01:060
29815040,0irq/29-eth0-tx-0-21swapper/007:41:010
29805040,0irq/28-eth0-rx-0-21swapper/309:31:003
252689944,0cyclictest0-21swapper/209:30:552
252689944,0cyclictest0-21swapper/207:15:392
252689943,0cyclictest3524-21snmpd09:40:552
252689943,0cyclictest30169-21awk07:35:552
252689943,0cyclictest15909-21awk07:25:592
252689940,0cyclictest0-21swapper/209:09:102
252679943,0cyclictest8622-21awk07:20:561
252679943,0cyclictest5415-21awk08:25:561
252679943,0cyclictest3571-21lldpd10:56:061
252679943,0cyclictest3571-21lldpd10:29:061
252679943,0cyclictest3571-21lldpd09:31:361
252679943,0cyclictest3571-21lldpd07:34:051
252679943,0cyclictest3524-21snmpd10:40:401
252679943,0cyclictest30423-21awk08:20:551
252679943,0cyclictest27024-21awk11:45:571
252679943,0cyclictest25685-21sadc08:40:391
252679943,0cyclictest23270-21awk09:55:551
252679943,0cyclictest14451-21awk09:50:591
252679943,0cyclictest12271-21awk07:45:551
252669944,0cyclictest4262-21diskmemload12:10:550
252669944,0cyclictest0-21swapper/011:21:150
252669944,0cyclictest0-21swapper/010:36:570
252669943,0cyclictest3765-21sadc07:40:380
252669943,0cyclictest3571-21lldpd11:52:380
252669943,0cyclictest3571-21lldpd07:21:350
252669943,0cyclictest3250-21irqbalance11:17:260
252669943,0cyclictest3250-21irqbalance10:55:460
252669943,0cyclictest3250-21irqbalance09:26:050
252669943,0cyclictest3250-21irqbalance09:16:150
252669943,0cyclictest3250-21irqbalance09:07:250
252669943,0cyclictest3250-21irqbalance08:40:550
252669943,0cyclictest17975-21awk11:40:570
252669943,0cyclictest16563-21sadc10:10:390
252669943,0cyclictest16003-21awk08:10:560
252669943,0cyclictest12611-21awk10:25:560
259940,0migration/29676-21kthreadcore08:05:572
259940,0migration/231889-21sh08:40:592
259940,0migration/226461-21hwlatdetect07:10:542
259940,0migration/215174-21latency_hist08:55:392
259940,0migration/211478-21cpuspeed_turbos07:45:522
259940,0migration/210282-21kthreadcore10:41:002
249940,0watchdog/29128-21kthreadcore07:20:572
249940,0watchdog/22803-21kthreadcore08:00:582
249940,0watchdog/223722-21kthreadcore11:05:582
249940,0watchdog/20-21swapper/211:45:582
249940,0watchdog/20-21swapper/210:55:582
249940,0watchdog/20-21swapper/210:50:582
249940,0watchdog/20-21swapper/208:25:542
179940,0migration/15324-21kthreadcore08:00:581
179940,0migration/14012-21kthreadcore07:15:571
179940,0migration/131840-21kthreadcore11:10:581
179940,0migration/130263-21kthreadcore09:41:001
179940,0migration/129412-21turbostat09:05:391
179940,0migration/128018-21kthreadcore10:50:591
179940,0migration/127792-21kthreadcore08:15:571
179940,0migration/127322-21taskset10:31:161
179940,0migration/123629-21fschecks_time09:20:541
179940,0migration/122466-21kthreadcore12:00:571
179940,0migration/121264-21timerandwakeup08:11:051
179940,0migration/117361-21fschecks_count10:10:521
179940,0migration/116899-21kthreadcore11:55:581
179940,0migration/115209-21runrttasks08:55:431
179940,0migration/110785-21taskset07:43:081
179940,0migration/110108-21kthreadcore08:50:581
169940,0watchdog/15264-21fschecks_time09:10:541
169940,0watchdog/14558-21kthreadcore08:45:581
169940,0watchdog/129162-21kthreadcore07:55:581
169940,0watchdog/126743-21ssh12:39:071
169940,0watchdog/124850-21ssh11:43:581
169940,0watchdog/116596-21ssh12:31:191
169940,0watchdog/11216-21kthreadcore09:05:581
169940,0watchdog/10-21swapper/110:15:581
169940,0watchdog/10-21swapper/109:25:581
169940,0watchdog/10-21swapper/107:50:581
169940,0watchdog/10-21swapper/107:35:581
149940,0migration/05067-21kthreadcore08:45:580
149940,0migration/032615-21diskmemload11:46:080
149940,0migration/024472-21kthreadcore12:00:570
149940,0migration/023214-21irqcore07:30:580
149940,0migration/015598-21kthreadcore09:51:000
149940,0migration/012437-21kthreadcore08:05:570
149940,0migration/011633-21kthreadcore11:35:590
149940,0migration/01084-21kthreadcore08:20:580
329930,0watchdog/30-21swapper/308:00:583
29805030,0irq/28-eth0-rx-0-21swapper/307:30:533
252689932,0cyclictest9106-21awk08:50:572
252689932,0cyclictest12574-21awk08:30:562
252689930,0cyclictest0-21swapper/208:40:002
252689930,0cyclictest0-21swapper/207:40:392
252679932,0cyclictest7166-21cut11:51:021
252679932,0cyclictest3524-21snmpd12:20:561
252679932,0cyclictest32459-21awk11:30:571
252669933,0cyclictest26652-21awk07:55:550
252669933,0cyclictest19731-21kworker/0:011:11:400
252669932,0cyclictest32338-21awk10:00:550
249930,0watchdog/20-21swapper/208:20:582
19130,0ktimersoftd/10-21swapper/108:35:191
169930,0watchdog/10-21swapper/112:10:581
169930,0watchdog/10-21swapper/110:45:501
169930,0watchdog/10-21swapper/110:00:581
169930,0watchdog/10-21swapper/109:45:581
252689920,0cyclictest0-21swapper/207:30:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional