You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 11:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Dec 15, 2025 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
586995454,0cyclictest9624-21kworker/0:122:57:430
44124435,0sleep30-21swapper/319:09:173
586994242,0cyclictest9624-21kworker/0:100:20:280
3269423626,0sleep20-21swapper/219:06:482
31323624,0sleep10-21swapper/119:07:471
586993332,0cyclictest9624-21kworker/0:123:02:290
32723127,0sleep00-21swapper/019:07:580
586992626,0cyclictest9624-21kworker/0:123:55:450
5879976,0cyclictest18537-21awk23:50:281
5879966,0cyclictest0-21swapper/100:02:191
339960,0migration/38077-21sh20:00:113
339960,0migration/36247-21sh21:22:193
339960,0migration/33242-21sh23:24:503
339960,0migration/310625-21munin-node19:35:313
329960,0watchdog/311520-21head21:05:373
29805060,0irq/28-eth0-rx-3781-21munin-node00:00:243
29805060,0irq/28-eth0-rx-28592-21tr00:30:293
29805060,0irq/28-eth0-rx-18987-21python00:05:373
29805060,0irq/28-eth0-rx-0-21swapper/321:35:453
149960,0migration/0781-21sh22:45:310
149960,0migration/07476-21sh21:58:040
149960,0migration/028077-21kthreadcore20:35:340
149960,0migration/027644-21kthreadcore21:50:300
8305050,0irq/26-0000:00:8170-21munin-run23:10:112
5889955,0cyclictest0-21swapper/223:43:442
5889955,0cyclictest0-21swapper/222:15:182
5889955,0cyclictest0-21swapper/200:22:132
5889950,0cyclictest28-21ksoftirqd/221:16:202
5889950,0cyclictest0-21swapper/223:53:212
5889950,0cyclictest0-21swapper/222:44:472
5889950,0cyclictest0-21swapper/222:25:142
5889950,0cyclictest0-21swapper/200:12:362
5879955,0cyclictest0-21swapper/123:13:361
5879955,0cyclictest0-21swapper/121:56:021
5879950,0cyclictest0-21swapper/123:32:501
5879950,0cyclictest0-21swapper/122:24:531
5879950,0cyclictest0-21swapper/122:15:161
5869955,0cyclictest9624-21kworker/0:123:40:180
5869955,0cyclictest9624-21kworker/0:123:35:540
5869955,0cyclictest9624-21kworker/0:123:31:060
5869955,0cyclictest9624-21kworker/0:123:26:160
5869955,0cyclictest9624-21kworker/0:123:15:240
5869955,0cyclictest9624-21kworker/0:122:42:560
5869955,0cyclictest9624-21kworker/0:100:36:000
5869955,0cyclictest9624-21kworker/0:100:31:140
5869955,0cyclictest9624-21kworker/0:100:26:040
5869955,0cyclictest9624-21kworker/0:100:15:560
5869955,0cyclictest9624-21kworker/0:100:10:260
5869955,0cyclictest9624-21kworker/0:100:06:160
5869955,0cyclictest9624-21kworker/0:100:00:200
5869955,0cyclictest7522-21kworker/0:222:05:390
5869955,0cyclictest7522-21kworker/0:222:00:590
5869955,0cyclictest7522-21kworker/0:221:45:130
5869955,0cyclictest7522-21kworker/0:221:40:170
5869955,0cyclictest7522-21kworker/0:221:35:190
5869955,0cyclictest7522-21kworker/0:221:30:150
5869955,0cyclictest7522-21kworker/0:221:25:290
5869955,0cyclictest7522-21kworker/0:221:10:170
5869955,0cyclictest7522-21kworker/0:221:05:510
5869955,0cyclictest7522-21kworker/0:221:00:150
5869955,0cyclictest7522-21kworker/0:220:55:170
5869955,0cyclictest7522-21kworker/0:220:50:150
5869955,0cyclictest7522-21kworker/0:220:45:230
5869955,0cyclictest7522-21kworker/0:220:40:450
5869955,0cyclictest7522-21kworker/0:220:40:450
5869955,0cyclictest3627-21kworker/0:120:25:330
5869955,0cyclictest3627-21kworker/0:120:20:190
5869955,0cyclictest3627-21kworker/0:120:15:210
5869955,0cyclictest3627-21kworker/0:120:10:170
5869955,0cyclictest3627-21kworker/0:120:05:290
5869955,0cyclictest3627-21kworker/0:120:00:530
5869955,0cyclictest3627-21kworker/0:119:55:530
5869955,0cyclictest3627-21kworker/0:119:51:030
5869955,0cyclictest3627-21kworker/0:119:45:210
5869955,0cyclictest3627-21kworker/0:119:40:190
5869955,0cyclictest3627-21kworker/0:119:35:290
5869955,0cyclictest3627-21kworker/0:119:31:250
5869955,0cyclictest28188-21kworker/0:022:20:340
5869955,0cyclictest28188-21kworker/0:022:15:260
5869955,0cyclictest28188-21kworker/0:022:11:260
5869955,0cyclictest24375-21kworker/0:119:15:510
5869955,0cyclictest24375-21kworker/0:119:10:150
5869955,0cyclictest15092-21kworker/0:019:25:450
339950,0migration/38520-21kthreadcore20:20:303
339950,0migration/36189-21sh23:06:043
339950,0migration/34129-21kthreadcore22:30:303
339950,0migration/33998-21kthreadcore00:15:303
339950,0migration/331974-21kthreadcore23:55:313
339950,0migration/330576-21kthreadcore19:50:293
339950,0migration/329759-21munin-node19:30:213
339950,0migration/329247-21ksmtuned19:27:123
339950,0migration/329037-21sh00:11:443
339950,0migration/328583-21kthreadcore21:50:313
339950,0migration/324094-21switchtime23:15:373
339950,0migration/323371-21kthreadcore21:15:293
339950,0migration/322987-21kthreadcore20:30:283
339950,0migration/321027-21idleruntime-cro21:15:113
339950,0migration/320924-21kthreadcore21:30:283
339950,0migration/32041-21diskmemload22:47:023
339950,0migration/314178-21missed_timers20:00:293
339950,0migration/310931-21kthreadcore20:45:273
339950,0migration/310194-21munin-node21:40:293
329950,0watchdog/34238-21munin-node00:35:303
329950,0watchdog/328556-21sh23:00:333
329950,0watchdog/321867-21munin-node20:50:333
329950,0watchdog/321820-21grep22:40:293
329950,0watchdog/31835-21cut20:40:253
329950,0watchdog/31835-21cut20:40:253
329950,0watchdog/313753-21aten_r1power_vo21:45:293
329950,0watchdog/30-21swapper/320:25:293
329950,0watchdog/30-21swapper/300:25:263
29815050,0irq/29-eth0-tx-3876-21sh21:40:112
29815050,0irq/29-eth0-tx-28627-21sh22:45:282
29815050,0irq/29-eth0-tx-266532sleep221:35:032
29815050,0irq/29-eth0-tx-17100-21munin-node00:25:342
29815050,0irq/29-eth0-tx-0-21swapper/222:15:002
29815050,0irq/29-eth0-tx-0-21swapper/222:05:432
29805050,0irq/28-eth0-rx-9191-21ssh22:35:263
29805050,0irq/28-eth0-rx-6600-21kthreadcore23:25:313
29805050,0irq/28-eth0-rx-4105-21kthreadcore19:10:253
29805050,0irq/28-eth0-rx-3510-21latency21:00:293
29805050,0irq/28-eth0-rx-28324-21if_eth022:10:283
29805050,0irq/28-eth0-rx-19698-21kernelversion22:05:433
29805050,0irq/28-eth0-rx-19222-21awk22:55:313
29805050,0irq/28-eth0-rx-14395-21grep22:00:303
29805050,0irq/28-eth0-rx-0-21swapper/323:52:523
29805050,0irq/28-eth0-rx-0-21swapper/323:35:263
29805050,0irq/28-eth0-rx-0-21swapper/323:30:293
29805050,0irq/28-eth0-rx-0-21swapper/322:50:303
29805050,0irq/28-eth0-rx-0-21swapper/322:29:533
29805050,0irq/28-eth0-rx-0-21swapper/322:21:013
29805050,0irq/28-eth0-rx-0-21swapper/322:19:313
259950,0migration/232386-21rt-features19:50:332
259950,0migration/228462-21sh23:00:322
259950,0migration/227897-21munin-node00:30:292
259950,0migration/226583-21munin-node23:55:242
259950,0migration/225661-21kthreadcore21:50:302
259950,0migration/220559-21ksmtuned21:46:142
259950,0migration/211821-21sh23:28:272
179950,0migration/19958-21missed_timers22:50:311
179950,0migration/15588-21sh00:16:021
179950,0migration/131705-21latency_hist21:55:111
179950,0migration/127916-21kthreadcore23:00:311
179950,0migration/12332-21sh22:12:151
179950,0migration/117945-21fschecks_time00:25:241
179950,0migration/115546-21sh22:00:391
179950,0migration/114475-21timerwakeupswit00:20:391
169950,0watchdog/18328-21tr21:05:291
169950,0watchdog/127909-21kthreadcore23:35:301
169950,0watchdog/127002-21diskstats23:55:261
169950,0watchdog/122733-21kthreadcore19:45:291
169950,0watchdog/116561-21cut19:40:291
169950,0watchdog/10-21swapper/119:55:331
149950,0migration/05134-21latency23:05:300
149950,0migration/04915-21sendmail_mailtr21:20:330
149950,0migration/04817-21sh22:50:260
149950,0migration/04063-21kthreadcore22:30:300
149950,0migration/030906-21kthreadcore23:20:290
149950,0migration/024704-21kthreadcore21:15:290
149950,0migration/023385-21fschecks_time22:25:230
149950,0migration/019147-21latency_hist20:30:110
149950,0migration/017920-21kthreadcore19:20:300
149950,0migration/017833-21munin-node23:50:250
149950,0migration/015820-21sh22:36:380
149950,0migration/015023-21sh23:45:520
149950,0migration/010945-21kthreadcore23:10:290
8305040,0irq/26-0000:00:0-21swapper/320:55:123
5889943,0cyclictest5317-21awk21:40:262
5889943,0cyclictest3524-21snmpd22:30:442
5889943,0cyclictest3524-21snmpd19:15:122
5889943,0cyclictest3250-21irqbalance23:15:272
5889943,0cyclictest3250-21irqbalance22:35:472
5889943,0cyclictest3250-21irqbalance20:50:162
5889943,0cyclictest3250-21irqbalance20:45:262
5889943,0cyclictest3250-21irqbalance20:35:362
5889943,0cyclictest3250-21irqbalance20:20:462
5889943,0cyclictest3250-21irqbalance20:15:262
5889943,0cyclictest3250-21irqbalance20:05:162
5889943,0cyclictest3250-21irqbalance20:01:462
5889943,0cyclictest3250-21irqbalance19:55:562
5889943,0cyclictest3250-21irqbalance19:41:462
5889943,0cyclictest3250-21irqbalance19:35:562
5889943,0cyclictest3250-21irqbalance19:32:262
5889943,0cyclictest3250-21irqbalance19:28:362
5889943,0cyclictest3250-21irqbalance00:05:272
5889943,0cyclictest3250-21irqbalance00:00:172
5879944,0cyclictest0-21swapper/123:42:461
5879944,0cyclictest0-21swapper/122:05:391
5879943,0cyclictest9483-21awk20:00:261
5879943,0cyclictest3571-21lldpd21:46:181
5879943,0cyclictest3571-21lldpd21:22:171
5879943,0cyclictest3571-21lldpd21:00:171
5879943,0cyclictest3571-21lldpd19:10:141
5879943,0cyclictest3524-21snmpd20:49:131
5879943,0cyclictest3524-21snmpd19:31:421
5879943,0cyclictest3250-21irqbalance22:30:271
5879943,0cyclictest3250-21irqbalance00:30:371
5879943,0cyclictest27898-21awk23:20:261
5879943,0cyclictest22403-21awk21:15:271
5879943,0cyclictest18713-21awk21:30:251
5879943,0cyclictest16390-21awk19:20:281
339940,0migration/33510-21kthreadcore21:55:293
339940,0migration/311858-21kthreadcore23:45:313
329940,0watchdog/36314-21runrttasks19:17:533
329940,0watchdog/326601-21cpu20:35:293
329940,0watchdog/324015-21irqcore20:10:293
329940,0watchdog/321317-21ntpq19:20:333
329940,0watchdog/30-21swapper/323:10:293
329940,0watchdog/30-21swapper/320:15:293
329940,0watchdog/30-21swapper/320:05:293
329940,0watchdog/30-21swapper/319:45:293
329940,0watchdog/30-21swapper/319:40:293
29815040,0irq/29-eth0-tx-29105-21ssh23:36:112
29815040,0irq/29-eth0-tx-11013-21kthreadcore22:00:292
29815040,0irq/29-eth0-tx-0-21swapper/223:45:132
29815040,0irq/29-eth0-tx-0-21swapper/223:20:122
29815040,0irq/29-eth0-tx-0-21swapper/223:10:302
29815040,0irq/29-eth0-tx-0-21swapper/222:50:132
29815040,0irq/29-eth0-tx-0-21swapper/222:20:132
29815040,0irq/29-eth0-tx-0-21swapper/221:55:112
29815040,0irq/29-eth0-tx-0-21swapper/221:25:242
29815040,0irq/29-eth0-tx-0-21swapper/221:20:112
29815040,0irq/29-eth0-tx-0-21swapper/200:35:142
29815040,0irq/29-eth0-tx-0-21swapper/200:15:182
29805040,0irq/28-eth0-rx-0-21swapper/323:40:183
29805040,0irq/28-eth0-rx-0-21swapper/321:25:293
29805040,0irq/28-eth0-rx-0-21swapper/300:20:173
259940,0migration/23712-21kthreadcore20:40:292
259940,0migration/23712-21kthreadcore20:40:292
259940,0migration/227206-21kthreadcore20:10:302
259940,0migration/224896-21kthreadcore20:30:282
259940,0migration/219961-21kthreadcore19:20:312
259940,0migration/216259-21kthreadcore22:55:292
259940,0migration/213207-21gltestperf21:10:242
249940,0watchdog/23202-21kthreadcore21:00:292
249940,0watchdog/225567-21users19:45:372
249940,0watchdog/216819-21kthreadcore23:30:302
249940,0watchdog/213964-21kthreadcore20:25:292
249940,0watchdog/211521-21unixbench_singl21:05:372
249940,0watchdog/20-21swapper/219:10:252
179940,0migration/17638-21kthreadcore20:20:291
179940,0migration/131643-21kthreadcore20:15:281
179940,0migration/129571-21kthreadcore19:50:291
179940,0migration/129454-21kthreadcore22:45:281
179940,0migration/127740-21kthreadcore22:25:271
179940,0migration/127097-21kthreadcore00:10:301
179940,0migration/124791-21taskset22:41:031
179940,0migration/111376-21kthreadcore19:15:271
169940,0watchdog/16352-21grep19:35:291
169940,0watchdog/14188-21ssh21:40:211
169940,0watchdog/124793-21ssh23:16:301
169940,0watchdog/124014-21irqcore20:10:291
169940,0watchdog/123600-21perl20:55:251
169940,0watchdog/120212-21ssh22:56:211
169940,0watchdog/116377-21perl20:50:251
169940,0watchdog/112628-21ssh00:05:221
169940,0watchdog/111057-21ssh23:26:501
169940,0watchdog/10-21swapper/123:05:291
169940,0watchdog/10-21swapper/121:25:291
169940,0watchdog/10-21swapper/120:40:131
169940,0watchdog/10-21swapper/120:40:131
169940,0watchdog/10-21swapper/120:35:291
169940,0watchdog/10-21swapper/120:25:291
169940,0watchdog/10-21swapper/119:25:251
5879932,0cyclictest9356-21awk23:45:291
5879932,0cyclictest3135-21ssh00:35:181
5879932,0cyclictest28542-21awk21:35:571
5879932,0cyclictest19113-21sort20:30:111
5879932,0cyclictest18550-21sensors21:10:321
5879932,0cyclictest16606-21awk20:05:271
259930,0migration/224132-21irqcore20:55:282
169930,0watchdog/10-21swapper/122:38:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional