You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 04:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri May 22, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2698724536,0sleep20-21swapper/219:22:252
2688424332,0sleep30-21swapper/319:21:183
2703923724,0sleep10-21swapper/119:23:041
2684623524,0sleep00-21swapper/019:20:470
339960,0migration/35388-21sh23:16:233
339960,0migration/322910-21sh23:27:093
339960,0migration/32192-21sh22:53:563
339960,0migration/319042-21sh00:02:443
339960,0migration/318957-21sh21:48:413
339960,0migration/312791-21sh00:18:003
339960,0migration/311480-21sh23:00:323
339960,0migration/310744-21munin-node21:28:343
329960,0watchdog/317376-21kthreadcore00:38:373
271269965,0cyclictest12293-21ps19:38:330
27160,0ktimersoftd/20-21swapper/221:43:332
8305050,0irq/26-0000:00:6817-21python20:38:402
8305050,0irq/26-0000:00:10642-21latency_hist23:58:172
4150,0ktimersoftd/00-21swapper/022:18:420
339950,0migration/34395-21kthreadcore19:53:333
339950,0migration/329386-21kthreadcore19:23:343
339950,0migration/326130-21fschecks_count20:33:293
339950,0migration/32428-21fschecks_count22:38:313
339950,0migration/32424-21kthreadcore21:23:343
339950,0migration/323759-21kthreadcore20:08:353
339950,0migration/321352-21taskset20:03:423
339950,0migration/320242-21fschecks_time00:03:323
339950,0migration/315039-21kthreadcore22:43:363
339950,0migration/31309-21kthreadcore21:58:343
339950,0migration/310727-21timerwakeupswit21:03:413
329950,0watchdog/39493-21hwlatdetect22:23:323
329950,0watchdog/35852-21ssh00:31:253
329950,0watchdog/325788-21telnet22:33:283
329950,0watchdog/30-21swapper/322:48:523
29815050,0irq/29-eth0-tx-8374-21switchtime22:38:432
29815050,0irq/29-eth0-tx-30826-21cut22:53:342
29815050,0irq/29-eth0-tx-18311-21munin-node19:43:300
29815050,0irq/29-eth0-tx-0-21swapper/221:41:072
29805050,0irq/28-eth0-rx-6640-21cpuspeed_turbos23:18:313
29805050,0irq/28-eth0-rx-28343-21grep23:28:363
29805050,0irq/28-eth0-rx-22877-21ssh22:12:143
29805050,0irq/28-eth0-rx-22399-21cat21:53:313
29805050,0irq/28-eth0-rx-20557-21cut21:33:343
29805050,0irq/28-eth0-rx-17792-21fschecks_count23:43:313
29805050,0irq/28-eth0-rx-15200-21latency_hist00:38:173
29805050,0irq/28-eth0-rx-10378-21grep19:33:303
29805050,0irq/28-eth0-rx-0-21swapper/323:48:353
29805050,0irq/28-eth0-rx-0-21swapper/323:38:363
29805050,0irq/28-eth0-rx-0-21swapper/323:35:233
29805050,0irq/28-eth0-rx-0-21swapper/323:08:313
29805050,0irq/28-eth0-rx-0-21swapper/322:28:363
29805050,0irq/28-eth0-rx-0-21swapper/322:20:383
29805050,0irq/28-eth0-rx-0-21swapper/322:13:343
29805050,0irq/28-eth0-rx-0-21swapper/322:03:433
29805050,0irq/28-eth0-rx-0-21swapper/321:47:543
29805050,0irq/28-eth0-rx-0-21swapper/321:38:173
29805050,0irq/28-eth0-rx-0-21swapper/300:43:363
29805050,0irq/28-eth0-rx-0-21swapper/300:25:003
29805050,0irq/28-eth0-rx-0-21swapper/300:08:363
271289950,0cyclictest0-21swapper/223:09:002
271279955,0cyclictest0-21swapper/122:18:341
271279955,0cyclictest0-21swapper/122:08:381
271279950,0cyclictest0-21swapper/122:33:521
271269955,0cyclictest0-21swapper/022:37:180
271269955,0cyclictest0-21swapper/022:12:240
271269955,0cyclictest0-21swapper/021:29:210
271269955,0cyclictest0-21swapper/019:23:230
271269954,0cyclictest5633-21ps20:18:320
271269950,0cyclictest0-21swapper/023:09:280
259950,0migration/225014-21kthreadcore21:53:342
19150,0ktimersoftd/10-21swapper/121:25:551
179950,0migration/17672-21kthreadcore21:03:341
179950,0migration/14992-21fschecks_time22:58:301
179950,0migration/14715-21timerwakeupswit00:28:431
179950,0migration/132660-21kthreadcore22:53:351
179950,0migration/129253-21latency_hist20:58:171
179950,0migration/126150-21unixbench_multi00:03:441
179950,0migration/122148-21kthreadcore20:28:341
169950,0watchdog/12232-21cut19:28:281
149950,0migration/07909-21sh00:50:560
149950,0migration/07666-21kthreadcore21:03:340
149950,0migration/05160-21kthreadcore22:38:350
149950,0migration/04857-21sh22:00:190
149950,0migration/04650-21cpu00:13:290
149950,0migration/04429-21sh23:13:450
149950,0migration/027921-21aten_r1power_fr22:53:280
149950,0migration/025527-21missed_timers00:03:380
149950,0migration/025287-21if_eth1.300:43:350
149950,0migration/025019-21kthreadcore20:08:350
149950,0migration/024929-21kthreadcore22:48:370
149950,0migration/020361-21sh00:20:000
149950,0migration/017965-21timerwakeupswit21:08:420
149950,0migration/012950-21kthreadcore23:38:360
149950,0migration/011621-21kthreadcore00:33:360
149950,0migration/010563-21kthreadcore23:18:360
149950,0migration/010454-21sh23:57:470
8305040,0irq/26-0000:00:16954-21kthreadcore00:18:362
8305040,0irq/26-0000:00:0-21swapper/222:13:172
339940,0migration/33784-21taskset21:00:023
339940,0migration/328634-21kthreadcore19:48:333
339940,0migration/319901-21kthreadcore20:48:333
339940,0migration/313261-21kthreadcore21:08:343
329940,0watchdog/322410-21cpu20:53:283
329940,0watchdog/30-21swapper/319:43:003
329940,0watchdog/30-21swapper/319:28:283
29815040,0irq/29-eth0-tx-6326-21ssh23:18:232
29815040,0irq/29-eth0-tx-5129-21ssh00:29:262
29815040,0irq/29-eth0-tx-30053-21aten2.4-expect21:58:282
29815040,0irq/29-eth0-tx-21798-21ssh00:23:212
29815040,0irq/29-eth0-tx-2011-21ssh21:23:330
29815040,0irq/29-eth0-tx-13205-21ssh22:04:202
29815040,0irq/29-eth0-tx-12053-21ssh00:15:562
29815040,0irq/29-eth0-tx-0-21swapper/223:48:302
29815040,0irq/29-eth0-tx-0-21swapper/223:38:362
29815040,0irq/29-eth0-tx-0-21swapper/223:28:342
29815040,0irq/29-eth0-tx-0-21swapper/223:03:312
29815040,0irq/29-eth0-tx-0-21swapper/222:48:192
29815040,0irq/29-eth0-tx-0-21swapper/222:33:252
29815040,0irq/29-eth0-tx-0-21swapper/222:28:182
29815040,0irq/29-eth0-tx-0-21swapper/222:08:302
29815040,0irq/29-eth0-tx-0-21swapper/221:48:312
29815040,0irq/29-eth0-tx-0-21swapper/221:33:342
29815040,0irq/29-eth0-tx-0-21swapper/200:48:242
29815040,0irq/29-eth0-tx-0-21swapper/200:33:582
29815040,0irq/29-eth0-tx-0-21swapper/200:08:222
29815040,0irq/29-eth0-tx-0-21swapper/200:03:222
29815040,0irq/29-eth0-tx-0-21swapper/020:58:330
29815040,0irq/29-eth0-tx-0-21swapper/020:13:410
29805040,0irq/28-eth0-rx-0-21swapper/323:53:173
29805040,0irq/28-eth0-rx-0-21swapper/323:04:093
29805040,0irq/28-eth0-rx-0-21swapper/300:48:293
29805040,0irq/28-eth0-rx-0-21swapper/300:18:343
271289944,0cyclictest0-21swapper/223:43:322
271289944,0cyclictest0-21swapper/220:43:382
271289943,0cyclictest5416-21awk21:03:322
271289943,0cyclictest3571-21lldpd23:13:342
271289943,0cyclictest3571-21lldpd21:15:322
271289943,0cyclictest3571-21lldpd19:34:292
271289943,0cyclictest3524-21snmpd20:23:232
271289943,0cyclictest3524-21snmpd19:48:382
271289943,0cyclictest3524-21snmpd19:47:382
271289943,0cyclictest3250-21irqbalance23:23:542
271289943,0cyclictest3250-21irqbalance22:59:342
271289943,0cyclictest30204-21awk20:13:312
271289943,0cyclictest27066-21awk21:18:332
271289943,0cyclictest25216-21awk00:43:342
271289943,0cyclictest12140-21awk19:38:322
271289943,0cyclictest12102-21awk23:58:332
271289943,0cyclictest10833-21awk21:28:342
271279943,0cyclictest4070-21sadc21:03:171
271279943,0cyclictest3571-21lldpd23:40:041
271279943,0cyclictest3571-21lldpd21:16:321
271279943,0cyclictest3571-21lldpd20:45:581
271279943,0cyclictest3571-21lldpd20:38:591
271279943,0cyclictest3571-21lldpd00:47:351
271279943,0cyclictest3524-21snmpd00:33:261
271279943,0cyclictest28420-21awk21:38:321
271279943,0cyclictest26946-21awk23:48:321
271279943,0cyclictest23167-21grep22:28:381
271279943,0cyclictest22899-21awk00:23:331
271279943,0cyclictest22571-21awk23:08:341
271279943,0cyclictest19378-21awk19:43:321
271279943,0cyclictest14272-21awk00:18:321
271279940,0cyclictest0-21swapper/121:21:291
271269944,0cyclictest28185-21kworker/0:221:33:300
271269943,0cyclictest9602-21awk22:23:330
271269943,0cyclictest5096-21awk21:43:330
271269943,0cyclictest3571-21lldpd23:01:040
271269943,0cyclictest3571-21lldpd19:56:590
271269943,0cyclictest3524-21snmpd20:35:230
271269943,0cyclictest3524-21snmpd19:53:080
271269943,0cyclictest3250-21irqbalance23:03:440
271269943,0cyclictest3250-21irqbalance20:53:230
271269943,0cyclictest3250-21irqbalance20:48:230
271269943,0cyclictest3250-21irqbalance00:11:540
271269943,0cyclictest3230-21awk19:28:310
271269943,0cyclictest31609-21awk00:28:330
271269943,0cyclictest28459-21awk21:38:330
271269943,0cyclictest23274-21strings23:43:370
271269943,0cyclictest22971-21awk00:23:330
271269943,0cyclictest16509-21awk00:38:340
271269943,0cyclictest16048-21awk23:23:310
271269943,0cyclictest15916-21awk20:03:300
271269943,0cyclictest1542-21awk20:38:320
271269943,0cyclictest11667-21awk22:43:330
271269940,0cyclictest9465-21munin-node19:33:290
259940,0migration/2456-21fschecks_count23:33:312
259940,0migration/230976-21kthreadcore19:23:352
259940,0migration/222101-21aten_r1power_po20:08:292
259940,0migration/218096-21kthreadcore00:38:372
259940,0migration/21677-21fschecks_time21:23:312
249940,0watchdog/24469-21df_inode20:18:282
249940,0watchdog/2298150irq/29-eth0-tx-22:21:282
249940,0watchdog/217772-21python21:08:402
249940,0watchdog/215723-21chrt22:25:202
249940,0watchdog/210549-21ssh22:43:242
19140,0ktimersoftd/10-21swapper/100:17:061
179940,0migration/19677-21kthreadcore20:18:331
179940,0migration/18337-21fschecks_time19:58:301
179940,0migration/18195-21taskset00:51:451
179940,0migration/17343-21taskset19:58:161
179940,0migration/17092-21fschecks_time23:18:321
179940,0migration/15420-21kthreadcore23:53:351
179940,0migration/130034-21aten_r1power_po21:58:281
179940,0migration/128090-21fschecks_time19:23:311
179940,0migration/127180-21kthreadcore23:28:361
179940,0migration/126926-21irqrtprio19:48:331
179940,0migration/125621-21kthreadcore22:13:341
179940,0migration/12131-21switchtime00:08:431
179940,0migration/121074-21pmu-power20:48:361
179940,0migration/121005-21kthreadcore21:33:351
179940,0migration/119974-21sh21:50:271
179940,0migration/118442-21taskset22:46:551
179940,0migration/118166-21taskset20:27:101
179940,0migration/117352-21aten2.4-expect23:43:291
179940,0migration/116361-21kthreadcore21:08:351
179940,0migration/116168-21kthreadcore23:03:351
179940,0migration/114969-21munin-node22:23:441
179940,0migration/11184-21irqcore23:33:341
179940,0migration/111670-21kthreadcore21:28:361
169940,0watchdog/19877-21missed_timers21:43:361
169940,0watchdog/17824-21cat22:38:361
169940,0watchdog/127098-21kthreadcore20:08:361
169940,0watchdog/126277-21ssh22:49:441
169940,0watchdog/122455-21if_eth1.321:53:321
169940,0watchdog/117377-21kthreadcore00:38:371
169940,0watchdog/115244-21cpuspeed_turbos23:23:281
149940,0migration/030867-21kthreadcore21:18:350
149940,0migration/030008-21python23:28:420
149940,0migration/027003-21kthreadcore22:13:340
149940,0migration/026710-21fschecks_time23:48:310
149940,0migration/025123-21kthreadcore21:53:340
149940,0migration/020245-21kthreadcore22:28:350
149940,0migration/014182-21timerwakeupswit20:43:420
149940,0migration/013225-21runrttasks22:04:230
329930,0watchdog/30-21swapper/321:18:323
329930,0watchdog/30-21swapper/320:43:403
329930,0watchdog/30-21swapper/320:26:363
329930,0watchdog/30-21swapper/320:13:443
329930,0watchdog/30-21swapper/319:43:283
29805030,0irq/28-eth0-rx-0-21swapper/321:17:463
29805030,0irq/28-eth0-rx-0-21swapper/320:38:283
29805030,0irq/28-eth0-rx-0-21swapper/320:28:283
29805030,0irq/28-eth0-rx-0-21swapper/320:18:593
29805030,0irq/28-eth0-rx-0-21swapper/319:58:353
271289932,0cyclictest3571-21lldpd19:58:292
271289932,0cyclictest3524-21snmpd19:53:232
271289932,0cyclictest16087-21if_err_eth1.320:48:312
271289930,0cyclictest29887-21grep20:33:332
271289930,0cyclictest22971-21perl20:53:292
271289930,0cyclictest18834-21df20:28:292
271289930,0cyclictest15581-21perl20:03:282
271289930,0cyclictest0-21swapper/220:58:182
271279932,0cyclictest3571-21lldpd19:35:581
271279932,0cyclictest27125-21cyclictest22:03:311
271279932,0cyclictest26861-21awk20:33:311
271279932,0cyclictest11637-21grep23:58:311
271269932,0cyclictest8669-21awk19:58:320
271269932,0cyclictest3524-21snmpd20:33:130
271269932,0cyclictest18759-21munin-node21:13:400
271269932,0cyclictest12370-21awk20:23:310
271269932,0cyclictest11994-21awk23:58:320
249930,0watchdog/20-21swapper/219:28:282
179930,0migration/130219-21if_err_eth120:13:311
169930,0watchdog/10-21swapper/123:15:401
169930,0watchdog/10-21swapper/120:03:361
169930,0watchdog/10-21swapper/119:38:241
149930,0migration/014746-21kthreadcore21:48:360
271269920,0cyclictest32158-21latency_hist23:33:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional