You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 09:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Dec 16, 2025 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
91624132,0sleep30-21swapper/319:09:233
66123927,0sleep20-21swapper/219:06:542
67223228,0sleep10-21swapper/119:07:011
70523127,0sleep00-21swapper/019:07:240
1067991313,0cyclictest0-21swapper/021:10:320
35170,0ktimersoftd/331681-21ssh22:30:033
8305060,0irq/26-0000:00:8798-21idleruntime-cro20:45:162
8305060,0irq/26-0000:00:19689-21munin-node20:30:392
339960,0migration/36207-21sh21:21:083
339960,0migration/329825-21sh21:17:373
339960,0migration/32573-21sh21:36:323
339960,0migration/320460-21sh23:32:383
339960,0migration/316276-21sh21:27:133
339960,0migration/315959-21sh23:12:143
329960,0watchdog/35194-21ssh00:15:513
29815060,0irq/29-eth0-tx-0-21swapper/020:05:220
29805060,0irq/28-eth0-rx-10976-21ssh00:02:483
259960,0migration/216048-21sh00:24:202
149960,0migration/08825-21kthreadcore00:00:370
149960,0migration/06052-21sh00:17:400
149960,0migration/05100-21irqrtprio23:25:340
149960,0migration/02292-21sh21:36:020
10679966,0cyclictest0-21swapper/021:00:340
8305050,0irq/26-0000:00:5258-21ssh23:40:422
4150,0ktimersoftd/00-21swapper/023:45:280
339950,0migration/37008-21kthreadcore21:40:343
339950,0migration/35923-21sshd23:41:243
339950,0migration/35642-21munin-node22:15:323
339950,0migration/332530-21munin-node22:30:303
339950,0migration/331376-21kthreadcore20:35:353
339950,0migration/330007-21sh23:38:233
339950,0migration/325850-21taskset22:06:473
339950,0migration/317782-21aten_r1power_fr23:15:303
339950,0migration/315270-21munin-node22:35:393
339950,0migration/31259-21taskset19:55:143
339950,0migration/310039-21munin-node23:25:393
329950,0watchdog/39648-21kthreadcore20:20:343
329950,0watchdog/38230-21kthreadcore00:35:353
329950,0watchdog/37395-21wc19:55:343
329950,0watchdog/331756-21kthreadcore22:45:353
329950,0watchdog/327110-21cut21:50:343
329950,0watchdog/325721-21ssh21:32:023
329950,0watchdog/323795-21cut20:30:343
329950,0watchdog/32041-21cut21:00:343
329950,0watchdog/313239-21cut00:05:313
329950,0watchdog/311554-21grep19:15:343
329950,0watchdog/311357-21python19:35:383
329950,0watchdog/30-21swapper/322:40:353
29815050,0irq/29-eth0-tx-7329-21tr00:00:372
29815050,0irq/29-eth0-tx-6613-21python21:55:402
29815050,0irq/29-eth0-tx-31217-21ssh21:20:102
29815050,0irq/29-eth0-tx-27769-21munin-node21:35:352
29815050,0irq/29-eth0-tx-26594-21ssh21:33:392
29815050,0irq/29-eth0-tx-23678-21munin-node23:00:322
29815050,0irq/29-eth0-tx-19537-21munin-node19:45:320
29815050,0irq/29-eth0-tx-13623-21perl23:30:302
29815050,0irq/29-eth0-tx-13426-21ssh22:20:032
29815050,0irq/29-eth0-tx-11664-21latency_hist00:40:172
29815050,0irq/29-eth0-tx-0-21swapper/223:54:192
29815050,0irq/29-eth0-tx-0-21swapper/223:20:452
29815050,0irq/29-eth0-tx-0-21swapper/222:30:362
29815050,0irq/29-eth0-tx-0-21swapper/222:05:512
29815050,0irq/29-eth0-tx-0-21swapper/200:14:492
29815050,0irq/29-eth0-tx-0-21swapper/200:09:082
29815050,0irq/29-eth0-tx-0-21swapper/020:20:350
29815050,0irq/29-eth0-tx-0-21swapper/019:25:290
29815050,0irq/29-eth0-tx-0-21swapper/019:20:080
29805050,0irq/28-eth0-rx-9577-21cut23:45:343
29805050,0irq/28-eth0-rx-7399-21kthreadcore22:50:333
29805050,0irq/28-eth0-rx-4818-21chrt19:34:563
29805050,0irq/28-eth0-rx-25116-21kthreadcore00:10:353
29805050,0irq/28-eth0-rx-20889-21cut00:25:353
29805050,0irq/28-eth0-rx-14472-21fschecks_count22:20:293
29805050,0irq/28-eth0-rx-0-21swapper/323:55:393
29805050,0irq/28-eth0-rx-0-21swapper/323:20:333
29805050,0irq/28-eth0-rx-0-21swapper/323:05:523
29805050,0irq/28-eth0-rx-0-21swapper/322:56:473
29805050,0irq/28-eth0-rx-0-21swapper/321:57:293
29805050,0irq/28-eth0-rx-0-21swapper/321:45:333
29805050,0irq/28-eth0-rx-0-21swapper/300:30:593
29805050,0irq/28-eth0-rx-0-21swapper/300:20:313
27150,0ktimersoftd/20-21swapper/223:46:512
259950,0migration/29444-21gltestperf23:10:302
259950,0migration/24169-21sh22:15:002
259950,0migration/230837-21aten_r1power_fr00:15:292
259950,0migration/224220-21kthreadcore23:35:352
259950,0migration/22214-21kthreadcore19:30:342
259950,0migration/218723-21idleruntime23:15:342
259950,0migration/218155-21kthreadcore19:20:302
259950,0migration/210933-21sh23:26:492
249950,0watchdog/24763-21sshd20:17:022
249950,0watchdog/229799-21expr20:55:422
249950,0watchdog/226900-21kthreadcore19:25:342
179950,0migration/19037-21proc_pri00:35:381
179950,0migration/15333-21kthreadcore00:00:361
179950,0migration/15251-21kernelversion23:25:341
179950,0migration/127300-21kthreadcore23:00:341
179950,0migration/122499-21switchtime20:50:401
179950,0migration/117228-21munin-node00:25:301
179950,0migration/114808-21kthreadcore20:25:341
179950,0migration/113966-21aten_r1power_po22:20:281
179950,0migration/111726-21sh22:16:231
169950,0watchdog/12889-21kthreadcore19:10:341
149950,0migration/06467-21sh21:21:350
149950,0migration/05283-21if_eth1.222:50:310
149950,0migration/04899-21taskset20:18:340
149950,0migration/030138-21taskset23:38:390
149950,0migration/02964-21kthreadcore19:10:340
149950,0migration/029376-21kthreadcore22:45:340
149950,0migration/028389-21kthreadcore23:55:340
149950,0migration/028340-21kthreadcore22:25:340
149950,0migration/027168-21irqcore00:30:310
149950,0migration/027137-21cpuspeed_turbos20:35:290
149950,0migration/026821-21kthreadcore23:00:340
149950,0migration/024117-21sh23:51:020
149950,0migration/023476-21kthreadcore20:30:340
149950,0migration/022239-21aten_r1power_vo21:15:300
149950,0migration/020466-21kthreadcore00:25:350
149950,0migration/017810-21kthreadcore21:45:340
149950,0migration/017289-21sh21:29:070
149950,0migration/016761-21sh23:13:570
149950,0migration/014662-21kthreadcore00:05:340
149950,0migration/013352-21fschecks_count23:30:300
149950,0migration/012953-21kthreadcore00:20:360
149950,0migration/011734-21kthreadcore22:35:340
149950,0migration/010886-21kthreadcore20:45:330
10699950,0cyclictest0-21swapper/223:59:282
10699950,0cyclictest0-21swapper/222:41:442
10699950,0cyclictest0-21swapper/221:40:442
10689955,0cyclictest0-21swapper/120:40:381
10689954,0cyclictest17104-21awk20:05:321
10689950,0cyclictest0-21swapper/121:55:411
10679955,0cyclictest0-21swapper/021:51:380
10679950,0cyclictest0-21swapper/023:06:410
10679950,0cyclictest0-21swapper/022:09:560
339940,0migration/323453-21cpu20:10:293
339940,0migration/316647-21kthreadcore19:40:333
329940,0watchdog/36169-21cut20:40:343
329940,0watchdog/314302-21kthreadcore20:25:343
329940,0watchdog/311774-21smartctl21:05:383
329940,0watchdog/30-21swapper/320:55:423
329940,0watchdog/30-21swapper/320:00:343
329940,0watchdog/30-21swapper/319:25:303
329940,0watchdog/30-21swapper/319:20:343
329940,0watchdog/30-21swapper/319:10:343
29815040,0irq/29-eth0-tx-14257-21munin-node21:45:312
29815040,0irq/29-eth0-tx-13783-21ssh22:20:202
29815040,0irq/29-eth0-tx-0-21swapper/223:05:452
29815040,0irq/29-eth0-tx-0-21swapper/222:55:252
29815040,0irq/29-eth0-tx-0-21swapper/222:45:372
29815040,0irq/29-eth0-tx-0-21swapper/222:35:262
29815040,0irq/29-eth0-tx-0-21swapper/222:00:182
29815040,0irq/29-eth0-tx-0-21swapper/222:00:182
29815040,0irq/29-eth0-tx-0-21swapper/221:50:182
29815040,0irq/29-eth0-tx-0-21swapper/221:25:272
29805040,0irq/28-eth0-rx-2592-21runrttasks22:11:413
29805040,0irq/28-eth0-rx-20300-21kthreadcore20:50:333
29805040,0irq/28-eth0-rx-0-21swapper/323:50:263
29805040,0irq/28-eth0-rx-0-21swapper/323:00:313
29805040,0irq/28-eth0-rx-0-21swapper/322:00:283
29805040,0irq/28-eth0-rx-0-21swapper/322:00:283
29805040,0irq/28-eth0-rx-0-21swapper/321:10:353
259940,0migration/29654-21fschecks_time20:45:292
259940,0migration/227297-21irqcore00:30:312
259940,0migration/223475-21fschecks_count22:25:292
259940,0migration/214974-21timerwakeupswit19:15:492
259940,0migration/212600-21cpuspeed_turbos19:40:282
249940,0watchdog/231498-21fschecks_time21:00:302
249940,0watchdog/219298-21cat20:05:342
249940,0watchdog/217719-21gltestperf00:25:312
249940,0watchdog/20-21swapper/220:10:342
249940,0watchdog/20-21swapper/219:50:302
179940,0migration/132176-21irqrtprio00:15:341
179940,0migration/130730-21taskset23:39:561
179940,0migration/128406-21fschecks_count21:35:291
179940,0migration/128047-21fschecks_time22:45:301
179940,0migration/123423-21aten_r1power_cu21:50:281
179940,0migration/116947-21kthreadcore21:45:341
179940,0migration/112348-21kthreadcore00:20:361
179940,0migration/111839-21taskset19:37:151
179940,0migration/110811-21kthreadcore21:25:341
179940,0migration/110586-21kthreadcore22:35:341
169940,0watchdog/1624-21cat23:40:351
169940,0watchdog/131497-21fschecks_time21:00:301
169940,0watchdog/128715-21kthreadcore20:55:341
169940,0watchdog/126884-21cpu19:50:301
169940,0watchdog/125475-21cat20:10:341
169940,0watchdog/121874-21proc_pri19:20:341
169940,0watchdog/112528-21diskmemload23:23:431
169940,0watchdog/10-21swapper/123:50:351
169940,0watchdog/10-21swapper/122:05:341
149940,0migration/026165-21runrttasks22:43:300
10699944,0cyclictest0-21swapper/222:50:252
10699944,0cyclictest0-21swapper/220:00:272
10699943,0cyclictest3524-21snmpd21:20:282
10699943,0cyclictest2674-21awk19:55:312
10699943,0cyclictest26480-21sadc19:50:162
10699943,0cyclictest13951-21awk21:10:332
10689943,0cyclictest9669-21awk19:15:321
10689943,0cyclictest3571-21lldpd23:13:091
10689943,0cyclictest3524-21snmpd23:46:011
10689943,0cyclictest3524-21snmpd23:16:301
10689943,0cyclictest3524-21snmpd22:57:451
10689943,0cyclictest3524-21snmpd22:41:451
10689943,0cyclictest32705-21awk23:05:331
10689943,0cyclictest3250-21irqbalance23:30:221
10689943,0cyclictest3250-21irqbalance22:30:221
10689943,0cyclictest3250-21irqbalance22:28:321
10689943,0cyclictest3250-21irqbalance22:01:221
10689943,0cyclictest3250-21irqbalance22:01:221
10689943,0cyclictest3250-21irqbalance21:40:221
10689943,0cyclictest3250-21irqbalance21:30:221
10689943,0cyclictest3250-21irqbalance21:20:521
10689943,0cyclictest3250-21irqbalance21:15:221
10689943,0cyclictest3250-21irqbalance21:10:221
10689943,0cyclictest3250-21irqbalance21:06:221
10689943,0cyclictest3250-21irqbalance20:45:521
10689943,0cyclictest3250-21irqbalance20:36:521
10689943,0cyclictest3250-21irqbalance20:30:421
10689943,0cyclictest3250-21irqbalance20:21:021
10689943,0cyclictest3250-21irqbalance20:15:521
10689943,0cyclictest3250-21irqbalance20:02:111
10689943,0cyclictest27583-21awk23:55:331
10689943,0cyclictest22620-21awk00:10:321
10679944,0cyclictest0-21swapper/022:57:230
10679944,0cyclictest0-21swapper/022:19:140
10679943,0cyclictest825-21awk22:30:330
10679943,0cyclictest6597-21awk21:05:310
10679943,0cyclictest6212-21mdstat21:55:360
10679943,0cyclictest6178-21awk19:35:310
10679943,0cyclictest6154-21awk21:40:330
10679943,0cyclictest3855-21awk00:35:320
10679943,0cyclictest3571-21lldpd22:22:390
10679943,0cyclictest3571-21lldpd20:58:370
10679943,0cyclictest3524-21snmpd21:34:430
10679943,0cyclictest3250-21irqbalance23:40:220
10679943,0cyclictest3250-21irqbalance23:20:320
10679943,0cyclictest3250-21irqbalance22:00:320
10679943,0cyclictest3250-21irqbalance22:00:320
10679943,0cyclictest3250-21irqbalance19:57:010
10679943,0cyclictest31222-21awk19:30:310
10679943,0cyclictest13548-21awk20:25:320
10679943,0cyclictest1241-21kworker/0:223:15:390
10679943,0cyclictest10017-21tr20:00:320
339930,0migration/315583-21runrttasks20:45:443
329930,0watchdog/30-21swapper/320:16:263
29815030,0irq/29-eth0-tx-0-21swapper/019:50:290
29805030,0irq/28-eth0-rx-0-21swapper/320:05:183
249930,0watchdog/20-21swapper/220:35:342
249930,0watchdog/20-21swapper/220:25:342
249930,0watchdog/20-21swapper/220:20:342
249930,0watchdog/20-21swapper/219:10:342
19130,0ktimersoftd/10-21swapper/119:56:481
169930,0watchdog/10-21swapper/119:40:301
169930,0watchdog/10-21swapper/119:30:181
169930,0watchdog/10-21swapper/119:25:301
169930,0watchdog/10-21swapper/100:05:311
10699932,0cyclictest9094-21cut21:05:342
10699932,0cyclictest3524-21snmpd19:35:272
10689932,0cyclictest5310-21awk22:50:321
10689932,0cyclictest32244-21sensors00:30:371
10689932,0cyclictest28993-21awk22:10:341
10689932,0cyclictest19757-21cpuspeed_turbos19:45:271
10679933,0cyclictest8550-21kworker/0:120:40:160
10679933,0cyclictest8550-21kworker/0:120:10:260
10679932,0cyclictest9067-21kworker/0:100:10:210
10679932,0cyclictest32440-21kthreadcore22:10:360
10679932,0cyclictest21994-21sensors19:20:350
10679932,0cyclictest16693-21tune2fs20:50:290
10679932,0cyclictest14130-21cut19:40:320
329920,0watchdog/30-21swapper/319:45:183
10699920,0cyclictest0-21swapper/220:50:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional