You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 09:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue Apr 28, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1773023728,0sleep30-21swapper/319:20:253
1745223425,0sleep10-21swapper/119:17:111
1756123324,0sleep20-21swapper/219:18:282
1754423228,0sleep00-21swapper/019:18:140
35160,0ktimersoftd/30-21swapper/321:50:493
339960,0migration/39919-21cpuspeed_turbos00:16:323
339960,0migration/39272-21sh23:16:443
339960,0migration/38140-21sh00:12:583
339960,0migration/34702-21fschecks_time19:56:323
339960,0migration/3432-21munin-node23:11:413
339960,0migration/326977-21sh23:27:013
339960,0migration/32482-21aten_r1power_en22:01:313
339960,0migration/324633-21sh00:21:443
339960,0migration/317634-21munin-node21:51:303
339960,0migration/314840-21sh22:44:543
339960,0migration/31285-21sh21:58:583
29815060,0irq/29-eth0-tx-3857-21munin-node19:56:400
29805060,0irq/28-eth0-rx-387-21diskstats21:41:323
29805060,0irq/28-eth0-rx-20608-21kthreadcore00:01:363
29805060,0irq/28-eth0-rx-12121-21uname21:26:423
29805060,0irq/28-eth0-rx-0-21swapper/323:21:323
29805060,0irq/28-eth0-rx-0-21swapper/323:10:333
339950,0migration/35750-21kthreadcore20:41:353
339950,0migration/35750-21diskmemload23:52:463
339950,0migration/32864-21open_files00:46:403
339950,0migration/326791-21kthreadcore00:06:353
339950,0migration/326007-21fschecks_time19:26:343
339950,0migration/323965-21munin-node21:36:303
339950,0migration/323628-21kthreadcore00:41:373
339950,0migration/323033-21kthreadcore22:11:373
339950,0migration/318025-21kthreadcore21:11:333
339950,0migration/315369-21fschecks_count20:26:333
339950,0migration/313476-21aten_r1power_en22:26:303
339950,0migration/310172-21kthreadcore20:21:363
329950,0watchdog/34955-21ssh22:21:293
329950,0watchdog/33347-21ssh23:32:143
329950,0watchdog/330078-21grep20:56:373
329950,0watchdog/326874-21sh00:26:223
329950,0watchdog/30-21swapper/323:01:383
329950,0watchdog/30-21swapper/322:31:293
329950,0watchdog/30-21swapper/321:21:373
29815050,0irq/29-eth0-tx-13728-21munin-node23:41:352
29815050,0irq/29-eth0-tx-0-21swapper/020:51:300
29815050,0irq/29-eth0-tx-0-21swapper/019:41:300
29805050,0irq/28-eth0-rx-3756-21kthreadcore22:36:363
29805050,0irq/28-eth0-rx-28495-21python21:16:433
29805050,0irq/28-eth0-rx-14963-21irqcore23:41:333
29805050,0irq/28-eth0-rx-0-21swapper/323:56:323
29805050,0irq/28-eth0-rx-0-21swapper/323:40:133
29805050,0irq/28-eth0-rx-0-21swapper/322:56:393
29805050,0irq/28-eth0-rx-0-21swapper/322:51:573
29805050,0irq/28-eth0-rx-0-21swapper/322:06:363
29805050,0irq/28-eth0-rx-0-21swapper/321:31:363
29805050,0irq/28-eth0-rx-0-21swapper/320:06:313
29805050,0irq/28-eth0-rx-0-21swapper/300:37:213
29805050,0irq/28-eth0-rx-0-21swapper/300:36:143
249950,0watchdog/218715-21grep22:46:342
19150,0ktimersoftd/10-21swapper/121:39:411
178779955,0cyclictest28477-21sensors21:16:412
178779950,0cyclictest0-21swapper/223:03:252
178779950,0cyclictest0-21swapper/222:57:262
178779950,0cyclictest0-21swapper/220:25:462
178769955,0cyclictest0-21swapper/123:04:021
178769955,0cyclictest0-21swapper/121:22:011
178769955,0cyclictest0-21swapper/120:31:441
178769950,0cyclictest0-21swapper/121:47:151
178769950,0cyclictest0-21swapper/121:28:291
178769950,0cyclictest0-21swapper/100:39:061
178759954,0cyclictest11277-21idleruntime-cro23:21:190
179950,0migration/18805-21irqcore19:36:341
179950,0migration/132013-21kthreadcore23:31:371
179950,0migration/13077-21kthreadcore22:56:391
179950,0migration/128240-21kthreadcore22:51:371
179950,0migration/124668-21kthreadcore23:26:381
179950,0migration/12276-21kthreadcore22:36:351
179950,0migration/12249-21taskset23:15:341
179950,0migration/118968-21fschecks_count20:51:331
179950,0migration/116186-21kthreadcore23:21:371
179950,0migration/113253-21latency23:56:391
179950,0migration/112130-21kthreadcore00:16:371
179950,0migration/110928-21kthreadcore23:36:381
149950,0migration/0931-21aten_r1power_en00:11:310
149950,0migration/05560-21kthreadcore00:31:370
149950,0migration/05485-21kthreadcore22:56:400
149950,0migration/04478-21dump-pmu-power22:21:140
149950,0migration/04038-21kthreadcore19:31:350
149950,0migration/032350-21latency_hist21:41:180
149950,0migration/028655-21sh00:45:510
149950,0migration/028233-21kthreadcore00:06:350
149950,0migration/026987-21kthreadcore22:51:360
149950,0migration/025902-21cpu20:56:310
149950,0migration/023850-21sh22:50:570
149950,0migration/023803-21kthreadcore23:06:370
149950,0migration/023256-21idleruntime21:16:330
149950,0migration/022295-21kthreadcore23:26:370
149950,0migration/022254-21cpuspeed_turbos22:31:310
149950,0migration/021250-21smart_sdb21:11:390
149950,0migration/020320-21kthreadcore19:21:350
149950,0migration/018667-21munin-node00:21:320
149950,0migration/016244-21kthreadcore20:46:360
149950,0migration/01461-21gltestperf21:01:310
149950,0migration/012157-21kthreadcore20:21:370
149950,0migration/01085-21kthreadcore00:46:370
149950,0migration/010006-21kthreadcore22:21:360
339940,0migration/36098-21kthreadcore21:01:353
339940,0migration/323399-21sh23:46:343
329940,0watchdog/314488-21sleep21:07:453
329940,0watchdog/30-21swapper/320:51:373
329940,0watchdog/30-21swapper/320:49:453
329940,0watchdog/30-21swapper/320:16:373
29815040,0irq/29-eth0-tx-4658-21ssh22:36:412
29815040,0irq/29-eth0-tx-32758-21telnet20:16:300
29815040,0irq/29-eth0-tx-3180-21munin-node00:31:352
29815040,0irq/29-eth0-tx-29259-21diskmemload00:37:072
29815040,0irq/29-eth0-tx-27399-21ssh23:28:122
29815040,0irq/29-eth0-tx-26359-21cpu21:56:322
29815040,0irq/29-eth0-tx-2424-21munin-node22:01:312
29815040,0irq/29-eth0-tx-20527-21munin-node00:41:322
29815040,0irq/29-eth0-tx-14477-21kthreadcore00:16:382
29815040,0irq/29-eth0-tx-1106-21ssh23:12:222
29815040,0irq/29-eth0-tx-0-21swapper/223:51:232
29815040,0irq/29-eth0-tx-0-21swapper/223:46:232
29815040,0irq/29-eth0-tx-0-21swapper/223:21:442
29815040,0irq/29-eth0-tx-0-21swapper/223:16:392
29815040,0irq/29-eth0-tx-0-21swapper/223:06:252
29815040,0irq/29-eth0-tx-0-21swapper/222:51:202
29815040,0irq/29-eth0-tx-0-21swapper/222:41:282
29815040,0irq/29-eth0-tx-0-21swapper/222:22:302
29815040,0irq/29-eth0-tx-0-21swapper/221:51:212
29815040,0irq/29-eth0-tx-0-21swapper/221:46:202
29815040,0irq/29-eth0-tx-0-21swapper/221:36:272
29815040,0irq/29-eth0-tx-0-21swapper/221:32:002
29815040,0irq/29-eth0-tx-0-21swapper/221:27:202
29815040,0irq/29-eth0-tx-0-21swapper/200:47:002
29815040,0irq/29-eth0-tx-0-21swapper/200:21:302
29815040,0irq/29-eth0-tx-0-21swapper/020:31:390
29815040,0irq/29-eth0-tx-0-21swapper/020:26:310
29815040,0irq/29-eth0-tx-0-21swapper/020:04:440
29815040,0irq/29-eth0-tx-0-21swapper/019:46:350
29815040,0irq/29-eth0-tx-0-21swapper/019:36:310
29805040,0irq/28-eth0-rx-358-21kthreadcore19:51:373
29805040,0irq/28-eth0-rx-0-21swapper/322:46:273
29805040,0irq/28-eth0-rx-0-21swapper/322:16:283
29805040,0irq/28-eth0-rx-0-21swapper/320:31:353
29805040,0irq/28-eth0-rx-0-21swapper/320:02:033
29805040,0irq/28-eth0-rx-0-21swapper/319:31:353
29805040,0irq/28-eth0-rx-0-21swapper/319:21:353
259940,0migration/27177-21runrttasks21:01:492
259940,0migration/25620-21kthreadcore19:56:362
259940,0migration/25174-21kthreadcore19:31:352
259940,0migration/22702-21kthreadcore21:41:362
259940,0migration/224816-21runrttasks19:23:382
259940,0migration/222869-21kthreadcore22:11:372
259940,0migration/221939-21kthreadcore20:06:362
259940,0migration/216893-21kthreadcore19:41:352
249940,0watchdog/229579-21if_err_eth1.322:16:332
249940,0watchdog/227350-21df_inode00:26:342
249940,0watchdog/22561-21kthreadcore20:36:372
249940,0watchdog/215995-21kthreadcore22:06:372
249940,0watchdog/215393-21fschecks_count20:26:332
249940,0watchdog/210005-21cut23:36:382
249940,0watchdog/20-21swapper/223:31:262
249940,0watchdog/20-21swapper/222:31:292
249940,0watchdog/20-21swapper/222:26:372
249940,0watchdog/20-21swapper/220:51:372
178779944,0cyclictest0-21swapper/200:06:292
178779943,0cyclictest3571-21lldpd20:18:142
178779943,0cyclictest3524-21snmpd20:57:562
178779943,0cyclictest3524-21snmpd20:46:262
178779943,0cyclictest3524-21snmpd20:45:262
178779943,0cyclictest3524-21snmpd20:01:562
178779943,0cyclictest3524-21snmpd19:53:562
178779943,0cyclictest3524-21snmpd19:47:552
178779943,0cyclictest3250-21irqbalance23:57:452
178779943,0cyclictest3250-21irqbalance00:01:252
178779943,0cyclictest30588-21awk21:21:342
178779943,0cyclictest23069-21awk20:31:332
178779943,0cyclictest1963-21awk00:11:352
178769944,0cyclictest0-21swapper/100:26:481
178769944,0cyclictest0-21swapper/100:01:341
178769943,0cyclictest5973-21awk22:21:331
178769943,0cyclictest3948-21awk23:16:351
178769943,0cyclictest3571-21lldpd21:41:451
178769943,0cyclictest3571-21lldpd21:17:461
178769943,0cyclictest3571-21lldpd20:16:431
178769943,0cyclictest3571-21lldpd00:32:171
178769943,0cyclictest19176-21awk23:06:351
178759943,0cyclictest3524-21snmpd22:37:120
178759943,0cyclictest3250-21irqbalance23:32:250
178759943,0cyclictest3250-21irqbalance22:06:450
178759943,0cyclictest3250-21irqbalance21:47:350
178759943,0cyclictest3250-21irqbalance21:21:250
178759943,0cyclictest3250-21irqbalance20:42:040
178759943,0cyclictest17982-21sadc00:21:180
178759943,0cyclictest14513-21awk22:26:340
179940,0migration/1380-21kthreadcore19:51:371
179940,0migration/131278-21unixbench_singl00:06:431
179940,0migration/129826-21fschecks_count20:36:321
179940,0migration/128410-21missed_timers23:46:391
179940,0migration/125040-21runrttasks20:08:371
179940,0migration/124247-21missed_timers00:21:391
179940,0migration/123595-21kernelversion22:31:361
179940,0migration/122853-21kthreadcore22:11:371
179940,0migration/118926-21kthreadcore23:41:351
179940,0migration/118703-21kthreadcore19:41:351
179940,0migration/114039-21taskset22:42:421
179940,0migration/111941-21kthreadcore20:21:371
179940,0migration/111921-21kthreadcore21:06:361
169940,0watchdog/13453-21smartctl22:01:331
169940,0watchdog/128094-21cat21:56:371
169940,0watchdog/126178-21grep00:41:381
169940,0watchdog/119707-21sensors_fan22:26:411
169940,0watchdog/1181412sleep120:49:451
169940,0watchdog/116335-21perl22:46:301
169940,0watchdog/115374-21fschecks_count20:26:331
169940,0watchdog/10-21swapper/121:31:291
169940,0watchdog/10-21swapper/120:41:291
169940,0watchdog/10-21swapper/119:31:371
169940,0watchdog/10-21swapper/100:11:341
149940,0migration/0788-21kthreadcore20:36:370
149940,0migration/07792-21latency_hist21:06:180
149940,0migration/04047-21irqrtprio22:01:360
149940,0migration/032222-21kthreadcore19:51:360
149940,0migration/031476-21rt-features19:26:420
149940,0migration/031015-21kthreadcore00:26:390
149940,0migration/027215-21kthreadcore21:36:350
149940,0migration/026369-21fschecks_time20:11:320
149940,0migration/024260-21vmstat21:51:450
149940,0migration/018889-21fschecks_count20:06:320
149940,0migration/018574-21runrttasks00:36:460
149940,0migration/016148-21runrttasks23:02:050
149940,0migration/013313-21sh23:40:550
149940,0migration/011705-21kthreadcore21:26:380
149940,0migration/011437-21kthreadcore22:41:370
149940,0migration/011417-21latency_hist23:21:190
13417240,0sleep30-21swapper/319:36:393
8305030,0irq/26-0000:00:0-21swapper/220:11:182
329930,0watchdog/30-21swapper/319:46:453
29805030,0irq/28-eth0-rx-0-21swapper/320:41:013
29805030,0irq/28-eth0-rx-0-21swapper/320:11:403
29805030,0irq/28-eth0-rx-0-21swapper/319:41:393
259930,0migration/215878-21fschecks_time21:11:302
178779933,0cyclictest3571-21lldpd19:29:132
178779932,0cyclictest3571-21lldpd19:36:432
178779932,0cyclictest14029-21sensors21:06:402
178769933,0cyclictest22939-21awk19:46:341
178769932,0cyclictest5292-21tail23:51:441
178769932,0cyclictest415-21latency_hist21:01:181
178769932,0cyclictest3571-21lldpd19:22:431
178769932,0cyclictest3524-21snmpd22:16:291
178769932,0cyclictest3524-21snmpd19:30:581
178769932,0cyclictest26787-21awk20:56:341
178769932,0cyclictest21239-21sensors21:11:381
178769930,0cyclictest4278-21munin-node19:56:321
178769930,0cyclictest11793-21perl20:01:321
178759933,0cyclictest30493-21kworker/0:121:56:400
178759933,0cyclictest0-21swapper/022:15:350
178759932,0cyclictest3524-21snmpd23:51:470
178759932,0cyclictest27192-21kthreadcore23:46:380
178759932,0cyclictest21117-21sensors21:31:390
178759930,0cyclictest8256-21perl23:56:340
178759930,0cyclictest27345-21perl23:11:330
178759930,0cyclictest0-21swapper/023:42:360
179930,0migration/132398-21runrttasks20:15:141
169930,0watchdog/10-21swapper/122:06:411
169930,0watchdog/10-21swapper/121:51:211
169930,0watchdog/10-21swapper/100:49:181
149930,0migration/023114-21sh00:02:550
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional