You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 03:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Tue Sep 08, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1160223524,0sleep00-21swapper/019:29:570
1141023525,0sleep10-21swapper/119:27:421
1147423322,0sleep30-21swapper/319:28:283
1143623127,0sleep20-21swapper/219:28:032
29805080,0irq/28-eth0-rx-2489-21munin-run23:32:123
118679970,0cyclictest0-21swapper/200:53:032
339960,0migration/325874-21sh01:00:173
339960,0migration/320414-21sh22:26:343
339960,0migration/316896-21kthreadcore00:17:313
329960,0watchdog/36505-21sh00:28:203
329960,0watchdog/318054-21cut21:02:313
29815060,0irq/29-eth0-tx-0-21swapper/222:12:332
29805060,0irq/28-eth0-rx-23358-21ssh23:04:093
29805060,0irq/28-eth0-rx-20068-21hddtemp_smartct22:07:273
29805060,0irq/28-eth0-rx-20053-21cut00:37:313
29805060,0irq/28-eth0-rx-10663-21munin-node23:17:293
149960,0migration/07034-21sh22:56:260
149960,0migration/05835-21munin-node21:37:350
149960,0migration/011581-21sh22:20:420
149960,0migration/010223-21fschecks_time23:17:270
118679963,0cyclictest17987-21awk21:47:262
339950,0migration/37799-21proc_pri20:32:333
339950,0migration/36869-21kthreadcore00:47:323
339950,0migration/33283-21sh23:49:243
339950,0migration/331930-21munin-node21:37:243
339950,0migration/32939-21taskset22:15:393
339950,0migration/32852-21kernelversion19:47:293
339950,0migration/325080-21kthreadcore20:02:273
339950,0migration/324711-21irqcore00:22:303
339950,0migration/324703-21irqrtprio20:47:293
339950,0migration/322962-21taskset20:46:223
339950,0migration/322385-21sh22:46:523
339950,0migration/320689-21fschecks_time23:42:263
339950,0migration/32008-21kthreadcore00:07:313
339950,0migration/318067-21munin-node19:32:333
339950,0migration/315671-21kthreadcore23:37:313
339950,0migration/312874-21fschecks_count20:17:263
339950,0migration/31258-21kthreadcore22:52:303
339950,0migration/312189-21latency_hist20:17:123
339950,0migration/310673-21aten_r1power_vo22:02:253
339950,0migration/31023-21taskset19:47:113
329950,0watchdog/39820-21gltestperf20:37:273
329950,0watchdog/329137-21cut21:32:313
329950,0watchdog/324838-21sh21:50:513
329950,0watchdog/315666-21sh00:35:163
329950,0watchdog/312679-21sensors_temp00:12:403
29805050,0irq/28-eth0-rx-9912-21kthreadcore21:42:323
29805050,0irq/28-eth0-rx-5954-21cut23:32:343
29805050,0irq/28-eth0-rx-4158-21chrt22:33:313
29805050,0irq/28-eth0-rx-24341-21grep22:27:313
29805050,0irq/28-eth0-rx-22266-21grep19:57:383
29805050,0irq/28-eth0-rx-2125-21ssh21:57:263
29805050,0irq/28-eth0-rx-19483-21python23:57:353
29805050,0irq/28-eth0-rx-0-21swapper/323:53:303
29805050,0irq/28-eth0-rx-0-21swapper/323:07:543
29805050,0irq/28-eth0-rx-0-21swapper/322:57:383
29805050,0irq/28-eth0-rx-0-21swapper/322:57:383
29805050,0irq/28-eth0-rx-0-21swapper/322:37:263
29805050,0irq/28-eth0-rx-0-21swapper/322:17:133
29805050,0irq/28-eth0-rx-0-21swapper/321:12:223
29805050,0irq/28-eth0-rx-0-21swapper/300:52:343
249950,0watchdog/20-21swapper/219:52:312
19150,0ktimersoftd/10-21swapper/122:05:451
19150,0ktimersoftd/10-21swapper/100:16:171
179950,0migration/18504-21sh00:49:191
179950,0migration/14044-21sh23:51:331
179950,0migration/123509-21aten_r1power_en21:32:241
179950,0migration/120352-21kthreadcore20:42:291
179950,0migration/119537-21munin-node22:07:261
179950,0migration/116619-21fschecks_time19:57:261
179950,0migration/11520-21kthreadcore22:32:331
169950,0watchdog/121911-21grep00:37:321
149950,0migration/08408-21kthreadcore23:52:300
149950,0migration/07883-21kthreadcore23:32:350
149950,0migration/06031-21fschecks_time20:57:270
149950,0migration/05984-21fschecks_time20:12:270
149950,0migration/05914-21munin-node00:27:350
149950,0migration/032586-21kthreadcore20:07:300
149950,0migration/032138-21sh00:43:400
149950,0migration/031791-21irqcore20:52:280
149950,0migration/031067-21sh21:35:520
149950,0migration/03032-21latency22:32:330
149950,0migration/029490-21smart_sdb20:47:350
149950,0migration/027613-21kthreadcore21:52:330
149950,0migration/026615-21ksmtuned21:11:070
149950,0migration/025637-21taskset00:59:340
149950,0migration/025277-21kthreadcore22:27:310
149950,0migration/023527-21kthreadcore23:42:300
149950,0migration/022375-21kthreadcore22:07:310
149950,0migration/021649-21kthreadcore20:22:290
149950,0migration/019490-21kthreadcore21:27:320
149950,0migration/017409-21fschecks_count21:47:250
149950,0migration/017367-21kthreadcore23:57:300
149950,0migration/016233-21aten2.4-expect23:02:250
149950,0migration/015870-21kthreadcore19:32:310
149950,0migration/015561-21fschecks_time00:17:270
149950,0migration/015423-21kthreadcore22:22:280
149950,0migration/014407-21sendmail_mailqu00:32:380
149950,0migration/012225-21kthreadcore21:22:320
118679955,0cyclictest0-21swapper/222:56:412
118679950,0cyclictest0-21swapper/222:46:082
118679950,0cyclictest0-21swapper/222:35:342
118679950,0cyclictest0-21swapper/200:31:552
118669955,0cyclictest0-21swapper/123:36:141
118669955,0cyclictest0-21swapper/122:23:151
118669955,0cyclictest0-21swapper/100:42:461
118669950,0cyclictest0-21swapper/121:43:221
118669950,0cyclictest0-21swapper/100:10:081
118659955,0cyclictest23209-21diskmemload22:02:140
118659955,0cyclictest0-21swapper/023:09:330
118659955,0cyclictest0-21swapper/022:58:310
118659955,0cyclictest0-21swapper/022:58:310
118659955,0cyclictest0-21swapper/022:37:420
118659955,0cyclictest0-21swapper/000:04:440
118659950,0cyclictest0-21swapper/023:40:360
118659950,0cyclictest0-21swapper/000:26:480
8305040,0irq/26-0000:00:0-21swapper/223:37:312
8305040,0irq/26-0000:00:0-21swapper/200:12:122
339940,0migration/39136-21munin-node21:22:263
339940,0migration/332702-21kthreadcore20:52:293
339940,0migration/326854-21if_eth1.221:52:323
339940,0migration/326262-21kthreadcore00:02:313
329940,0watchdog/30-21swapper/323:12:353
329940,0watchdog/30-21swapper/322:47:313
329940,0watchdog/30-21swapper/321:28:513
329940,0watchdog/30-21swapper/320:57:273
329940,0watchdog/30-21swapper/320:27:313
329940,0watchdog/30-21swapper/320:07:313
29815040,0irq/29-eth0-tx-0-21swapper/223:48:382
29815040,0irq/29-eth0-tx-0-21swapper/223:22:262
29815040,0irq/29-eth0-tx-0-21swapper/222:27:132
29815040,0irq/29-eth0-tx-0-21swapper/222:17:242
29815040,0irq/29-eth0-tx-0-21swapper/220:42:312
29805040,0irq/28-eth0-rx-31203-21ntp_states00:42:333
29805040,0irq/28-eth0-rx-0-21swapper/323:24:593
29805040,0irq/28-eth0-rx-0-21swapper/321:07:293
29805040,0irq/28-eth0-rx-0-21swapper/319:37:293
249940,0watchdog/25933-21fschecks_count20:57:272
249940,0watchdog/22766-21fschecks_time21:57:272
249940,0watchdog/224244-21kthreadcore22:07:312
249940,0watchdog/215578-21kthreadcore19:32:312
249940,0watchdog/20-21swapper/223:14:392
249940,0watchdog/20-21swapper/220:12:312
179940,0migration/18113-21kthreadcore22:17:301
179940,0migration/14187-21kthreadcore21:17:291
179940,0migration/13311-21kthreadcore20:32:291
179940,0migration/130684-21kthreadcore23:27:311
179940,0migration/127676-21aten_r1power_fr22:12:231
179940,0migration/126439-21taskset20:25:561
179940,0migration/125046-21kthreadcore23:42:311
179940,0migration/118694-21kthreadcore21:27:321
179940,0migration/114270-21kthreadcore20:17:301
179940,0migration/111157-21ntp_kernel_pll_20:12:331
179940,0migration/110775-21kthreadcore00:32:341
169940,0watchdog/14721-21tr22:52:311
169940,0watchdog/14657-21kthreadcore21:37:311
169940,0watchdog/1455-21ntpq21:12:311
169940,0watchdog/14130-21python20:07:351
169940,0watchdog/128978-21kthreadcore00:22:321
169940,0watchdog/123282-21cut20:47:231
169940,0watchdog/122189-21cut00:57:321
169940,0watchdog/118088-21if_eth1.221:47:271
169940,0watchdog/115307-21switchtime21:22:391
169940,0watchdog/10-21swapper/123:17:231
169940,0watchdog/10-21swapper/121:02:311
169940,0watchdog/10-21swapper/120:57:271
169940,0watchdog/10-21swapper/120:37:311
169940,0watchdog/10-21swapper/119:32:311
149940,0migration/03232-21kthreadcore23:12:350
149940,0migration/027031-21fschecks_count19:42:240
149940,0migration/01846-21kthreadcore00:07:310
118679944,0cyclictest0-21swapper/223:19:052
118679943,0cyclictest9306-21awk00:32:322
118679943,0cyclictest6861-21awk22:37:282
118679943,0cyclictest5707-21awk23:52:282
118679943,0cyclictest3571-21lldpd23:08:122
118679943,0cyclictest3571-21lldpd22:49:122
118679943,0cyclictest3571-21lldpd20:01:102
118679943,0cyclictest3571-21lldpd00:03:132
118679943,0cyclictest3524-21snmpd23:59:162
118679943,0cyclictest3524-21snmpd23:29:312
118679943,0cyclictest3524-21snmpd23:02:312
118679943,0cyclictest3524-21snmpd22:24:452
118679943,0cyclictest3524-21snmpd21:37:152
118679943,0cyclictest3524-21snmpd21:16:452
118679943,0cyclictest3524-21snmpd20:52:302
118679943,0cyclictest3524-21snmpd20:39:002
118679943,0cyclictest3524-21snmpd20:27:152
118679943,0cyclictest3524-21snmpd20:10:292
118679943,0cyclictest3524-21snmpd20:05:292
118679943,0cyclictest3524-21snmpd19:48:592
118679943,0cyclictest31235-21awk00:07:292
118679943,0cyclictest26811-21awk21:52:312
118679943,0cyclictest24580-21awk21:32:282
118679943,0cyclictest24484-21awk00:22:282
118679943,0cyclictest24427-21awk20:47:282
118679943,0cyclictest19580-21munin-node20:22:282
118679943,0cyclictest1706-21munin-node21:17:252
118679943,0cyclictest11665-21awk22:02:292
118679940,0cyclictest7598-21munin-node22:57:272
118679940,0cyclictest7598-21munin-node22:57:272
118679940,0cyclictest19754-21munin-node21:07:242
118679940,0cyclictest1190-21munin-node00:47:272
118669944,0cyclictest0-21swapper/100:55:231
118669943,0cyclictest6888-21awk22:37:281
118669943,0cyclictest552-21awk00:27:271
118669943,0cyclictest3571-21lldpd23:52:121
118669943,0cyclictest3571-21lldpd22:48:421
118669943,0cyclictest3571-21lldpd22:28:421
118669943,0cyclictest3524-21snmpd21:59:301
118669943,0cyclictest3524-21snmpd21:53:151
118669943,0cyclictest3524-21snmpd20:52:151
118669943,0cyclictest3524-21snmpd19:37:141
118669943,0cyclictest27843-21awk20:27:281
118669943,0cyclictest2378-21awk19:47:271
118669943,0cyclictest20819-21awk21:07:271
118669943,0cyclictest1946-21awk23:12:331
118669943,0cyclictest19175-21awk23:22:281
118669943,0cyclictest15838-21sadc23:02:131
118669943,0cyclictest15838-21sadc23:02:131
118669943,0cyclictest14347-21awk23:57:281
118669943,0cyclictest12542-21awk23:37:291
118659944,0cyclictest0-21swapper/022:14:030
118659944,0cyclictest0-21swapper/021:18:330
118659943,0cyclictest3571-21lldpd23:48:120
118659943,0cyclictest3571-21lldpd00:54:130
118659943,0cyclictest3524-21snmpd22:50:160
118659943,0cyclictest3524-21snmpd22:42:300
118659943,0cyclictest3524-21snmpd20:42:150
118659943,0cyclictest3524-21snmpd20:37:300
118659943,0cyclictest3524-21snmpd19:53:290
118659943,0cyclictest27899-21awk20:27:290
118659943,0cyclictest24106-21awk20:02:250
8305030,0irq/26-0000:00:0-21swapper/200:57:132
329930,0watchdog/311373-21kthreadcore19:52:313
29805030,0irq/28-eth0-rx-0-21swapper/321:17:303
29805030,0irq/28-eth0-rx-0-21swapper/320:22:233
249930,0watchdog/20-21swapper/223:42:242
249930,0watchdog/20-21swapper/221:02:312
169930,0watchdog/120970-21ssh22:42:431
169930,0watchdog/10-21swapper/123:07:191
169930,0watchdog/10-21swapper/100:17:321
118679933,0cyclictest3571-21lldpd00:17:132
118679933,0cyclictest0-21swapper/219:37:242
118679932,0cyclictest9810-21cut21:42:312
118679932,0cyclictest3926-21awk23:32:322
118679932,0cyclictest2614-21awk20:32:272
118679932,0cyclictest10244-21ps21:22:312
118679932,0cyclictest0-21swapper/200:42:172
118679932,0cyclictest0-21swapper/200:37:192
118679930,0cyclictest26477-21munin-node19:42:312
118679930,0cyclictest0-21swapper/221:27:272
118679930,0cyclictest0-21swapper/220:17:262
118669932,0cyclictest3524-21snmpd19:52:161
118669932,0cyclictest3524-21snmpd00:03:041
118669932,0cyclictest17255-21awk23:02:291
118659933,0cyclictest3571-21lldpd21:59:110
118659933,0cyclictest0-21swapper/021:14:080
118659933,0cyclictest0-21swapper/019:47:450
118659932,0cyclictest7579-21sensors00:47:360
118659932,0cyclictest3524-21snmpd20:17:200
118659932,0cyclictest3524-21snmpd19:37:140
118659932,0cyclictest27675-21awk23:27:280
118659932,0cyclictest2507-21tail20:32:260
118659932,0cyclictest18049-21irqrtprio00:37:300
118659932,0cyclictest13708-21awk21:02:280
118659930,0cyclictest9057-21perl21:42:280
118659930,0cyclictest18482-21diskstats23:22:260
118659930,0cyclictest0-21swapper/000:12:350
118669921,0cyclictest26389-21wc19:42:121
118669920,0cyclictest22961-21latency_hist20:02:121
118659921,0cyclictest0-21swapper/019:57:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional