You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 11:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri May 08, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2730725142,0sleep10-21swapper/119:19:091
2737524939,0sleep20-21swapper/219:19:542
2728723625,0sleep30-21swapper/319:18:553
2062523624,0sleep00-21swapper/019:17:160
27633991010,0cyclictest3571-21lldpd19:34:271
276329976,0cyclictest6952-21munin-node21:22:240
4160,0ktimersoftd/00-21swapper/019:27:350
339960,0migration/39386-21sh21:41:103
339960,0migration/328248-21sh22:08:473
339960,0migration/313967-21fschecks_time00:32:253
339960,0migration/311185-21sh23:13:213
329960,0watchdog/327110-21sh23:05:593
276349966,0cyclictest0-21swapper/200:18:142
276349960,0cyclictest30135-21runrttasks22:27:522
149960,0migration/08299-21switchtime22:52:330
149960,0migration/020495-21kthreadcore19:37:260
149960,0migration/012943-21kthreadcore22:57:250
8305050,0irq/26-0000:00:29744-21load23:42:282
8305050,0irq/26-0000:00:13384-21crond19:57:072
339950,0migration/38752-21kthreadcore22:17:263
339950,0migration/38257-21kernelversion20:37:243
339950,0migration/37405-21munin-node21:22:193
339950,0migration/35572-21missed_timers21:17:273
339950,0migration/34569-21kthreadcore00:07:283
339950,0migration/34569-21kthreadcore00:07:283
339950,0migration/33521-21kthreadcore22:32:253
339950,0migration/33302-21kthreadcore23:27:273
339950,0migration/331744-21taskset20:32:173
339950,0migration/33117-21aten_r1power_en20:57:193
339950,0migration/330724-21kthreadcore20:07:253
339950,0migration/330423-21munin-node00:42:183
339950,0migration/330325-21kthreadcore00:22:263
339950,0migration/329529-21kthreadcore23:07:253
339950,0migration/326271-21kthreadcore22:27:293
339950,0migration/325153-21kthreadcore20:02:253
339950,0migration/32447-21taskset20:52:593
339950,0migration/323937-21taskset20:22:563
339950,0migration/320505-21munin-node00:17:223
339950,0migration/319462-21kthreadcore21:07:253
339950,0migration/316972-21latency_hist19:37:073
339950,0migration/316712-21kthreadcore19:57:263
339950,0migration/316298-21runrttasks22:41:053
339950,0migration/316237-21sh23:54:493
339950,0migration/311487-21irqcore21:42:263
329950,0watchdog/35418-21python19:47:303
329950,0watchdog/327417-21cut20:27:273
329950,0watchdog/325071-21kthreadcore23:22:273
329950,0watchdog/316401-21kthreadcore22:22:273
329950,0watchdog/312516-21sh22:02:193
329950,0watchdog/30-21swapper/321:35:193
29815050,0irq/29-eth0-tx-6788-21munin-node00:47:262
29815050,0irq/29-eth0-tx-5801-21ssh23:31:042
29815050,0irq/29-eth0-tx-4151-21munin-node23:12:282
29815050,0irq/29-eth0-tx-31522-21munin-node19:47:230
29815050,0irq/29-eth0-tx-16973-21munin-node22:42:272
29815050,0irq/29-eth0-tx-14427-21chrt23:35:582
29815050,0irq/29-eth0-tx-0-21swapper/222:18:512
29815050,0irq/29-eth0-tx-0-21swapper/200:23:262
29815050,0irq/29-eth0-tx-0-21swapper/200:12:492
29815050,0irq/29-eth0-tx-0-21swapper/021:07:140
29815050,0irq/29-eth0-tx-0-21swapper/020:32:180
29815050,0irq/29-eth0-tx-0-21swapper/020:07:320
29815050,0irq/29-eth0-tx-0-21swapper/020:02:010
29805050,0irq/28-eth0-rx-25378-21kthreadcore23:42:273
29805050,0irq/28-eth0-rx-17949-21kthreadcore21:27:253
29805050,0irq/28-eth0-rx-16735-21kthreadcore23:37:273
29805050,0irq/28-eth0-rx-0-21swapper/323:57:223
29805050,0irq/28-eth0-rx-0-21swapper/323:50:273
29805050,0irq/28-eth0-rx-0-21swapper/322:45:333
29805050,0irq/28-eth0-rx-0-21swapper/322:12:263
29805050,0irq/28-eth0-rx-0-21swapper/321:52:283
29805050,0irq/28-eth0-rx-0-21swapper/300:50:153
29805050,0irq/28-eth0-rx-0-21swapper/300:37:273
29805050,0irq/28-eth0-rx-0-21swapper/300:02:243
276349955,0cyclictest0-21swapper/221:31:072
276349955,0cyclictest0-21swapper/200:07:302
276349955,0cyclictest0-21swapper/200:07:302
276349950,0cyclictest0-21swapper/221:44:592
276339955,0cyclictest0-21swapper/122:52:201
276339950,0cyclictest0-21swapper/123:48:271
276339950,0cyclictest0-21swapper/123:06:121
276339950,0cyclictest0-21swapper/122:23:571
276339950,0cyclictest0-21swapper/121:30:211
276329955,0cyclictest0-21swapper/021:42:130
276329950,0cyclictest0-21swapper/022:00:020
276329950,0cyclictest0-21swapper/021:33:140
276329950,0cyclictest0-21swapper/000:01:350
27150,0ktimersoftd/20-21swapper/219:27:302
259950,0migration/25501-21kthreadcore23:47:272
259950,0migration/230348-21latency_hist00:42:082
259950,0migration/228761-21kthreadcore00:02:242
259950,0migration/226160-21fschecks_count22:47:232
259950,0migration/225787-21taskset21:48:122
259950,0migration/219287-21kthreadcore19:37:252
249950,0watchdog/228355-21munin-node20:52:192
249950,0watchdog/212849-21munin-node23:17:272
179950,0migration/16775-21kthreadcore20:57:261
179950,0migration/130126-21kthreadcore20:27:271
179950,0migration/129737-21aten_r1power_cu22:12:181
179950,0migration/126685-21if_eth022:47:251
179950,0migration/125692-21munin-node21:32:231
179950,0migration/120218-21kthreadcore19:37:251
179950,0migration/118276-21gltestperf23:57:221
179950,0migration/117679-21taskset22:58:441
179950,0migration/113503-21fschecks_count23:17:221
169950,0watchdog/128232-21cut23:42:271
169950,0watchdog/118008-21ssh00:13:351
149950,0migration/06580-21sh23:32:200
149950,0migration/06536-21timerandwakeup23:47:330
149950,0migration/05900-21kthreadcore20:57:260
149950,0migration/05589-21latency22:32:260
149950,0migration/05513-21gltestperf00:27:220
149950,0migration/03530-21kthreadcore23:27:270
149950,0migration/032710-21kthreadcore00:42:250
149950,0migration/032352-21cpuspeed_turbos21:17:210
149950,0migration/029045-21kthreadcore21:12:250
149950,0migration/029035-21kthreadcore22:47:270
149950,0migration/028502-21kthreadcore19:42:250
149950,0migration/028481-21kthreadcore00:02:240
149950,0migration/027434-21kthreadcore22:27:290
149950,0migration/024372-21latency_hist21:32:080
149950,0migration/023847-21aten_r1power_fr23:42:210
149950,0migration/023022-21kthreadcore20:22:250
149950,0migration/019478-21fschecks_count21:47:210
149950,0migration/018986-21kthreadcore22:22:280
149950,0migration/016750-21kthreadcore23:37:260
149950,0migration/014878-21kthreadcore00:32:280
149950,0migration/014094-21munin-node22:02:260
149950,0migration/013091-21cpuspeed_turbos23:17:210
149950,0migration/012497-21kthreadcore20:17:240
149950,0migration/012173-21irqcore00:12:260
149950,0migration/010622-21kthreadcore00:47:290
8305040,0irq/26-0000:00:0-21swapper/222:02:082
339940,0migration/39828-21taskset20:16:283
339940,0migration/39778-21latency_hist19:32:073
339940,0migration/38227-21kthreadcore21:57:273
339940,0migration/327792-21taskset20:49:383
339940,0migration/32113-21taskset19:23:443
339940,0migration/312005-21kthreadcore19:52:263
339940,0migration/310433-21aten2.4-expect21:02:193
339940,0migration/310156-21aten_r1power_en20:17:183
329940,0watchdog/30-21swapper/323:17:273
29815040,0irq/29-eth0-tx-6952-21munin-node21:22:282
29815040,0irq/29-eth0-tx-25378-21ssh23:22:272
29815040,0irq/29-eth0-tx-2016-21ssh21:53:042
29815040,0irq/29-eth0-tx-19199-21munin-node23:02:212
29815040,0irq/29-eth0-tx-1143-21aten_r1power_po21:37:202
29815040,0irq/29-eth0-tx-0-21swapper/223:57:092
29815040,0irq/29-eth0-tx-0-21swapper/223:52:122
29815040,0irq/29-eth0-tx-0-21swapper/223:37:142
29815040,0irq/29-eth0-tx-0-21swapper/222:37:222
29815040,0irq/29-eth0-tx-0-21swapper/222:32:332
29815040,0irq/29-eth0-tx-0-21swapper/221:57:202
29815040,0irq/29-eth0-tx-0-21swapper/200:27:462
29815040,0irq/29-eth0-tx-0-21swapper/020:16:280
29815040,0irq/29-eth0-tx-0-21swapper/020:02:230
29805040,0irq/28-eth0-rx-11713-21ssh22:57:243
29805040,0irq/28-eth0-rx-0-21swapper/323:32:393
29805040,0irq/28-eth0-rx-0-21swapper/322:52:203
29805040,0irq/28-eth0-rx-0-21swapper/322:47:393
29805040,0irq/28-eth0-rx-0-21swapper/321:47:283
29805040,0irq/28-eth0-rx-0-21swapper/319:37:253
29805040,0irq/28-eth0-rx-0-21swapper/300:29:533
29805040,0irq/28-eth0-rx-0-21swapper/300:12:273
276349943,0cyclictest412-21awk20:32:232
276349943,0cyclictest3571-21lldpd20:58:282
276349943,0cyclictest3250-21irqbalance22:53:042
276349943,0cyclictest3250-21irqbalance00:37:252
276349943,0cyclictest3250-21irqbalance00:32:352
276349943,0cyclictest30862-21awk22:12:232
276349943,0cyclictest28977-21awk23:07:242
276349943,0cyclictest25651-21awk20:27:252
276349943,0cyclictest25388-21awk19:42:232
276349943,0cyclictest15025-21awk20:42:232
276349943,0cyclictest11082-21awk19:32:242
276339944,0cyclictest0-21swapper/123:34:441
276339944,0cyclictest0-21swapper/123:12:211
276339943,0cyclictest3524-21snmpd22:32:191
276339943,0cyclictest3524-21snmpd21:37:491
276339943,0cyclictest3524-21snmpd20:07:031
276339943,0cyclictest3524-21snmpd19:52:481
276339943,0cyclictest3524-21snmpd19:48:031
276339943,0cyclictest29110-21awk20:07:231
276339943,0cyclictest28772-21tail23:07:221
276339943,0cyclictest28014-21sadc20:52:071
276339943,0cyclictest27133-21awk00:02:221
276339942,0cyclictest24408-21grep23:22:261
276339940,0cyclictest0-21swapper/100:19:481
276329943,0cyclictest7917-21irqcore20:37:240
276329943,0cyclictest5246-21awk23:12:240
276329943,0cyclictest29416-21awk00:22:250
276329943,0cyclictest20309-21awk23:02:240
276329943,0cyclictest14938-21awk20:42:230
276329943,0cyclictest11411-21awk21:02:230
276329940,0cyclictest30945-21cat20:52:240
259940,0migration/228732-21fschecks_time19:22:222
259940,0migration/227713-21runrttasks20:06:192
259940,0migration/226730-21kthreadcore21:12:252
259940,0migration/224559-21kthreadcore22:07:262
259940,0migration/223277-21kthreadcore21:07:262
259940,0migration/21494-21kthreadcore19:47:242
259940,0migration/214734-21diskmemload22:22:212
259940,0migration/210675-21aten_r1power_po22:57:202
249940,0watchdog/25929-21python21:17:312
249940,0watchdog/219798-21find19:57:302
249940,0watchdog/211373-21idleruntime21:02:232
249940,0watchdog/20-21swapper/221:32:272
179940,0migration/16134-21taskset20:33:361
179940,0migration/15405-21irqrtprio21:57:251
179940,0migration/15215-21kthreadcore19:27:271
179940,0migration/14291-21kthreadcore00:07:271
179940,0migration/14291-21kthreadcore00:07:271
179940,0migration/130794-21fschecks_count23:27:221
179940,0migration/127542-21kthreadcore21:12:251
179940,0migration/125750-21kthreadcore00:37:271
179940,0migration/125026-21kthreadcore22:27:291
179940,0migration/122504-21kthreadcore22:42:291
179940,0migration/120414-21irqrtprio21:47:251
179940,0migration/118390-21kthreadcore23:37:271
179940,0migration/117998-21fschecks_time20:22:201
179940,0migration/116130-21kthreadcore20:42:251
179940,0migration/114487-21kthreadcore20:17:241
179940,0migration/113925-21fschecks_time00:32:251
179940,0migration/112757-21kthreadcore23:52:261
179940,0migration/110081-21sh21:42:181
169940,0watchdog/19906-21irqstats22:37:231
169940,0watchdog/18516-21ssh21:22:231
169940,0watchdog/127868-21ssh21:52:231
169940,0watchdog/119800-21wc19:57:301
169940,0watchdog/10-21swapper/122:04:311
169940,0watchdog/10-21swapper/121:02:231
169940,0watchdog/10-21swapper/120:37:271
149940,0migration/0522-21kthreadcore22:12:260
149940,0migration/03666-21kthreadcore21:37:260
149940,0migration/025639-21kthreadcore22:07:260
329930,0watchdog/30-21swapper/320:43:033
29815030,0irq/29-eth0-tx-27909-21aten2.4-expect19:22:190
29805030,0irq/28-eth0-rx-0-21swapper/319:42:193
276349932,0cyclictest4055-21awk20:12:222
276349932,0cyclictest22147-21awk20:47:222
276339932,0cyclictest3524-21snmpd21:17:161
276339932,0cyclictest3524-21snmpd00:43:051
276339932,0cyclictest25719-21irqrtprio19:42:241
276339932,0cyclictest22320-21awk22:07:241
276339932,0cyclictest21804-21grep21:07:251
276339932,0cyclictest1987-21users19:22:341
276339932,0cyclictest13612-21ssh22:20:011
276329933,0cyclictest3571-21lldpd19:33:570
276329933,0cyclictest3524-21snmpd23:23:500
276329932,0cyclictest3524-21snmpd21:52:230
276329932,0cyclictest20723-21awk00:17:240
276329932,0cyclictest11222-21cut22:37:240
276329930,0cyclictest2896-21diskmemload23:09:360
249930,0watchdog/20-21swapper/220:37:272
249930,0watchdog/20-21swapper/220:22:142
249930,0watchdog/20-21swapper/220:19:462
249930,0watchdog/20-21swapper/220:07:142
169930,0watchdog/16704-21diskmemload00:29:271
169930,0watchdog/10-21swapper/100:47:511
169930,0watchdog/10-21swapper/100:22:231
149930,0migration/028259-21kthreadcore20:27:270
149930,0migration/027773-21runrttasks20:49:250
329920,0watchdog/30-21swapper/321:12:153
276339920,0cyclictest28212-21latency_hist20:52:071
276339920,0cyclictest0-21swapper/120:12:111
276329921,0cyclictest8646-21latency_hist23:52:090
276329921,0cyclictest17411-21diskstats22:42:230
276329920,0cyclictest2069-21latency_hist00:07:090
276329920,0cyclictest2069-21latency_hist00:07:090
276329920,0cyclictest0-21swapper/022:17:190
276329920,0cyclictest0-21swapper/019:52:090
276329920,0cyclictest0-21swapper/000:37:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional