You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 19:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot2.osadl.org (updated Mon Mar 09, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2505324839,0sleep10-21swapper/107:14:351
2513923526,0sleep20-21swapper/207:15:362
2491623127,0sleep00-21swapper/007:13:010
2523122824,0sleep30-21swapper/307:16:413
253539983,0cyclictest15529-21awk11:52:282
253519985,0cyclictest7142-21munin-run09:37:120
253539973,0cyclictest5395-21awk08:32:282
253539973,0cyclictest3861-21sadc07:47:122
253539973,0cyclictest27090-21munin-node10:07:292
253539973,0cyclictest16017-21awk07:32:272
253539972,0cyclictest9038-21awk12:07:292
4160,0ktimersoftd/00-21swapper/008:17:310
339960,0migration/39355-21sh11:10:343
339960,0migration/328879-21sh10:26:323
339960,0migration/328465-21sh11:39:483
339960,0migration/323007-21sh11:57:173
339960,0migration/322791-21munin-node09:42:383
339960,0migration/317758-21sh12:12:293
339960,0migration/310183-21munin-node12:27:263
29815060,0irq/29-eth0-tx-15156-21munin-node09:02:350
29805060,0irq/28-eth0-rx-9019-40yum-updatesd-he08:12:273
29805060,0irq/28-eth0-rx-2014-21grep10:47:303
253539962,0cyclictest4708-21awk10:12:292
253539962,0cyclictest3524-21snmpd07:41:312
253539962,0cyclictest26807-21sadc10:07:122
253539962,0cyclictest23551-21awk09:07:282
253539962,0cyclictest19576-21awk07:57:272
253539962,0cyclictest14310-21awk09:22:282
253539961,0cyclictest0-21swapper/211:18:412
253539960,0cyclictest7454-21munin-node12:22:322
253539960,0cyclictest30643-21cut09:47:312
253539960,0cyclictest25923-21fschecks_time12:17:252
253539960,0cyclictest10230-21munin-node11:12:372
253539960,0cyclictest0-21swapper/212:38:012
253539960,0cyclictest0-21swapper/212:34:022
253539960,0cyclictest0-21swapper/211:40:022
253539960,0cyclictest0-21swapper/211:31:242
253539960,0cyclictest0-21swapper/211:10:122
253539960,0cyclictest0-21swapper/210:42:422
253539960,0cyclictest0-21swapper/209:43:002
253539960,0cyclictest0-21swapper/209:31:452
19160,0ktimersoftd/116721-21kthreadcore08:17:311
149960,0migration/012737-21sh11:48:080
339950,0migration/35093-21kthreadcore08:07:323
339950,0migration/35019-21gltestperf07:47:273
339950,0migration/3481-21latency_hist08:52:123
339950,0migration/332128-21kthreadcore09:12:303
339950,0migration/331536-21kthreadcore07:42:293
339950,0migration/330718-21kthreadcore11:22:323
339950,0migration/329853-21cpuspeed_turbos11:42:253
339950,0migration/327249-21aten_r1power_fr12:37:233
339950,0migration/327129-21taskset11:22:083
339950,0migration/325630-21taskset08:47:113
339950,0migration/322556-21munin-node10:57:333
339950,0migration/321142-21munin-node09:02:323
339950,0migration/318616-21taskset10:17:393
339950,0migration/316033-21munin-node11:52:293
339950,0migration/31546-21munin-node07:22:283
339950,0migration/315412-21idleruntime10:37:273
339950,0migration/312657-21taskset10:33:153
329950,0watchdog/37458-21uname12:22:323
329950,0watchdog/330418-21seq09:31:513
329950,0watchdog/326644-21if_eth007:17:273
329950,0watchdog/326644-21if_eth007:17:273
329950,0watchdog/318745-21munin-node11:32:363
329950,0watchdog/318032-21kthreadcore08:17:313
329950,0watchdog/30-21swapper/309:17:273
29815050,0irq/29-eth0-tx-25564-21munin-node07:17:310
29815050,0irq/29-eth0-tx-25564-21munin-node07:17:310
29815050,0irq/29-eth0-tx-0-21swapper/008:44:560
29815050,0irq/29-eth0-tx-0-21swapper/008:32:340
29815050,0irq/29-eth0-tx-0-21swapper/008:14:500
29815050,0irq/29-eth0-tx-0-21swapper/007:42:320
29805050,0irq/28-eth0-rx-4888-21python09:32:353
29805050,0irq/28-eth0-rx-432-21kthreadcore08:27:293
29805050,0irq/28-eth0-rx-3658-21munin-node10:12:253
29805050,0irq/28-eth0-rx-29643-21cpu10:27:253
29805050,0irq/28-eth0-rx-28176-21cut12:17:303
29805050,0irq/28-eth0-rx-26910-21cut08:02:273
29805050,0irq/28-eth0-rx-18382-21cut10:02:123
29805050,0irq/28-eth0-rx-10179-21df09:57:243
29805050,0irq/28-eth0-rx-0-21swapper/312:11:303
29805050,0irq/28-eth0-rx-0-21swapper/312:02:313
29805050,0irq/28-eth0-rx-0-21swapper/311:51:473
29805050,0irq/28-eth0-rx-0-21swapper/311:27:293
29805050,0irq/28-eth0-rx-0-21swapper/311:12:323
29805050,0irq/28-eth0-rx-0-21swapper/311:04:373
29805050,0irq/28-eth0-rx-0-21swapper/310:54:103
29805050,0irq/28-eth0-rx-0-21swapper/310:42:143
29805050,0irq/28-eth0-rx-0-21swapper/309:49:283
29805050,0irq/28-eth0-rx-0-21swapper/309:26:133
29805050,0irq/28-eth0-rx-0-21swapper/308:32:303
253539954,0cyclictest0-21swapper/208:37:332
253539952,0cyclictest9058-21awk08:57:282
253539952,0cyclictest23861-21fschecks_time11:57:262
253539952,0cyclictest13837-21sensors07:27:332
253539952,0cyclictest12137-21grep10:32:372
253539950,0cyclictest6253-21ssh10:48:202
253539950,0cyclictest10011-21kthreadcore11:47:332
253539950,0cyclictest0-21swapper/212:42:312
253539950,0cyclictest0-21swapper/212:27:252
253539950,0cyclictest0-21swapper/212:13:002
253539950,0cyclictest0-21swapper/212:02:292
253539950,0cyclictest0-21swapper/211:45:122
253539950,0cyclictest0-21swapper/211:33:352
253539950,0cyclictest0-21swapper/211:22:142
253539950,0cyclictest0-21swapper/211:02:362
253539950,0cyclictest0-21swapper/210:57:412
253539950,0cyclictest0-21swapper/210:52:202
253539950,0cyclictest0-21swapper/210:38:092
253539950,0cyclictest0-21swapper/210:28:332
253539950,0cyclictest0-21swapper/210:22:512
253539950,0cyclictest0-21swapper/210:18:132
253539950,0cyclictest0-21swapper/209:57:372
253539950,0cyclictest0-21swapper/209:53:022
253539950,0cyclictest0-21swapper/209:38:032
253539950,0cyclictest0-21swapper/209:32:202
253539950,0cyclictest0-21swapper/209:20:292
253539950,0cyclictest0-21swapper/208:12:122
253529955,0cyclictest0-21swapper/112:34:141
253529955,0cyclictest0-21swapper/110:22:451
253529950,0cyclictest0-21swapper/111:44:161
253529950,0cyclictest0-21swapper/109:46:201
253519950,0cyclictest0-21swapper/009:12:360
179950,0migration/19346-21kthreadcore11:47:331
179950,0migration/13888-21munin-node12:42:261
179950,0migration/130805-21kthreadcore07:42:291
179950,0migration/128797-21unixbench-2d09:07:381
179950,0migration/126023-21fschecks_time11:02:271
179950,0migration/114860-21kthreadcore11:32:311
179950,0migration/113137-21taskset09:22:211
169950,0watchdog/113472-21tr10:52:321
149950,0migration/09863-21kthreadcore07:47:310
149950,0migration/031802-21munin-node08:02:320
149950,0migration/028889-21sh09:28:050
149950,0migration/028398-21munin-node12:37:280
149950,0migration/028209-21ntp_offset08:22:330
149950,0migration/027855-21munin-node11:22:270
149950,0migration/02560-21kthreadcore10:27:310
149950,0migration/020528-21munin-node11:52:320
149950,0migration/020424-21sh11:36:230
149950,0migration/016792-21kthreadcore09:22:300
149950,0migration/016458-21latency_hist12:12:130
149950,0migration/016179-21runrttasks09:57:340
149950,0migration/013575-21kthreadcore12:07:320
149950,0migration/012167-21sh10:17:220
4140,0ktimersoftd/00-21swapper/011:42:420
4140,0ktimersoftd/00-21swapper/011:16:030
339940,0migration/37431-21taskset08:54:003
339940,0migration/33461-21kthreadcore09:52:293
339940,0migration/33335-21latency_hist12:42:133
339940,0migration/323829-21kthreadcore08:22:303
339940,0migration/312890-21kernelversion07:52:293
339940,0migration/310174-21kthreadcore07:27:293
329940,0watchdog/313955-21kthreadcore08:37:273
329940,0watchdog/30-21swapper/310:07:283
329940,0watchdog/30-21swapper/308:57:313
29815040,0irq/29-eth0-tx-0-21swapper/009:17:250
29815040,0irq/29-eth0-tx-0-21swapper/007:58:190
29805040,0irq/28-eth0-rx-0-21swapper/312:32:303
29805040,0irq/28-eth0-rx-0-21swapper/309:37:253
253539943,0cyclictest3524-21snmpd09:16:322
253539943,0cyclictest3524-21snmpd09:06:322
253539943,0cyclictest3524-21snmpd08:47:322
253539943,0cyclictest3524-21snmpd08:45:322
253539943,0cyclictest3524-21snmpd08:31:322
253539943,0cyclictest3524-21snmpd08:15:462
253539943,0cyclictest26597-21awk07:17:262
253539943,0cyclictest26597-21awk07:17:262
253539943,0cyclictest12356-21awk07:52:272
253539940,0cyclictest22239-21munin-node08:22:242
253529944,0cyclictest0-21swapper/112:22:151
253529944,0cyclictest0-21swapper/111:14:471
253529944,0cyclictest0-21swapper/108:07:291
253529944,0cyclictest0-21swapper/107:52:301
253529943,0cyclictest5643-21awk09:17:291
253529943,0cyclictest380-21awk10:47:281
253529943,0cyclictest3571-21lldpd12:15:501
253529943,0cyclictest3571-21lldpd09:47:491
253529943,0cyclictest3571-21lldpd08:53:191
253529943,0cyclictest3571-21lldpd07:27:181
253529943,0cyclictest3571-21lldpd07:17:181
253529943,0cyclictest3571-21lldpd07:17:181
253529943,0cyclictest32720-21awk12:02:281
253529943,0cyclictest30677-21awk09:12:281
253529943,0cyclictest30522-21awk10:27:281
253529943,0cyclictest20477-21tail11:17:321
253529943,0cyclictest14805-21sadc08:17:121
253529943,0cyclictest10973-21awk09:57:281
253519944,0cyclictest8920-21kworker/0:212:32:300
253519944,0cyclictest8920-21kworker/0:212:30:020
253519944,0cyclictest28080-21kworker/0:210:42:300
253519944,0cyclictest28080-21kworker/0:210:32:300
253519944,0cyclictest26254-21kworker/0:011:05:520
253519944,0cyclictest0-21swapper/012:17:130
253519944,0cyclictest0-21swapper/011:41:170
253519943,0cyclictest8794-21awk07:27:270
253519943,0cyclictest4562-21awk12:42:290
253519943,0cyclictest4555-21awk10:12:280
253519943,0cyclictest3571-21lldpd10:48:200
253519943,0cyclictest3571-21lldpd07:36:480
253519943,0cyclictest3524-21snmpd07:26:310
253519943,0cyclictest3250-21irqbalance12:03:290
253519943,0cyclictest3250-21irqbalance11:27:190
253519943,0cyclictest3250-21irqbalance09:53:190
253519943,0cyclictest3250-21irqbalance09:48:090
253519943,0cyclictest3250-21irqbalance09:43:390
253519943,0cyclictest3250-21irqbalance09:38:090
253519943,0cyclictest3250-21irqbalance08:27:190
253519943,0cyclictest28163-21awk10:07:280
253519943,0cyclictest2703-21awk11:07:290
253519943,0cyclictest24135-21awk11:57:280
253519943,0cyclictest12598-21awk08:37:260
249940,0watchdog/20-21swapper/207:47:312
179940,0migration/1722-21runrttasks12:21:271
179940,0migration/14277-21kthreadcore07:22:301
179940,0migration/13546-21kthreadcore09:52:291
179940,0migration/130573-21kthreadcore12:37:291
179940,0migration/128795-21kthreadcore08:02:281
179940,0migration/127731-21fschecks_count10:07:261
179940,0migration/126657-21fschecks_time08:47:251
179940,0migration/125140-21kthreadcore10:42:291
179940,0migration/123681-21kthreadcore07:57:291
179940,0migration/123555-21irqcore08:22:301
179940,0migration/122887-21fschecks_time07:37:251
179940,0migration/121945-21sh09:27:171
179940,0migration/118974-21kthreadcore10:57:311
179940,0migration/117091-21kthreadcore11:52:301
179940,0migration/116966-21kthreadcore10:37:301
179940,0migration/115891-21kthreadcore10:17:321
179940,0migration/111921-21kthreadcore12:07:321
179940,0migration/111744-21cpuspeed_turbos08:37:221
169940,0watchdog/19011-21cut07:47:311
169940,0watchdog/13796-21chrt08:29:351
169940,0watchdog/10-21swapper/112:27:321
169940,0watchdog/10-21swapper/109:37:271
149940,0migration/03699-21kthreadcore08:52:300
149940,0migration/029058-21taskset09:08:470
149940,0migration/02745-21kthreadcore08:07:320
149940,0migration/026090-21taskset11:19:100
149940,0migration/020331-21kthreadcore10:02:300
149940,0migration/018934-21kthreadcore10:57:310
149940,0migration/017110-21kthreadcore10:37:300
149940,0migration/016939-21kthreadcore07:52:300
149940,0migration/011065-21kthreadcore10:52:310
329930,0watchdog/30-21swapper/307:37:153
329930,0watchdog/30-21swapper/307:32:233
29815030,0irq/29-eth0-tx-0-21swapper/008:47:230
29805030,0irq/28-eth0-rx-0-21swapper/309:07:373
29805030,0irq/28-eth0-rx-0-21swapper/307:57:233
253539932,0cyclictest21235-21sensors08:17:352
253539930,0cyclictest31696-21ntp_states08:02:312
253529932,0cyclictest8384-21grep08:32:301
253529932,0cyclictest7713-21cut10:12:311
253529932,0cyclictest3571-21lldpd10:32:191
253529932,0cyclictest30989-21aten2.4-expect09:32:241
253519933,0cyclictest8920-21kworker/0:212:22:300
253519933,0cyclictest28080-21kworker/0:210:26:100
253519930,0cyclictest0-21swapper/008:57:240
253519930,0cyclictest0-21swapper/007:37:120
169930,0watchdog/10-21swapper/111:37:281
169930,0watchdog/10-21swapper/111:27:281
169930,0watchdog/10-21swapper/111:22:241
169930,0watchdog/10-21swapper/111:08:481
169930,0watchdog/10-21swapper/110:02:191
169930,0watchdog/10-21swapper/109:02:231
169930,0watchdog/10-21swapper/108:57:311
169930,0watchdog/10-21swapper/107:32:231
253539920,0cyclictest32725-21latency_hist07:22:122
253529920,0cyclictest0-21swapper/111:57:131
249920,0watchdog/20-21swapper/208:52:152
169920,0watchdog/10-21swapper/108:42:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional