You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 13:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Thu Dec 25, 2025 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2994824233,0sleep10-21swapper/107:08:541
2988523928,0sleep30-21swapper/307:08:123
2993323826,0sleep20-21swapper/207:08:472
2995223624,0sleep00-21swapper/007:08:570
8305060,0irq/26-0000:00:19856-21sh08:56:033
35160,0ktimersoftd/30-21swapper/312:38:223
339960,0migration/39579-21sh10:38:493
339960,0migration/33849-21aten_r1power_vo10:01:173
339960,0migration/332688-21sh12:03:153
339960,0migration/330028-21kthreadcore09:56:213
339960,0migration/329879-21sh09:36:433
339960,0migration/327222-21sh12:18:123
339960,0migration/311057-21kthreadcore09:11:223
329960,0watchdog/3951-21kthreadcore12:21:233
302079960,0cyclictest0-21swapper/211:30:452
302049960,0cyclictest0-21swapper/009:26:170
29815060,0irq/29-eth0-tx-9051-21munin-node07:41:200
29805060,0irq/28-eth0-rx-7730-21df_inode10:21:193
29805060,0irq/28-eth0-rx-7211-21kthreadcore09:26:223
29805060,0irq/28-eth0-rx-15618-21iostat_ios11:01:223
4150,0ktimersoftd/00-21swapper/009:53:080
4150,0ktimersoftd/00-21swapper/009:34:570
339950,0migration/37679-21munin-node07:36:223
339950,0migration/33611-21kthreadcore08:21:233
339950,0migration/327246-21latency_hist09:01:043
339950,0migration/326922-21latency_hist07:31:033
339950,0migration/325153-21kthreadcore10:11:233
339950,0migration/324412-21sendmail_mailqu09:51:253
339950,0migration/321946-21sh12:33:263
339950,0migration/32062-21kthreadcore09:41:213
339950,0migration/313975-21runrttasks11:00:503
339950,0migration/31357-21taskset08:17:543
339950,0migration/313516-21munin-node07:21:203
329950,0watchdog/36115-21fschecks_count08:01:193
329950,0watchdog/332299-21kthreadcore07:56:193
329950,0watchdog/327459-21cat10:31:233
329950,0watchdog/327026-21munin-node11:26:153
329950,0watchdog/325502-21kthreadcore11:41:193
329950,0watchdog/320089-21munin-node08:56:233
329950,0watchdog/317614-21ssh12:11:393
329950,0watchdog/314553-21fschecks_time09:31:193
329950,0watchdog/312663-21taskset10:06:073
329950,0watchdog/30-21swapper/312:26:243
329950,0watchdog/30-21swapper/310:46:353
302079955,0cyclictest9164-21diskmemload11:49:212
302079955,0cyclictest0-21swapper/209:53:102
302079950,0cyclictest0-21swapper/210:23:352
302079950,0cyclictest0-21swapper/209:15:292
302059955,0cyclictest0-21swapper/111:56:191
302059955,0cyclictest0-21swapper/110:51:311
302059955,0cyclictest0-21swapper/110:47:161
302059950,0cyclictest0-21swapper/111:36:371
302059950,0cyclictest0-21swapper/110:07:231
302059950,0cyclictest0-21swapper/109:43:531
302059950,0cyclictest0-21swapper/109:28:071
302049955,0cyclictest0-21swapper/011:06:140
302049955,0cyclictest0-21swapper/010:50:090
302049955,0cyclictest0-21swapper/010:09:290
302049955,0cyclictest0-21swapper/009:57:300
302049955,0cyclictest0-21swapper/009:17:180
302049955,0cyclictest0-21swapper/007:51:320
302049950,0cyclictest0-21swapper/012:25:230
302049950,0cyclictest0-21swapper/011:12:420
302049950,0cyclictest0-21swapper/010:21:370
302049950,0cyclictest0-21swapper/010:03:480
302049950,0cyclictest0-21swapper/009:49:460
29815050,0irq/29-eth0-tx-5419-21munin-node10:56:172
29815050,0irq/29-eth0-tx-32018-21munin-run12:41:052
29815050,0irq/29-eth0-tx-21716-21munin-node10:11:272
29815050,0irq/29-eth0-tx-20089-21munin-node08:56:290
29815050,0irq/29-eth0-tx-16361-21munin-node08:31:270
29815050,0irq/29-eth0-tx-13281-21kthreadcore09:46:212
29815050,0irq/29-eth0-tx-10840-21munin-node12:11:192
29815050,0irq/29-eth0-tx-10644-21open_files09:26:252
29815050,0irq/29-eth0-tx-10569-21ssh10:01:432
29815050,0irq/29-eth0-tx-0-21swapper/211:08:412
29815050,0irq/29-eth0-tx-0-21swapper/210:08:202
29815050,0irq/29-eth0-tx-0-21swapper/209:37:092
29815050,0irq/29-eth0-tx-0-21swapper/209:21:022
29815050,0irq/29-eth0-tx-0-21swapper/007:33:450
29805050,0irq/28-eth0-rx-9867-21fschecks_time11:16:193
29805050,0irq/28-eth0-rx-7788-21tune2fs11:51:193
29805050,0irq/28-eth0-rx-2731-21gltestperf12:06:173
29805050,0irq/28-eth0-rx-23721-21ssh11:58:123
29805050,0irq/28-eth0-rx-10365-21unixbench_multi11:31:313
29805050,0irq/28-eth0-rx-0-21swapper/311:46:233
29805050,0irq/28-eth0-rx-0-21swapper/311:23:283
29805050,0irq/28-eth0-rx-0-21swapper/311:07:033
29805050,0irq/28-eth0-rx-0-21swapper/310:53:533
29805050,0irq/28-eth0-rx-0-21swapper/310:43:153
29805050,0irq/28-eth0-rx-0-21swapper/310:29:073
259950,0migration/228554-21sh11:41:562
259950,0migration/220667-21kthreadcore08:31:212
259950,0migration/215085-21needreboot08:26:222
259950,0migration/214788-21sh09:31:192
249950,0watchdog/20-21swapper/207:46:232
19150,0ktimersoftd/19164-21diskmemload10:36:551
179950,0migration/19800-21fschecks_time07:41:161
179950,0migration/129385-21kthreadcore11:26:201
179950,0migration/123455-21kthreadcore09:51:221
179950,0migration/123013-21irqcore10:11:221
179950,0migration/114411-21aten_r1power_cu12:31:171
179950,0migration/114289-21kernelversion08:06:191
179950,0migration/110920-21kthreadcore09:46:211
179950,0migration/110919-21irqrtprio09:11:211
169950,0watchdog/16882-21cut12:26:241
149950,0migration/09316-21kthreadcore08:46:220
149950,0migration/05985-21kthreadcore11:31:220
149950,0migration/03039-21kthreadcore09:41:220
149950,0migration/02733-21sendmail_mailtr10:51:250
149950,0migration/025749-21fschecks_count12:01:190
149950,0migration/025398-21kthreadcore12:36:220
149950,0migration/024223-21if_eth109:36:200
149950,0migration/02334-21fschecks_count10:36:170
149950,0migration/022604-21sh11:04:550
149950,0migration/019031-21sh12:15:000
149950,0migration/011828-21switchtime12:26:320
149950,0migration/010385-21munin-node08:26:190
8305040,0irq/26-0000:00:0-21swapper/309:11:043
8305040,0irq/26-0000:00:0-21swapper/307:41:033
339940,0migration/327593-21aten_r1power_fr09:21:153
339940,0migration/320535-21fschecks_time07:26:173
339940,0migration/319276-21diskmemload09:16:183
339940,0migration/318579-21kthreadcore08:31:203
339940,0migration/312785-21sh08:06:133
329940,0watchdog/323496-21aten_r1power_en07:51:153
329940,0watchdog/30-21swapper/311:11:433
329940,0watchdog/30-21swapper/309:46:193
302079943,0cyclictest3571-21lldpd07:11:562
302079943,0cyclictest3250-21irqbalance10:51:312
302079943,0cyclictest3250-21irqbalance07:31:102
302079943,0cyclictest3250-21irqbalance07:17:002
302079943,0cyclictest31872-21awk08:41:202
302079943,0cyclictest29876-21awk12:21:212
302079943,0cyclictest2794-21awk07:36:192
302079943,0cyclictest15470-21awk12:31:212
302079943,0cyclictest10155-21awk11:16:212
302059944,0cyclictest0-21swapper/112:19:011
302059944,0cyclictest0-21swapper/110:02:481
302059943,0cyclictest6598-21awk08:01:211
302059943,0cyclictest3524-21snmpd09:36:361
302059943,0cyclictest3524-21snmpd07:36:201
302059943,0cyclictest3524-21snmpd07:26:201
302059943,0cyclictest31922-21awk08:41:201
302059943,0cyclictest28353-21awk09:01:191
302059943,0cyclictest15461-21awk11:01:211
302059943,0cyclictest11939-21awk12:11:191
302059943,0cyclictest1035-21awk11:11:191
302049943,0cyclictest3571-21lldpd08:19:550
302049943,0cyclictest3524-21snmpd11:27:230
302049943,0cyclictest3270-21awk09:06:180
302049943,0cyclictest3250-21irqbalance11:55:310
302049943,0cyclictest3250-21irqbalance10:12:300
302049943,0cyclictest3250-21irqbalance08:44:000
302049943,0cyclictest3250-21irqbalance08:36:200
302049943,0cyclictest3250-21irqbalance07:36:100
302049943,0cyclictest2990-21awk12:06:190
302049943,0cyclictest29426-21kworker/0:111:44:460
302049943,0cyclictest28636-21awk09:21:190
302049943,0cyclictest26361-21awk10:31:210
302049943,0cyclictest13830-21awk08:06:180
302049943,0cyclictest13786-21awk11:36:190
302049943,0cyclictest12287-21sadc07:21:040
29815040,0irq/29-eth0-tx-9384-21ssh09:11:040
29815040,0irq/29-eth0-tx-3616-21ssh11:31:052
29815040,0irq/29-eth0-tx-3534-21sshd08:24:360
29815040,0irq/29-eth0-tx-28206-21fschecks_time09:21:172
29815040,0irq/29-eth0-tx-27981-21kthreadcore12:01:242
29815040,0irq/29-eth0-tx-23357-21kthreadcore10:46:212
29815040,0irq/29-eth0-tx-17987-21ssh11:21:122
29815040,0irq/29-eth0-tx-0-21swapper/212:16:532
29815040,0irq/29-eth0-tx-0-21swapper/211:37:162
29815040,0irq/29-eth0-tx-0-21swapper/211:11:122
29815040,0irq/29-eth0-tx-0-21swapper/210:31:172
29815040,0irq/29-eth0-tx-0-21swapper/210:26:152
29815040,0irq/29-eth0-tx-0-21swapper/210:16:152
29815040,0irq/29-eth0-tx-0-21swapper/209:41:532
29815040,0irq/29-eth0-tx-0-21swapper/009:01:150
29815040,0irq/29-eth0-tx-0-21swapper/008:51:160
29815040,0irq/29-eth0-tx-0-21swapper/008:11:210
29815040,0irq/29-eth0-tx-0-21swapper/008:03:500
29815040,0irq/29-eth0-tx-0-21swapper/007:46:160
29815040,0irq/29-eth0-tx-0-21swapper/007:26:180
29805040,0irq/28-eth0-rx-0-21swapper/311:36:283
29805040,0irq/28-eth0-rx-0-21swapper/310:16:293
259940,0migration/29744-21kthreadcore11:51:232
259940,0migration/25131-21kthreadcore09:06:202
259940,0migration/232665-21kthreadcore09:01:212
259940,0migration/230293-21runrttasks08:38:232
259940,0migration/22588-21fschecks_time12:06:172
259940,0migration/222920-21kthreadcore08:56:222
259940,0migration/221553-21kthreadcore07:26:202
259940,0migration/218851-21kthreadcore11:56:212
259940,0migration/212655-21latency_hist08:06:032
259940,0migration/212517-21kthreadcore10:41:212
259940,0migration/21143-21kthreadcore07:56:192
249940,0watchdog/26883-21sed12:26:242
249940,0watchdog/26652-21hwlatdetect08:46:192
249940,0watchdog/2628-21needreboot09:56:232
249940,0watchdog/226469-21yum08:11:312
249940,0watchdog/223495-21aten_r1power_en07:51:152
249940,0watchdog/220760-21sensors11:01:272
249940,0watchdog/21877-21aten_r1power_po10:36:152
249940,0watchdog/214951-21kthreadcore07:21:222
249940,0watchdog/20-21swapper/208:01:192
179940,0migration/19183-21aten_r1power_vo11:16:171
179940,0migration/18990-21latency_hist08:26:031
179940,0migration/15379-21kthreadcore12:06:211
179940,0migration/132176-21crond12:02:051
179940,0migration/130864-21kthreadcore09:21:211
179940,0migration/123556-21kthreadcore09:16:221
179940,0migration/123209-21taskset08:34:461
179940,0migration/123123-21kthreadcore08:56:221
179940,0migration/12172-21aten_r1power_fr09:06:141
179940,0migration/112307-21runrttasks08:47:241
169940,0watchdog/18641-21irqcore10:21:231
169940,0watchdog/14145-21ssh12:23:511
169940,0watchdog/130526-21taskset11:07:271
169940,0watchdog/130100-21ssh12:36:361
169940,0watchdog/125501-21kthreadcore11:41:191
169940,0watchdog/121234-21kthreadcore07:46:231
169940,0watchdog/121048-21ssh09:32:271
169940,0watchdog/116216-21ssh10:26:071
169940,0watchdog/113002-21tune2fs07:21:181
169940,0watchdog/112551-21kthreadcore11:51:231
169940,0watchdog/111868-21ssh11:34:471
169940,0watchdog/10-21swapper/110:31:231
169940,0watchdog/10-21swapper/109:56:191
149940,0migration/08163-21kthreadcore10:56:220
149940,0migration/05220-21sh11:47:040
149940,0migration/03384-21kthreadcore10:16:220
149940,0migration/03125-21kthreadcore07:56:200
149940,0migration/020542-21kthreadcore11:56:220
149940,0migration/017328-21timerandwakeup10:41:290
149940,0migration/014887-21fschecks_count12:31:190
149940,0migration/012676-21aten2.4-expect07:21:170
339930,0migration/35170-21runrttasks08:43:093
329930,0watchdog/30-21swapper/308:46:193
329930,0watchdog/30-21swapper/308:36:073
329930,0watchdog/30-21swapper/308:26:153
302079933,0cyclictest0-21swapper/208:21:342
302079932,0cyclictest28139-21awk08:16:192
302079932,0cyclictest13918-21awk08:51:192
302079932,0cyclictest10084-21awk07:41:172
302059933,0cyclictest13933-21awk08:51:191
302059932,0cyclictest5861-21diskstats10:56:181
302059932,0cyclictest31715-21awk07:56:171
302059932,0cyclictest27057-21ls08:16:031
302059932,0cyclictest22147-21kthreadcore08:11:211
302059932,0cyclictest14348-21cut08:26:211
302059930,0cyclictest24294-21perl08:36:161
302059930,0cyclictest14342-21kthreadcore10:41:221
302049933,0cyclictest29426-21kworker/0:112:16:060
302049933,0cyclictest29426-21kworker/0:111:21:070
302049933,0cyclictest29426-21kworker/0:110:26:170
302049930,0cyclictest9772-21perl11:16:190
29815030,0irq/29-eth0-tx-0-21swapper/007:11:140
29805030,0irq/28-eth0-rx-0-21swapper/308:11:153
29805030,0irq/28-eth0-rx-0-21swapper/307:46:163
29805030,0irq/28-eth0-rx-0-21swapper/307:16:153
29805030,0irq/28-eth0-rx-0-21swapper/307:12:243
179930,0migration/14868-21runrttasks07:14:011
169930,0watchdog/10-21swapper/111:46:231
169930,0watchdog/10-21swapper/111:21:191
169930,0watchdog/10-21swapper/110:16:191
169930,0watchdog/10-21swapper/107:51:151
169930,0watchdog/10-21swapper/107:31:181
169930,0watchdog/10-21swapper/107:16:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional