You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 23:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Sat Apr 11, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2590523829,0sleep20-21swapper/207:19:542
2579423829,0sleep10-21swapper/107:18:441
2514823727,0sleep30-21swapper/307:15:183
2553423026,0sleep00-21swapper/007:15:430
4160,0ktimersoftd/019065-21ssh12:32:580
339960,0migration/332012-21sh10:49:503
339960,0migration/33175-21munin-node12:25:103
339960,0migration/330131-21sh09:32:083
339960,0migration/318464-21sh11:17:353
29815060,0irq/29-eth0-tx-972-21munin-node07:25:190
29805060,0irq/28-eth0-rx-31284-21sh12:01:333
29805060,0irq/28-eth0-rx-30217-21df07:45:093
29805060,0irq/28-eth0-rx-2179-21munin-node11:10:203
29805060,0irq/28-eth0-rx-17774-21sensors_temp12:30:213
29805060,0irq/28-eth0-rx-13118-21users10:35:253
29805060,0irq/28-eth0-rx-10280-21irqstats10:55:143
259789960,0cyclictest0-21swapper/212:25:092
259779960,0cyclictest0-21swapper/109:50:181
259769965,0cyclictest16135-21grep08:20:100
259769960,0cyclictest0-21swapper/010:09:110
259769960,0cyclictest0-21swapper/008:35:130
179960,0migration/110934-21sh12:29:131
149960,0migration/01300-21kthreadcore09:35:140
4150,0ktimersoftd/00-21swapper/011:56:110
4150,0ktimersoftd/00-21swapper/011:29:350
4150,0ktimersoftd/00-21swapper/010:29:120
339950,0migration/37858-21sh10:53:223
339950,0migration/36924-21kthreadcore09:20:133
339950,0migration/34908-21kthreadcore09:55:153
339950,0migration/33616-21kthreadcore12:05:153
339950,0migration/331834-21kthreadcore11:25:153
339950,0migration/331583-21taskset09:35:063
339950,0migration/329324-21taskset07:41:083
339950,0migration/326282-21taskset08:48:533
339950,0migration/326100-21diskmemload10:05:423
339950,0migration/325679-21aten_r1power_en09:50:093
339950,0migration/32291-21missed_timers12:40:163
339950,0migration/319518-21latency_hist11:19:573
339950,0migration/317229-21munin-node08:20:143
339950,0migration/317131-21irqcore09:05:133
339950,0migration/313505-21cpuspeed_turbos11:35:103
339950,0migration/313226-21taskset12:49:243
339950,0migration/31280-21latency_hist08:54:563
329950,0watchdog/35412-21perl11:30:123
329950,0watchdog/326146-21kthreadcore08:25:153
329950,0watchdog/322113-21kthreadcore12:15:163
329950,0watchdog/314204-21cut09:00:153
329950,0watchdog/310572-21python10:15:203
329950,0watchdog/30-21swapper/308:30:153
29815050,0irq/29-eth0-tx-9113-21df_abs10:55:102
29815050,0irq/29-eth0-tx-9070-21ssh09:56:282
29815050,0irq/29-eth0-tx-6785-21ssh09:37:172
29815050,0irq/29-eth0-tx-3552-21lldpd12:02:402
29815050,0irq/29-eth0-tx-27923-21awk11:24:542
29815050,0irq/29-eth0-tx-27483-21ssh10:09:352
29815050,0irq/29-eth0-tx-22728-21munin-node09:30:102
29815050,0irq/29-eth0-tx-17772-21ssh12:15:062
29815050,0irq/29-eth0-tx-15510-21grep09:25:142
29815050,0irq/29-eth0-tx-1398-21munin-node08:55:180
29815050,0irq/29-eth0-tx-12370-21ssh11:33:202
29815050,0irq/29-eth0-tx-11440-21ssh12:30:002
29815050,0irq/29-eth0-tx-0-21swapper/211:55:392
29815050,0irq/29-eth0-tx-0-21swapper/008:28:460
29805050,0irq/28-eth0-rx-4737-21kthreadcore08:55:143
29805050,0irq/28-eth0-rx-4732-21date07:49:563
29805050,0irq/28-eth0-rx-4169-21kthreadcore07:25:143
29805050,0irq/28-eth0-rx-32043-21ntpq11:05:173
29805050,0irq/28-eth0-rx-22769-21kthreadcore12:35:143
29805050,0irq/28-eth0-rx-21259-21proc_pri10:40:183
29805050,0irq/28-eth0-rx-17062-21switchtime10:00:223
29805050,0irq/28-eth0-rx-14684-21kthreadcore10:20:143
29805050,0irq/28-eth0-rx-14399-21proc_pri07:30:173
29805050,0irq/28-eth0-rx-0-21swapper/312:21:443
29805050,0irq/28-eth0-rx-0-21swapper/311:55:123
29805050,0irq/28-eth0-rx-0-21swapper/311:51:283
29805050,0irq/28-eth0-rx-0-21swapper/311:43:263
29805050,0irq/28-eth0-rx-0-21swapper/311:02:023
29805050,0irq/28-eth0-rx-0-21swapper/310:32:083
29805050,0irq/28-eth0-rx-0-21swapper/310:29:433
29805050,0irq/28-eth0-rx-0-21swapper/309:40:143
27150,0ktimersoftd/20-21swapper/210:29:122
259789955,0cyclictest83050irq/26-0000:00:10:50:402
259789955,0cyclictest0-21swapper/211:17:302
259789950,0cyclictest0-21swapper/209:47:572
259779955,0cyclictest0-21swapper/111:02:591
259779955,0cyclictest0-21swapper/110:21:031
259779950,0cyclictest0-21swapper/112:39:001
259779950,0cyclictest0-21swapper/112:02:251
259779950,0cyclictest0-21swapper/111:45:331
259779950,0cyclictest0-21swapper/110:25:281
259769955,0cyclictest0-21swapper/012:37:510
259769955,0cyclictest0-21swapper/009:55:380
259769954,0cyclictest3858-21ps11:10:180
259769950,0cyclictest0-21swapper/012:16:150
259950,0migration/24430-21kthreadcore08:55:142
259950,0migration/22985-21fschecks_time11:10:142
259950,0migration/226786-21sh12:35:232
179950,0migration/16913-21kthreadcore08:55:151
179950,0migration/115521-21sh10:55:451
179950,0migration/115339-21kthreadcore11:35:151
169950,0watchdog/131916-21cat11:05:161
169950,0watchdog/121861-21kthreadcore08:45:151
149950,0migration/09723-21kthreadcore12:45:160
149950,0migration/08318-21taskset10:54:400
149950,0migration/07184-21kthreadcore07:50:140
149950,0migration/03963-21munin-node08:30:200
149950,0migration/03241-21kthreadcore09:15:150
149950,0migration/032388-21kthreadcore10:10:150
149950,0migration/030363-21latency_hist11:44:570
149950,0migration/027123-21fschecks_count08:50:100
149950,0migration/026145-21taskset08:04:400
149950,0migration/025693-21aten_r1power_en09:50:090
149950,0migration/025211-21kthreadcore11:20:140
149950,0migration/023984-21sh09:46:090
149950,0migration/020430-21sh10:22:560
149950,0migration/019269-21kthreadcore07:35:150
149950,0migration/015403-21irqrtprio09:25:140
149950,0migration/015297-21taskset08:18:130
149950,0migration/015297-21taskset08:18:130
149950,0migration/015237-21kthreadcore07:55:140
149950,0migration/013368-21kthreadcore09:40:140
149950,0migration/012382-21munin-node10:35:170
149950,0migration/012068-21kthreadcore07:30:140
149950,0migration/011267-21df_abs11:15:100
149950,0migration/011099-21kthreadcore09:00:140
149950,0migration/011053-21taskset12:29:350
149950,0migration/010939-21kthreadcore12:10:130
149950,0migration/010282-21sh10:55:140
339940,0migration/332133-21kthreadcore09:15:143
339940,0migration/317897-21kthreadcore08:40:163
339940,0migration/313976-21kthreadcore07:55:143
329940,0watchdog/312910-21kthreadcore08:15:153
329940,0watchdog/312910-21kthreadcore08:15:153
329940,0watchdog/30-21swapper/310:10:163
329940,0watchdog/30-21swapper/309:10:073
29815040,0irq/29-eth0-tx-301-21ssh12:05:032
29815040,0irq/29-eth0-tx-28193-21ssh11:25:032
29815040,0irq/29-eth0-tx-27860-21ssh10:10:002
29815040,0irq/29-eth0-tx-0-21swapper/212:20:092
29815040,0irq/29-eth0-tx-0-21swapper/211:50:032
29815040,0irq/29-eth0-tx-0-21swapper/211:40:442
29815040,0irq/29-eth0-tx-0-21swapper/211:35:112
29815040,0irq/29-eth0-tx-0-21swapper/211:04:592
29815040,0irq/29-eth0-tx-0-21swapper/210:45:062
29815040,0irq/29-eth0-tx-0-21swapper/210:30:012
29815040,0irq/29-eth0-tx-0-21swapper/210:20:352
29815040,0irq/29-eth0-tx-0-21swapper/209:40:092
29805040,0irq/28-eth0-rx-5941-21hwlatdetect08:35:103
29805040,0irq/28-eth0-rx-0-21swapper/312:10:303
29805040,0irq/28-eth0-rx-0-21swapper/311:45:093
29805040,0irq/28-eth0-rx-0-21swapper/309:45:093
29805040,0irq/28-eth0-rx-0-21swapper/309:25:033
29805040,0irq/28-eth0-rx-0-21swapper/308:05:093
29805040,0irq/28-eth0-rx-0-21swapper/307:20:133
259789944,0cyclictest0-21swapper/208:25:212
259789943,0cyclictest3571-21lldpd09:50:082
259789943,0cyclictest3571-21lldpd09:22:072
259789943,0cyclictest3571-21lldpd08:45:072
259789943,0cyclictest3571-21lldpd07:40:372
259789943,0cyclictest3250-21irqbalance10:41:232
259789943,0cyclictest3250-21irqbalance10:35:032
259789943,0cyclictest3250-21irqbalance09:13:332
259789943,0cyclictest3250-21irqbalance09:01:032
259789943,0cyclictest3250-21irqbalance08:40:532
259789943,0cyclictest3250-21irqbalance08:35:432
259789943,0cyclictest3250-21irqbalance08:20:032
259789943,0cyclictest3250-21irqbalance08:15:032
259789943,0cyclictest3250-21irqbalance08:15:032
259789943,0cyclictest2132-21awk07:25:122
259789943,0cyclictest18492-21awk11:00:132
259789943,0cyclictest11809-21awk10:00:132
259779944,0cyclictest0-21swapper/111:50:081
259779944,0cyclictest0-21swapper/110:49:261
259779944,0cyclictest0-21swapper/109:32:111
259779943,0cyclictest7558-21awk10:35:141
259779943,0cyclictest3571-21lldpd11:11:091
259779943,0cyclictest3571-21lldpd10:04:371
259779943,0cyclictest3571-21lldpd07:46:071
259779943,0cyclictest3524-21snmpd09:00:511
259779943,0cyclictest3524-21snmpd08:37:211
259779943,0cyclictest3524-21snmpd07:51:511
259779943,0cyclictest2084-21awk07:25:121
259779943,0cyclictest20371-21awk08:00:141
259779943,0cyclictest1467-21awk12:05:121
259769944,0cyclictest0-21swapper/012:42:070
259769943,0cyclictest5670-21awk11:30:140
259769943,0cyclictest3571-21lldpd12:22:100
259769943,0cyclictest3571-21lldpd11:52:400
259769943,0cyclictest3524-21snmpd12:09:090
259769943,0cyclictest3524-21snmpd10:49:230
259769943,0cyclictest3250-21irqbalance11:05:130
259769943,0cyclictest27341-21awk07:20:120
259769943,0cyclictest2392-21awk08:10:140
259769943,0cyclictest0-21swapper/009:10:080
259940,0migration/26158-21kthreadcore08:10:162
259940,0migration/25840-21fschecks_time12:45:122
259940,0migration/231139-21kthreadcore07:20:142
259940,0migration/230723-21fschecks_time07:45:112
259940,0migration/230419-21latency_hist11:44:572
259940,0migration/228016-21munin-node08:50:132
259940,0migration/22736-21kthreadcore09:15:152
259940,0migration/221455-21kthreadcore08:00:162
259940,0migration/218777-21kthreadcore07:35:152
259940,0migration/218071-21kthreadcore09:05:132
259940,0migration/213803-21kthreadcore07:55:142
259940,0migration/211509-21kthreadcore12:10:142
259940,0migration/210975-21runrttasks10:15:302
259940,0migration/210694-21kthreadcore07:30:142
259940,0migration/210009-21kthreadcore07:50:142
249940,0watchdog/232188-21cat08:30:152
249940,0watchdog/231558-21kthreadcore08:05:152
249940,0watchdog/20-21swapper/212:40:082
179940,0migration/15812-21fschecks_time12:45:121
179940,0migration/14634-21kthreadcore09:55:151
179940,0migration/131511-21kthreadcore08:50:151
179940,0migration/128129-21kthreadcore07:20:131
179940,0migration/127275-21kthreadcore07:40:141
179940,0migration/126840-21sh11:21:551
179940,0migration/124744-21kthreadcore08:25:151
179940,0migration/118627-21kthreadcore11:55:151
179940,0migration/11721-21kthreadcore09:15:151
179940,0migration/116921-21runrttasks09:44:581
179940,0migration/114760-21fschecks_time09:25:111
179940,0migration/114565-21kthreadcore08:40:151
179940,0migration/114194-21kthreadcore07:55:141
169940,0watchdog/1696-21kthreadcore10:10:161
169940,0watchdog/1349-21python12:20:201
169940,0watchdog/13344-21kthreadcore08:10:151
169940,0watchdog/131557-21kthreadcore08:05:151
169940,0watchdog/12692-21ssh11:25:481
169940,0watchdog/124698-21kthreadcore11:40:161
169940,0watchdog/119890-21kthreadcore08:20:151
169940,0watchdog/115761-21kthreadcore11:15:161
169940,0watchdog/114687-21sensors08:15:191
169940,0watchdog/114687-21sensors08:15:191
169940,0watchdog/110301-21cat12:10:121
169940,0watchdog/10-21swapper/112:40:081
169940,0watchdog/10-21swapper/110:51:161
169940,0watchdog/10-21swapper/109:10:071
169940,0watchdog/10-21swapper/107:35:151
149940,0migration/05272-21aten2.4-expect09:20:070
149940,0migration/04220-21timerandwakeup10:30:210
149940,0migration/025681-21kthreadcore09:30:150
149940,0migration/025655-21irqrtprio12:00:150
149940,0migration/025355-21kthreadcore07:40:140
149940,0migration/021850-21kthreadcore08:45:150
149940,0migration/018482-21switchtime08:40:220
149940,0migration/01786-21kthreadcore11:45:140
149940,0migration/013409-21aten2.4-expect11:35:090
329930,0watchdog/30-21swapper/308:00:113
329930,0watchdog/30-21swapper/307:35:153
259779932,0cyclictest9197-21grep07:30:101
259779932,0cyclictest5426-21awk10:15:121
259779932,0cyclictest3571-21lldpd09:42:371
259779932,0cyclictest3571-21lldpd09:20:381
259779932,0cyclictest16111-21awk10:40:121
259779932,0cyclictest12619-21awk12:30:141
259769933,0cyclictest17973-21kworker/0:107:45:010
259769933,0cyclictest14889-21kworker/0:110:59:580
259769933,0cyclictest14889-21kworker/0:110:40:040
259769933,0cyclictest14889-21kworker/0:110:14:580
259769933,0cyclictest14889-21kworker/0:110:00:060
259769932,0cyclictest3571-21lldpd08:05:070
259769930,0cyclictest16727-21perl09:05:100
179930,0migration/1947-21kthreadcore10:30:141
179930,0migration/121143-21kthreadcore12:15:161
179930,0migration/117890-21kthreadcore09:05:131
169930,0watchdog/10-21swapper/111:30:161
169930,0watchdog/10-21swapper/110:05:161
169930,0watchdog/10-21swapper/109:35:111
169930,0watchdog/10-21swapper/108:30:151
329920,0watchdog/30-21swapper/308:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional