You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-14 - 16:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Sun Dec 14, 2025 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1438425150,0sleep10-21swapper/107:09:521
1410824131,0sleep30-21swapper/307:06:383
1420823526,0sleep20-21swapper/207:07:492
1438323228,0sleep00-21swapper/007:09:510
8305060,0irq/26-0000:00:31988-21if_eth1.312:25:242
339960,0migration/33129-21sendmail_mailqu08:05:293
339960,0migration/330087-21sh10:02:013
339960,0migration/323520-21sh12:00:333
339960,0migration/321803-21sh09:25:133
339960,0migration/321333-21sh09:24:433
339960,0migration/319614-21sh11:41:003
329960,0watchdog/332630-21tr11:30:273
329960,0watchdog/328751-21ssh12:21:273
29815060,0irq/29-eth0-tx-4306-21ssh10:25:212
29805060,0irq/28-eth0-rx-9874-21swap11:35:333
29805060,0irq/28-eth0-rx-3253-21diskstats09:15:223
29805060,0irq/28-eth0-rx-19309-21netstat10:30:283
29805060,0irq/28-eth0-rx-1305-21grep09:30:263
29805060,0irq/28-eth0-rx-0-21swapper/310:51:153
149960,0migration/02469-21sh09:47:100
149960,0migration/020988-21taskset09:24:010
149960,0migration/012402-21sh11:04:300
8305050,0irq/26-0000:00:14834-21pmu-power09:35:302
339950,0migration/37999-21munin-node08:35:203
339950,0migration/35235-21kthreadcore07:45:253
339950,0migration/33494-21kthreadcore11:15:273
339950,0migration/330262-21munin-node07:20:263
339950,0migration/329711-21aten_r1power_vo08:50:223
339950,0migration/329350-21sh10:35:553
339950,0migration/328073-21munin-node07:15:313
339950,0migration/327958-21kthreadcore09:10:263
339950,0migration/323646-21proc_pri11:25:313
339950,0migration/323565-21sh12:35:383
339950,0migration/322473-21cpuspeed_turbos11:10:213
339950,0migration/321822-21kthreadcore07:35:263
339950,0migration/315870-21fschecks_time08:40:223
339950,0migration/313150-21kthreadcore07:30:263
339950,0migration/310818-21kthreadcore10:45:283
329950,0watchdog/330212-21kthreadcore07:40:263
329950,0watchdog/326279-21forks08:25:223
329950,0watchdog/315999-21rm10:11:433
329950,0watchdog/30-21swapper/310:25:353
329950,0watchdog/30-21swapper/309:00:343
29815050,0irq/29-eth0-tx-534-21kthreadcore09:30:262
29815050,0irq/29-eth0-tx-3610-21diskstats12:10:222
29815050,0irq/29-eth0-tx-3408-21munin-node11:35:292
29815050,0irq/29-eth0-tx-29065-21munin-node07:20:320
29815050,0irq/29-eth0-tx-26356-21munin-node12:05:212
29815050,0irq/29-eth0-tx-24323-21grep10:50:352
29815050,0irq/29-eth0-tx-22365-21munin-node08:45:290
29815050,0irq/29-eth0-tx-18141-21munin-node09:40:232
29815050,0irq/29-eth0-tx-17184-21ssh10:49:382
29815050,0irq/29-eth0-tx-15851-21ssh10:11:242
29815050,0irq/29-eth0-tx-14686-21munin-node07:10:160
29815050,0irq/29-eth0-tx-0-21swapper/211:53:132
29815050,0irq/29-eth0-tx-0-21swapper/210:08:432
29815050,0irq/29-eth0-tx-0-21swapper/008:40:210
29815050,0irq/29-eth0-tx-0-21swapper/008:20:350
29805050,0irq/28-eth0-rx-4432-21cpu09:50:213
29805050,0irq/28-eth0-rx-31872-21grep11:50:213
29805050,0irq/28-eth0-rx-15910-21cut07:55:223
29805050,0irq/28-eth0-rx-15791-21ssh09:36:213
29805050,0irq/28-eth0-rx-1386-21kthreadcore10:40:243
29805050,0irq/28-eth0-rx-13140-21cut11:05:213
29805050,0irq/28-eth0-rx-0-21swapper/312:30:203
29805050,0irq/28-eth0-rx-0-21swapper/312:25:223
29805050,0irq/28-eth0-rx-0-21swapper/312:16:593
29805050,0irq/28-eth0-rx-0-21swapper/312:11:133
29805050,0irq/28-eth0-rx-0-21swapper/312:07:203
29805050,0irq/28-eth0-rx-0-21swapper/311:45:173
29805050,0irq/28-eth0-rx-0-21swapper/311:20:233
29805050,0irq/28-eth0-rx-0-21swapper/311:00:243
29805050,0irq/28-eth0-rx-0-21swapper/310:56:553
29805050,0irq/28-eth0-rx-0-21swapper/310:20:223
29805050,0irq/28-eth0-rx-0-21swapper/310:20:223
29805050,0irq/28-eth0-rx-0-21swapper/310:05:233
29805050,0irq/28-eth0-rx-0-21swapper/309:46:193
29805050,0irq/28-eth0-rx-0-21swapper/308:10:273
259950,0migration/27791-21aten_r1power_po12:30:202
259950,0migration/229995-21munin-node08:50:232
259950,0migration/225302-21sh10:16:562
259950,0migration/221123-21sh09:57:352
259950,0migration/220270-21sh11:06:452
249950,0watchdog/232632-21tr11:30:272
249950,0watchdog/229346-21grep09:45:272
179950,0migration/19293-21kthreadcore07:50:251
179950,0migration/18100-21kthreadcore08:55:261
179950,0migration/16965-21sh11:53:411
179950,0migration/14055-21kthreadcore12:25:271
179950,0migration/129535-21taskset10:00:541
179950,0migration/128420-21irqcore10:20:261
179950,0migration/128420-21irqcore10:20:261
179950,0migration/125521-21sh09:41:501
179950,0migration/123687-21mdstat10:50:281
179950,0migration/118705-21kthreadcore07:10:221
179950,0migration/118646-21ntp_offset09:20:301
179950,0migration/118033-21kthreadcore09:55:271
179950,0migration/111035-21sh09:18:061
169950,0watchdog/17785-21kthreadcore12:10:271
169950,0watchdog/132631-21tail11:30:271
169950,0watchdog/120990-21cat10:15:271
169950,0watchdog/115764-21kthreadcore11:40:271
144819955,0cyclictest0-21swapper/211:14:082
144819950,0cyclictest0-21swapper/212:01:352
144819950,0cyclictest0-21swapper/211:23:262
144819950,0cyclictest0-21swapper/210:55:132
144799954,0cyclictest5657-21tr08:55:250
144799950,0cyclictest0-21swapper/011:23:270
144799950,0cyclictest0-21swapper/010:38:410
149950,0migration/07526-21latency_hist12:30:090
149950,0migration/06620-21taskset11:17:180
149950,0migration/06138-21sh09:31:060
149950,0migration/06077-21sh10:40:370
149950,0migration/04823-21smart_sda12:25:310
149950,0migration/04540-21kthreadcore11:50:260
149950,0migration/032070-21smart_nvme0n108:25:310
149950,0migration/030575-21sh09:29:130
149950,0migration/030370-21kthreadcore09:10:270
149950,0migration/030326-21kthreadcore12:05:310
149950,0migration/02910-21kthreadcore08:50:280
149950,0migration/029064-21kthreadcore11:30:250
149950,0migration/02819-21kthreadcore10:05:260
149950,0migration/02784-21sh10:58:530
149950,0migration/025738-21taskset09:08:570
149950,0migration/024117-21kthreadcore11:10:260
149950,0migration/023523-21kthreadcore10:15:270
149950,0migration/022142-21kthreadcore07:35:260
149950,0migration/018267-21aten_r1power_po09:40:200
149950,0migration/017101-21kthreadcore07:55:250
149950,0migration/016855-21kthreadcore12:15:280
149950,0migration/016515-21taskset11:59:260
149950,0migration/016380-21kthreadcore08:15:270
149950,0migration/015685-21kthreadcore11:05:260
149950,0migration/014281-21timerandwakeup08:35:340
149950,0migration/014136-21fschecks_time09:55:220
149950,0migration/012611-21taskset09:54:010
149950,0migration/012442-21kthreadcore10:45:290
149950,0migration/011597-21kthreadcore10:10:250
149950,0migration/010817-21sh12:12:260
149950,0migration/010776-21taskset07:28:420
8305040,0irq/26-0000:00:0-21swapper/208:25:092
339940,0migration/39393-21kthreadcore08:55:273
329940,0watchdog/36314-21runrttasks08:22:143
329940,0watchdog/3596-21munin-node08:30:303
329940,0watchdog/322807-21fschecks_count08:45:223
329940,0watchdog/30-21swapper/308:15:263
329940,0watchdog/30-21swapper/308:00:183
329940,0watchdog/30-21swapper/307:25:303
29815040,0irq/29-eth0-tx-31627-21ssh10:40:182
29815040,0irq/29-eth0-tx-29492-21telnet08:05:190
29815040,0irq/29-eth0-tx-22266-21telnet08:00:190
29815040,0irq/29-eth0-tx-12649-21ssh11:40:162
29815040,0irq/29-eth0-tx-0-21swapper/211:55:172
29815040,0irq/29-eth0-tx-0-21swapper/211:45:202
29815040,0irq/29-eth0-tx-0-21swapper/211:25:092
29815040,0irq/29-eth0-tx-0-21swapper/209:50:532
29815040,0irq/29-eth0-tx-0-21swapper/209:20:412
29815040,0irq/29-eth0-tx-0-21swapper/209:15:152
29815040,0irq/29-eth0-tx-0-21swapper/209:10:262
29815040,0irq/29-eth0-tx-0-21swapper/007:40:190
29805040,0irq/28-eth0-rx-0-21swapper/311:55:193
29805040,0irq/28-eth0-rx-0-21swapper/310:15:173
29805040,0irq/28-eth0-rx-0-21swapper/309:55:253
29805040,0irq/28-eth0-rx-0-21swapper/309:41:023
259940,0migration/29506-21kthreadcore11:00:272
259940,0migration/232092-21fschecks_time11:15:232
259940,0migration/230165-21fschecks_time08:05:212
259940,0migration/228419-21pmu-power08:45:302
259940,0migration/22628-21kthreadcore07:45:242
259940,0migration/223183-21fschecks_count10:00:222
259940,0migration/222534-21fschecks_time09:25:212
259940,0migration/221426-21runrttasks07:12:502
259940,0migration/218935-21fschecks_count07:35:222
259940,0migration/213727-21fschecks_count10:30:222
259940,0migration/21298-21kthreadcore07:20:282
249940,0watchdog/28825-21grep08:35:222
249940,0watchdog/26631-21kthreadcore07:25:302
249940,0watchdog/222199-21aten2.4-expect08:00:182
249940,0watchdog/218992-21kthreadcore12:35:272
249940,0watchdog/20-21swapper/209:00:342
249940,0watchdog/20-21swapper/208:15:262
249940,0watchdog/20-21swapper/208:10:222
179940,0migration/19572-21kthreadcore08:10:271
179940,0migration/19144-21fschecks_count10:45:251
179940,0migration/18637-21fschecks_time08:35:221
179940,0migration/14965-21fschecks_time09:50:221
179940,0migration/13402-21kthreadcore08:30:261
179940,0migration/131432-21aten_r1power_en09:30:191
179940,0migration/130381-21fschecks_time08:50:241
179940,0migration/129898-21fschecks_count08:05:211
179940,0migration/128221-21timerwakeupswit12:20:381
179940,0migration/126809-21kthreadcore09:25:261
179940,0migration/123881-21kthreadcore08:20:281
179940,0migration/122947-21fschecks_count08:45:231
179940,0migration/122201-21cpuspeed_turbos11:45:211
179940,0migration/121693-21runrttasks10:34:161
179940,0migration/114386-21kthreadcore12:15:271
179940,0migration/112379-21irqcore07:30:251
169940,0watchdog/16632-21kthreadcore07:25:301
169940,0watchdog/127628-21cut11:10:271
169940,0watchdog/124438-21kthreadcore07:15:261
169940,0watchdog/12406-21ssh09:47:031
169940,0watchdog/122066-21kthreadcore09:05:261
169940,0watchdog/119104-21perl07:35:221
169940,0watchdog/113367-21kthreadcore09:00:261
169940,0watchdog/110820-21kthreadcore09:35:271
169940,0watchdog/10-21swapper/111:25:271
169940,0watchdog/10-21swapper/111:00:231
169940,0watchdog/10-21swapper/110:55:351
169940,0watchdog/10-21swapper/110:41:191
169940,0watchdog/10-21swapper/108:00:181
144819943,0cyclictest5515-21awk08:55:242
144819943,0cyclictest3524-21snmpd12:20:222
144819943,0cyclictest3524-21snmpd10:35:202
144819943,0cyclictest3524-21snmpd09:07:342
144819943,0cyclictest3524-21snmpd07:50:332
144819943,0cyclictest3524-21snmpd07:41:032
144819943,0cyclictest3524-21snmpd07:32:482
144819943,0cyclictest3250-21irqbalance10:20:142
144819943,0cyclictest3250-21irqbalance10:20:142
144819943,0cyclictest3250-21irqbalance08:43:042
144819943,0cyclictest3250-21irqbalance08:30:242
144819943,0cyclictest19825-21awk08:20:262
144819943,0cyclictest13503-21awk12:15:252
144809943,0cyclictest5162-21awk10:25:251
144809943,0cyclictest4502-21awk11:35:241
144809943,0cyclictest3571-21lldpd07:49:031
144809943,0cyclictest3250-21irqbalance12:37:151
144809943,0cyclictest3250-21irqbalance12:31:051
144809943,0cyclictest3250-21irqbalance12:05:251
144809943,0cyclictest3250-21irqbalance12:01:551
144809943,0cyclictest3250-21irqbalance11:55:151
144809943,0cyclictest3250-21irqbalance11:15:141
144809943,0cyclictest3250-21irqbalance07:40:341
144809943,0cyclictest27295-21awk09:10:251
144809943,0cyclictest26997-21awk08:25:251
144809943,0cyclictest16321-21awk08:40:241
144809943,0cyclictest12490-21awk08:15:241
144809940,0cyclictest0-21swapper/110:10:361
144799944,0cyclictest0-21swapper/011:46:190
144799943,0cyclictest4575-21awk11:35:240
144799943,0cyclictest3524-21snmpd12:21:220
144799943,0cyclictest18563-21awk11:25:250
144799943,0cyclictest18238-21awk12:00:240
144799943,0cyclictest1442-21awk07:45:220
144799943,0cyclictest13500-21kworker/0:109:35:230
144799940,0cyclictest0-21swapper/007:50:200
149940,0migration/05361-21kthreadcore09:15:260
149940,0migration/03724-21kthreadcore08:30:260
149940,0migration/023372-21fschecks_time10:00:230
149940,0migration/019504-21kthreadcore12:35:270
149940,0migration/018078-21diskmemload10:50:220
149940,0migration/016253-21kthreadcore11:40:270
149940,0migration/012426-21fschecks_time09:00:230
329930,0watchdog/30-21swapper/309:05:263
329930,0watchdog/30-21swapper/307:10:223
29815030,0irq/29-eth0-tx-0-21swapper/007:15:210
29805030,0irq/28-eth0-rx-0-21swapper/307:50:203
259930,0migration/221659-21runrttasks07:57:192
249930,0watchdog/20-21swapper/207:15:262
169930,0watchdog/10-21swapper/111:20:111
169930,0watchdog/10-21swapper/110:05:271
144809932,0cyclictest3524-21snmpd11:05:211
144809932,0cyclictest3250-21irqbalance07:20:241
144809932,0cyclictest25100-21tr10:35:261
144799933,0cyclictest9640-21kworker/0:210:30:210
144799933,0cyclictest9640-21kworker/0:210:25:210
144799933,0cyclictest9640-21kworker/0:210:20:110
144799933,0cyclictest9640-21kworker/0:210:20:110
144799933,0cyclictest13027-21kworker/0:108:10:080
144799932,0cyclictest12320-21awk07:30:250
169920,0watchdog/10-21swapper/107:55:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional