You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 12:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Mon Apr 27, 2026 00:46:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
128501140irq/42-ahci0-21swapper/119:09:171
128501130irq/42-ahci0-21swapper/219:09:284
9918501120irq/53-eth0-rx-0-21swapper/319:08:115
28352210290sleep50-21swapper/519:05:527
991850990irq/53-eth0-rx-0-21swapper/419:09:376
991850920irq/53-eth0-rx-0-21swapper/719:05:519
991850880irq/53-eth0-rx-0-21swapper/1119:05:353
115050870irq/18-i801_smb0-21swapper/819:09:1910
2843926553sleep90-21swapper/919:06:5611
2842126353sleep60-21swapper/619:06:408
2842525955sleep100-21swapper/1019:06:452
2833125955sleep00-21swapper/019:05:340
991950320irq/54-eth0-tx-0-21swapper/021:21:340
2887599290cyclictest356-21chrt22:13:193
28874992516cyclictest13723-1kworker/10:2H22:04:112
28874992417cyclictest0-21swapper/1021:33:382
28874992416cyclictest0-21swapper/1023:33:532
28874992416cyclictest0-21swapper/1023:02:082
28874992416cyclictest0-21swapper/1023:02:072
28874992416cyclictest0-21swapper/1021:36:352
28874992416cyclictest0-21swapper/1021:25:352
28874992416cyclictest0-21swapper/1000:24:452
28874992316cyclictest0-21swapper/1023:50:082
28874992316cyclictest0-21swapper/1023:22:172
28874992316cyclictest0-21swapper/1021:53:482
28874992316cyclictest0-21swapper/1021:15:172
28874992316cyclictest0-21swapper/1020:14:462
28874992315cyclictest0-21swapper/1021:46:082
28874992315cyclictest0-21swapper/1000:16:042
28874992216cyclictest0-21swapper/1023:43:452
28874992216cyclictest0-21swapper/1020:38:382
28874992215cyclictest0-21swapper/1022:08:262
28874992215cyclictest0-21swapper/1022:08:252
28874992115cyclictest0-21swapper/1023:55:352
28874992015cyclictest0-21swapper/1021:44:102
2883999200cyclictest0-21swapper/021:34:570
991950190irq/54-eth0-tx-0-21swapper/000:06:390
2887599194cyclictest0-21swapper/1121:18:043
2887599190cyclictest186272sleep1122:28:443
2887499192cyclictest991850irq/53-eth0-rx-23:46:082
2887499192cyclictest991850irq/53-eth0-rx-22:43:422
2887499192cyclictest991850irq/53-eth0-rx-22:20:102
2887499192cyclictest991850irq/53-eth0-rx-21:55:132
2887499192cyclictest991850irq/53-eth0-rx-21:13:592
2887499192cyclictest991850irq/53-eth0-rx-00:10:442
2887499192cyclictest12850irq/42-ahci00:30:422
28874991917cyclictest25333-21kworker/10:100:04:522
2883999190cyclictest0-21swapper/022:26:590
2883999190cyclictest0-21swapper/022:08:310
2883999190cyclictest0-21swapper/022:08:300
2883999190cyclictest0-21swapper/021:08:450
2883999190cyclictest0-21swapper/021:08:440
28875991817cyclictest991850irq/53-eth0-rx-22:15:583
2887599180cyclictest0-21swapper/1119:10:023
28874991817cyclictest0-21swapper/1023:35:232
28874991817cyclictest0-21swapper/1023:25:312
28874991817cyclictest0-21swapper/1022:25:022
2887499181cyclictest991850irq/53-eth0-rx-23:11:202
2887499181cyclictest991850irq/53-eth0-rx-23:05:572
2887499181cyclictest991850irq/53-eth0-rx-22:55:132
2887499181cyclictest991850irq/53-eth0-rx-22:55:132
2887499181cyclictest991850irq/53-eth0-rx-22:51:532
2887499181cyclictest991850irq/53-eth0-rx-22:45:362
2887499181cyclictest991850irq/53-eth0-rx-22:39:202
2887499181cyclictest991850irq/53-eth0-rx-22:31:352
2887499181cyclictest991850irq/53-eth0-rx-22:10:302
2887499181cyclictest991850irq/53-eth0-rx-21:20:262
2887499181cyclictest991850irq/53-eth0-rx-19:45:382
2887499181cyclictest991850irq/53-eth0-rx-00:37:002
2887499181cyclictest991850irq/53-eth0-rx-00:26:482
2887499181cyclictest991850irq/53-eth0-rx-00:08:262
2887499181cyclictest12850irq/42-ahci19:40:192
28839991816cyclictest0-21swapper/021:44:190
2883999180cyclictest0-21swapper/022:14:140
2883999180cyclictest0-21swapper/019:15:490
2883999180cyclictest0-21swapper/019:15:480
28874991716cyclictest13723-1kworker/10:2H21:05:122
28874991716cyclictest13723-1kworker/10:2H21:05:112
28874991716cyclictest0-21swapper/1020:00:202
2887499170cyclictest991850irq/53-eth0-rx-23:15:032
2887499170cyclictest991850irq/53-eth0-rx-22:15:292
2887499170cyclictest991850irq/53-eth0-rx-20:55:042
2887499170cyclictest991850irq/53-eth0-rx-20:50:322
2887499170cyclictest991850irq/53-eth0-rx-20:40:042
2887499170cyclictest991850irq/53-eth0-rx-20:25:412
2887499170cyclictest991850irq/53-eth0-rx-20:17:042
2887499170cyclictest991850irq/53-eth0-rx-20:17:032
2887499170cyclictest991850irq/53-eth0-rx-20:06:102
2887499170cyclictest991850irq/53-eth0-rx-19:55:142
2887499170cyclictest991850irq/53-eth0-rx-19:31:032
2887499170cyclictest991850irq/53-eth0-rx-19:25:082
2887499170cyclictest991850irq/53-eth0-rx-19:15:152
2887499170cyclictest991850irq/53-eth0-rx-19:15:152
2887499170cyclictest55472sleep1019:20:082
2887499170cyclictest293242sleep1019:10:072
2887499170cyclictest275012sleep1019:50:142
2887499170cyclictest272042sleep1020:31:182
2887499170cyclictest272042sleep1020:31:172
2887499170cyclictest184232sleep1020:20:172
2887499170cyclictest184232sleep1020:20:172
2887499170cyclictest167002sleep1021:00:442
2887499170cyclictest12850irq/42-ahci20:46:082
2887499170cyclictest12850irq/42-ahci19:35:052
28863991715cyclictest20607-21qemu-kvm21:31:578
28862991716cyclictest26859-21qemu-kvm22:08:427
28862991716cyclictest26859-21qemu-kvm22:08:417
28862991715cyclictest2971-21ssh21:48:327
28862991715cyclictest13859-21ssh22:25:017
28853991715cyclictest2308-21snmpd23:27:094
2883999172cyclictest0-21swapper/000:30:170
28839991716cyclictest0-21swapper/019:12:010
28839991714cyclictest991850irq/53-eth0-rx-21:28:540
28839991714cyclictest0-21swapper/022:51:350
28839991713cyclictest991850irq/53-eth0-rx-22:24:490
2887299165cyclictest0-21swapper/821:40:0110
28862991615cyclictest26859-21qemu-kvm22:17:357
28862991614cyclictest8364-21ssh00:08:247
28862991614cyclictest6354-21ssh00:34:257
28862991614cyclictest20606-21qemu-kvm21:39:087
28862991614cyclictest20606-21qemu-kvm21:09:267
28862991614cyclictest20606-21qemu-kvm21:09:257
28853991614cyclictest2308-21snmpd22:22:384
28853991614cyclictest2308-21snmpd21:31:534
2885399160cyclictest0-21swapper/200:15:164
2883999163cyclictest0-21swapper/021:45:170
28839991615cyclictest991850irq/53-eth0-rx-22:19:160
2883999160cyclictest0-21swapper/020:04:290
28875991514cyclictest12754-21taskset20:13:153
2887299155cyclictest0-21swapper/823:00:0210
2887299155cyclictest0-21swapper/823:00:0110
2887299154cyclictest0-21swapper/819:15:0110
2887299154cyclictest0-21swapper/819:15:0010
2886499154cyclictest0-21swapper/720:40:009
2886499153cyclictest0-21swapper/721:40:019
28863991514cyclictest20607-21qemu-kvm21:22:308
28863991513cyclictest20607-21qemu-kvm21:13:438
28863991513cyclictest20606-21qemu-kvm21:08:588
28863991513cyclictest20606-21qemu-kvm21:08:588
28862991514cyclictest20606-21qemu-kvm21:27:207
28862991513cyclictest13515-21ssh21:55:507
2886299150cyclictest0-21swapper/523:40:467
28861991514cyclictest991850irq/53-eth0-rx-21:56:396
2886199150cyclictest0-21swapper/423:41:126
2886199150cyclictest0-21swapper/421:46:416
2884899150cyclictest0-21swapper/121:11:171
2884899150cyclictest0-21swapper/100:35:241
2884899150cyclictest0-21swapper/100:28:511
28839991513cyclictest2745-21runrttasks20:19:550
28839991513cyclictest2745-21runrttasks20:19:540
2883999150cyclictest12850irq/42-ahci19:21:570
2883999150cyclictest0-21swapper/023:25:120
2883999150cyclictest0-21swapper/021:35:080
2883999150cyclictest0-21swapper/000:20:130
2883999150cyclictest0-21swapper/000:19:480
2887599144cyclictest0-21swapper/1122:40:013
28875991413cyclictest991850irq/53-eth0-rx-22:22:523
28875991413cyclictest38832sleep1121:20:353
2887299144cyclictest0-21swapper/820:20:0110
2887299144cyclictest0-21swapper/820:20:0110
2887299144cyclictest0-21swapper/819:35:0110
2887299143cyclictest0-21swapper/822:20:1810
2887299143cyclictest0-21swapper/819:25:0110
2886499145cyclictest0-21swapper/719:55:009
2886499144cyclictest0-21swapper/721:50:009
2886499144cyclictest0-21swapper/719:25:029
2886499144cyclictest0-21swapper/700:05:009
2886399147cyclictest0-21swapper/622:45:008
2886399144cyclictest0-21swapper/623:30:028
2886399143cyclictest0-21swapper/622:23:248
28863991412cyclictest20607-21qemu-kvm21:25:128
28862991412cyclictest16536-21ssh23:47:487
28861991413cyclictest991850irq/53-eth0-rx-20:12:216
28839991413cyclictest991850irq/53-eth0-rx-21:16:430
2883999140cyclictest0-21swapper/022:47:370
1799140watchdog/10-21swapper/123:58:501
991950130irq/54-eth0-tx-0-21swapper/021:55:380
991850130irq/53-eth0-rx-0-21swapper/023:17:000
2887299134cyclictest0-21swapper/821:34:5910
2887299134cyclictest0-21swapper/800:00:0010
2887299133cyclictest0-21swapper/820:25:0210
2887299133cyclictest0-21swapper/820:10:5210
2887299133cyclictest0-21swapper/819:45:0010
2887299133cyclictest0-21swapper/819:15:0010
2886499134cyclictest0-21swapper/723:35:019
2886499134cyclictest0-21swapper/723:00:029
2886499134cyclictest0-21swapper/723:00:019
2886499134cyclictest0-21swapper/720:55:019
2886499131cyclictest0-21swapper/720:35:019
2886499131cyclictest0-21swapper/720:35:009
2886499130cyclictest0-21swapper/720:35:239
28863991312cyclictest20606-21qemu-kvm21:37:018
28863991311cyclictest8686-21python23:40:248
28863991311cyclictest6140-21snmp_rack3slot900:05:248
28863991311cyclictest20606-21qemu-kvm21:45:138
2886299133cyclictest0-21swapper/500:20:017
28862991311cyclictest1732-21ssh23:35:157
2886199130cyclictest0-21swapper/421:44:046
2885399133cyclictest0-21swapper/221:55:174
28853991311cyclictest2308-21snmpd20:04:364
2885399130cyclictest0-21swapper/221:00:244
2884899130cyclictest0-21swapper/121:35:071
28839991311cyclictest24314-21chrt21:10:350
2883999130cyclictest0-21swapper/023:55:010
2883999130cyclictest0-21swapper/000:04:000
14050130irq/18-ehci_hcd0-21swapper/021:04:410
14050130irq/18-ehci_hcd0-21swapper/020:59:390
14050130irq/18-ehci_hcd0-21swapper/000:11:120
991950120irq/54-eth0-tx-0-21swapper/023:44:390
991850120irq/53-eth0-rx-0-21swapper/023:03:100
991850120irq/53-eth0-rx-0-21swapper/023:03:090
5499120migration/627010-21munin-node21:40:218
2887299124cyclictest0-21swapper/823:05:0110
2887299124cyclictest0-21swapper/823:05:0010
2887299124cyclictest0-21swapper/819:50:1810
2887299123cyclictest0-21swapper/822:00:1810
2887299123cyclictest0-21swapper/800:25:0010
2887299122cyclictest0-21swapper/823:26:5510
2886499123cyclictest0-21swapper/720:45:029
2886399121cyclictest0-21swapper/622:10:188
2886299123cyclictest0-21swapper/522:45:177
28862991211cyclictest20606-21qemu-kvm21:34:377
2886299120cyclictest0-21swapper/521:40:557
28861991211cyclictest2734-21diskstats19:15:146
28861991211cyclictest2734-21diskstats19:15:146
2886199120cyclictest0-21swapper/423:28:576
28860991211cyclictest341ksoftirqd/323:26:165
2885399122cyclictest0-21swapper/219:40:184
28853991210cyclictest2308-21snmpd23:30:254
28853991210cyclictest2308-21snmpd19:55:524
28853991210cyclictest0-21swapper/200:15:004
2885399120cyclictest0-21swapper/221:23:104
2883999121cyclictest2242-40kipmi023:30:290
2883999120cyclictest0-21swapper/020:44:370
991950110irq/54-eth0-tx-0-21swapper/223:43:594
991950110irq/54-eth0-tx-0-21swapper/122:35:141
991950110irq/54-eth0-tx-0-21swapper/122:27:031
991950110irq/54-eth0-tx-0-21swapper/023:36:090
901110ksoftirqd/110-21swapper/1100:00:163
761110ksoftirqd/90-21swapper/923:35:0511
691110ksoftirqd/80-21swapper/822:28:0210
621110ksoftirqd/70-21swapper/721:58:459
551110ksoftirqd/626859-21qemu-kvm22:28:028
481110ksoftirqd/59091-21qemu-kvm20:10:217
481110ksoftirqd/50-21swapper/519:23:587
411110ksoftirqd/40-21swapper/422:19:466
341110ksoftirqd/320758-21diskmemload21:58:455
341110ksoftirqd/30-21swapper/322:56:245
341110ksoftirqd/30-21swapper/322:56:235
31110ksoftirqd/00-21swapper/022:56:240
31110ksoftirqd/00-21swapper/022:56:230
31110ksoftirqd/00-21swapper/020:10:220
2887599119cyclictest4114-21snmp_easybox.os19:15:263
2887599119cyclictest4114-21snmp_easybox.os19:15:253
2887599114cyclictest0-21swapper/1123:20:003
2887599113cyclictest0-21swapper/1122:50:003
2887599112cyclictest0-21swapper/1120:05:173
2887599110cyclictest0-21swapper/1122:30:243
2887599110cyclictest0-21swapper/1120:56:503
2887599110cyclictest0-21swapper/1120:27:593
2887299114cyclictest0-21swapper/820:50:0210
2887299114cyclictest0-21swapper/819:45:0110
2887299113cyclictest0-21swapper/823:50:0110
2887299113cyclictest0-21swapper/822:35:5310
2887299113cyclictest0-21swapper/821:27:5310
2887299113cyclictest0-21swapper/821:17:2210
2887299113cyclictest0-21swapper/819:24:4610
2887299111cyclictest0-21swapper/822:34:5110
2887299111cyclictest0-21swapper/819:36:0610
2886499113cyclictest0-21swapper/723:21:309
2886499113cyclictest0-21swapper/721:10:019
2886499113cyclictest0-21swapper/721:10:009
2886499113cyclictest0-21swapper/700:25:019
2886499111cyclictest0-21swapper/719:15:039
2886499111cyclictest0-21swapper/719:15:029
2886399119cyclictest8252-21python20:05:238
2886399113cyclictest9090-21qemu-kvm20:27:588
2886399113cyclictest9090-21qemu-kvm20:18:448
2886399113cyclictest9090-21qemu-kvm20:18:448
28863991110cyclictest11326-21python23:15:258
2886399111cyclictest0-21swapper/621:16:188
2886399110cyclictest0-21swapper/623:50:118
2886399110cyclictest0-21swapper/622:16:548
2886299119cyclictest20967-21ssh22:56:377
2886299119cyclictest20967-21ssh22:56:377
2886299113cyclictest0-21swapper/519:50:187
2886299112cyclictest0-21swapper/521:20:177
2886299110cyclictest0-21swapper/500:28:557
2886199117cyclictest0-21swapper/423:13:186
2886199113cyclictest0-21swapper/419:30:176
2886199110cyclictest0-21swapper/421:11:386
2885399113cyclictest0-21swapper/222:50:184
2885399113cyclictest0-21swapper/222:15:164
2885399113cyclictest0-21swapper/221:29:594
2885399113cyclictest0-21swapper/220:25:184
2885399110cyclictest0-21swapper/221:10:184
2885399110cyclictest0-21swapper/220:30:164
2885399110cyclictest0-21swapper/220:30:154
2884899110cyclictest0-21swapper/123:45:071
2884899110cyclictest0-21swapper/122:30:131
2884899110cyclictest0-21swapper/119:15:041
2884899110cyclictest0-21swapper/119:15:031
2883999119cyclictest0-21swapper/021:51:140
2883999119cyclictest0-21swapper/000:25:260
28839991110cyclictest0-21swapper/019:44:240
2883999110cyclictest0-21swapper/023:56:100
2883999110cyclictest0-21swapper/023:45:220
2883999110cyclictest0-21swapper/023:20:060
2883999110cyclictest0-21swapper/022:30:210
271110ksoftirqd/20-21swapper/220:10:224
1699110watchdog/00-21swapper/020:54:220
991950100irq/54-eth0-tx-9628-21ssh22:47:475
991950100irq/54-eth0-tx-860-21ssh22:14:114
991950100irq/54-eth0-tx-27439-21cat21:15:129
991950100irq/54-eth0-tx-26337-21ssh22:07:183
991950100irq/54-eth0-tx-26337-21ssh22:07:183
991950100irq/54-eth0-tx-22433-21ssh23:52:474
991950100irq/54-eth0-tx-19913-21munin-node22:30:195
991950100irq/54-eth0-tx-0-21swapper/922:55:0311
991950100irq/54-eth0-tx-0-21swapper/922:55:0211
991950100irq/54-eth0-tx-0-21swapper/719:13:339
991950100irq/54-eth0-tx-0-21swapper/623:14:408
991950100irq/54-eth0-tx-0-21swapper/523:50:037
991950100irq/54-eth0-tx-0-21swapper/522:24:427
991950100irq/54-eth0-tx-0-21swapper/423:57:416
991950100irq/54-eth0-tx-0-21swapper/300:16:165
991950100irq/54-eth0-tx-0-21swapper/223:59:554
991950100irq/54-eth0-tx-0-21swapper/200:31:074
991950100irq/54-eth0-tx-0-21swapper/122:52:361
991950100irq/54-eth0-tx-0-21swapper/122:05:141
991950100irq/54-eth0-tx-0-21swapper/122:05:131
991950100irq/54-eth0-tx-0-21swapper/100:21:061
991850100irq/53-eth0-rx-0-21swapper/821:50:1610
991850100irq/53-eth0-rx-0-21swapper/800:35:1910
991850100irq/53-eth0-rx-0-21swapper/623:49:088
991850100irq/53-eth0-rx-0-21swapper/622:06:368
991850100irq/53-eth0-rx-0-21swapper/622:06:358
991850100irq/53-eth0-rx-0-21swapper/422:37:346
991850100irq/53-eth0-rx-0-21swapper/422:00:146
991850100irq/53-eth0-rx-0-21swapper/421:34:516
991850100irq/53-eth0-rx-0-21swapper/420:35:196
991850100irq/53-eth0-rx-0-21swapper/321:38:595
991850100irq/53-eth0-rx-0-21swapper/223:20:044
991850100irq/53-eth0-rx-0-21swapper/221:35:134
991850100irq/53-eth0-rx-0-21swapper/200:04:054
991850100irq/53-eth0-rx-0-21swapper/022:40:330
991850100irq/53-eth0-rx-0-21swapper/022:01:170
901100ksoftirqd/110-21swapper/1123:58:373
901100ksoftirqd/110-21swapper/1123:47:043
901100ksoftirqd/110-21swapper/1123:35:183
901100ksoftirqd/110-21swapper/1123:33:313
901100ksoftirqd/110-21swapper/1122:56:243
901100ksoftirqd/110-21swapper/1122:56:243
901100ksoftirqd/110-21swapper/1121:58:463
901100ksoftirqd/110-21swapper/1121:53:293
901100ksoftirqd/110-21swapper/1121:12:203
901100ksoftirqd/110-21swapper/1100:32:163
8999100migration/117603-21cpuspeed_turbos00:35:133
8999100migration/1122073-21cpuspeed_turbos00:20:123
8999100migration/1118484-21munin-node19:35:193
8999100migration/1113677-21cpuspeed_turbos20:15:123
8999100migration/1113677-21cpuspeed_turbos20:15:123
761100ksoftirqd/90-21swapper/923:33:3011
761100ksoftirqd/90-21swapper/923:20:0311
761100ksoftirqd/90-21swapper/922:21:2711
761100ksoftirqd/90-21swapper/900:22:4311
7599100migration/97170-21cpuspeed_turbos21:25:1211
7599100migration/9323-21latency_hist19:15:0011
7599100migration/925129-21cpuspeed_turbos21:40:1211
7599100migration/911466-21diskmemload00:37:4511
7399100watchdog/90-21swapper/921:58:4711
7399100watchdog/90-21swapper/921:45:4211
7399100watchdog/90-21swapper/921:15:1911
7399100watchdog/90-21swapper/921:02:2611
7399100watchdog/90-21swapper/919:43:0211
691100ksoftirqd/80-21swapper/823:18:1810
691100ksoftirqd/80-21swapper/800:01:2710
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional