You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 11:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Sat Jan 10, 2026 00:46:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
146992121106sleep10-21swapper/119:06:121
128501130irq/42-ahci0-21swapper/219:10:004
1497829893sleep70-21swapper/719:09:079
12850970irq/42-ahci0-21swapper/419:08:136
991850920irq/53-eth0-rx-0-21swapper/319:05:455
991850920irq/53-eth0-rx-0-21swapper/1119:05:313
991850890irq/53-eth0-rx-0-21swapper/519:05:197
991850820irq/53-eth0-rx-0-21swapper/819:08:3510
1499428280sleep100-21swapper/1019:09:222
1499327775sleep90-21swapper/919:09:2111
1237427665sleep00-21swapper/019:05:110
1502926863sleep60-21swapper/619:09:558
14050330irq/18-ehci_hcd0-21swapper/020:15:220
15185993231cyclictest991850irq/53-eth0-rx-20:15:2711
15186993013cyclictest831ksoftirqd/1021:54:512
15148993029cyclictest991850irq/53-eth0-rx-20:15:141
15147993028cyclictest0-21swapper/021:15:250
15186992712cyclictest831ksoftirqd/1023:39:112
15186992613cyclictest831ksoftirqd/1000:00:322
15178992524cyclictest991850irq/53-eth0-rx-20:15:177
1518699249cyclictest831ksoftirqd/1020:59:322
15185992415cyclictest991850irq/53-eth0-rx-00:32:0411
15185992415cyclictest991850irq/53-eth0-rx-00:32:0311
15185992415cyclictest0-21swapper/922:36:2711
1518599241cyclictest0-21swapper/923:49:5611
1518599241cyclictest0-21swapper/923:06:2911
1518599241cyclictest0-21swapper/922:08:3011
1518599241cyclictest0-21swapper/921:42:4711
15184992422cyclictest15050irq/18-uhci_hcd20:15:2110
15186992311cyclictest831ksoftirqd/1022:09:222
1518599231cyclictest0-21swapper/921:51:2311
15159992322cyclictest991850irq/53-eth0-rx-20:15:114
15185992215cyclictest0-21swapper/922:34:0011
1518599221cyclictest0-21swapper/922:27:4811
1518599221cyclictest0-21swapper/922:16:4411
1518599220cyclictest0-21swapper/922:13:4311
15183992221cyclictest991850irq/53-eth0-rx-20:15:139
15165992120cyclictest991950irq/54-eth0-tx-20:15:135
15189992018cyclictest0-21swapper/1120:08:223
15186992013cyclictest0-21swapper/1000:13:432
15147992017cyclictest7009-21diskmemload22:12:310
1518699192cyclictest991850irq/53-eth0-rx-23:50:322
1518699192cyclictest991850irq/53-eth0-rx-23:20:492
1518699192cyclictest991850irq/53-eth0-rx-22:04:362
1518699192cyclictest991850irq/53-eth0-rx-00:24:422
1518699192cyclictest831ksoftirqd/1022:36:132
1518699192cyclictest831ksoftirqd/1022:22:452
1518699192cyclictest831ksoftirqd/1021:34:062
1518699192cyclictest831ksoftirqd/1021:21:092
1518699192cyclictest277732chrt20:08:392
1518599192cyclictest0-21swapper/900:35:1111
1518599192cyclictest0-21swapper/900:35:1111
15189991816cyclictest991850irq/53-eth0-rx-21:13:213
15189991816cyclictest991850irq/53-eth0-rx-21:13:203
15186991817cyclictest831ksoftirqd/1019:20:232
15186991817cyclictest0-21swapper/1023:00:452
15186991817cyclictest0-21swapper/1022:25:412
15186991817cyclictest0-21swapper/1021:37:472
15186991817cyclictest0-21swapper/1019:53:592
1518699181cyclictest991950irq/54-eth0-tx-23:26:532
1518699181cyclictest991950irq/54-eth0-tx-00:26:282
1518699181cyclictest991950irq/54-eth0-tx-00:26:272
1518699181cyclictest991850irq/53-eth0-rx-23:57:372
1518699181cyclictest991850irq/53-eth0-rx-23:43:572
1518699181cyclictest991850irq/53-eth0-rx-22:55:592
1518699181cyclictest991850irq/53-eth0-rx-22:47:252
1518699181cyclictest991850irq/53-eth0-rx-22:15:242
1518699181cyclictest991850irq/53-eth0-rx-21:55:282
1518699181cyclictest991850irq/53-eth0-rx-21:25:322
1518699181cyclictest991850irq/53-eth0-rx-21:09:582
1518699181cyclictest991850irq/53-eth0-rx-00:38:522
1518699181cyclictest991850irq/53-eth0-rx-00:38:522
1518699181cyclictest831ksoftirqd/1023:30:472
1518699181cyclictest831ksoftirqd/1023:15:102
1518699181cyclictest831ksoftirqd/1023:07:422
1518699181cyclictest831ksoftirqd/1022:50:022
1518699181cyclictest831ksoftirqd/1022:10:012
1518699181cyclictest831ksoftirqd/1021:45:122
1518699181cyclictest831ksoftirqd/1021:40:282
1518699181cyclictest831ksoftirqd/1021:15:192
1518699181cyclictest831ksoftirqd/1021:10:132
1518699181cyclictest831ksoftirqd/1021:10:122
1518699181cyclictest831ksoftirqd/1020:47:282
1518699181cyclictest831ksoftirqd/1020:29:482
1518699181cyclictest831ksoftirqd/1020:20:142
1518699181cyclictest831ksoftirqd/1019:30:222
1518699181cyclictest831ksoftirqd/1019:25:122
1518699181cyclictest831ksoftirqd/1000:30:122
1518699181cyclictest831ksoftirqd/1000:30:112
1518699181cyclictest831ksoftirqd/1000:05:122
1518699181cyclictest323042chrt23:12:502
1518699181cyclictest12850irq/42-ahci23:46:292
1518699181cyclictest12850irq/42-ahci19:19:592
1518699180cyclictest106322sleep1020:30:062
15185991816cyclictest17249-21chrt20:37:5411
1518599181cyclictest0-21swapper/923:59:2211
1518599181cyclictest0-21swapper/923:52:5711
1518599181cyclictest0-21swapper/923:25:3811
1518599181cyclictest0-21swapper/923:19:4511
1518599181cyclictest0-21swapper/922:55:5811
1518599181cyclictest0-21swapper/922:52:1811
1518599181cyclictest0-21swapper/921:35:1511
1518599181cyclictest0-21swapper/921:26:5511
1518599181cyclictest0-21swapper/921:15:0711
1518599181cyclictest0-21swapper/900:14:3511
1518599181cyclictest0-21swapper/900:08:3311
15159991816cyclictest2308-21snmpd21:54:014
15159991816cyclictest2308-21snmpd21:27:464
15159991816cyclictest2308-21snmpd00:31:034
15159991816cyclictest2308-21snmpd00:31:034
15189991716cyclictest181452sleep1122:10:083
1518999170cyclictest0-21swapper/1119:23:153
15186991716cyclictest831ksoftirqd/1019:45:252
15186991716cyclictest6888-21munin-node19:40:102
15186991716cyclictest0-21swapper/1020:00:122
15186991716cyclictest0-21swapper/1000:15:072
1518699170cyclictest991850irq/53-eth0-rx-20:40:042
1518699170cyclictest991850irq/53-eth0-rx-20:35:062
1518699170cyclictest991850irq/53-eth0-rx-20:11:462
1518699170cyclictest991850irq/53-eth0-rx-19:35:192
1518699170cyclictest831ksoftirqd/1022:40:052
1518699170cyclictest831ksoftirqd/1022:30:142
1518699170cyclictest831ksoftirqd/1021:00:112
1518699170cyclictest831ksoftirqd/1020:15:102
1518699170cyclictest831ksoftirqd/1019:10:202
1518699170cyclictest252222chrt20:50:092
1518699170cyclictest173882chrt19:55:032
15185991716cyclictest0-21swapper/921:04:1111
1518599170cyclictest5842-21sh23:44:2311
1518599170cyclictest5013-1kworker/9:0H23:23:3711
1518599170cyclictest5013-1kworker/9:0H20:26:1311
1518599170cyclictest32254-21ssh22:20:1611
1518599170cyclictest0-21swapper/922:01:2911
1518599170cyclictest0-21swapper/921:33:2011
1518599170cyclictest0-21swapper/921:22:3511
1518599170cyclictest0-21swapper/920:50:1611
1518599170cyclictest0-21swapper/920:48:2211
1518599170cyclictest0-21swapper/920:42:3511
1518599170cyclictest0-21swapper/919:33:2811
1518599170cyclictest0-21swapper/919:15:1611
1518499175cyclictest0-21swapper/820:25:1610
1518299176cyclictest0-21swapper/622:00:008
1518299175cyclictest3907-21awk22:24:598
15182991716cyclictest16457-21qemu-kvm22:18:598
15178991715cyclictest25808-21ssh23:34:297
15159991715cyclictest2308-21snmpd22:55:464
15159991715cyclictest2308-21snmpd22:33:474
15159991715cyclictest2308-21snmpd21:23:174
15185991615cyclictest991950irq/54-eth0-tx-21:55:2211
15185991615cyclictest0-21swapper/923:37:3611
15185991615cyclictest0-21swapper/923:12:3311
15185991615cyclictest0-21swapper/921:48:5511
15185991615cyclictest0-21swapper/920:30:1111
15185991615cyclictest0-21swapper/920:24:2011
15185991615cyclictest0-21swapper/919:55:2711
15185991615cyclictest0-21swapper/919:51:3911
15185991615cyclictest0-21swapper/919:49:0611
15185991615cyclictest0-21swapper/919:26:2911
15185991615cyclictest0-21swapper/919:20:4311
15185991615cyclictest0-21swapper/900:27:0411
15185991615cyclictest0-21swapper/900:27:0311
15185991615cyclictest0-21swapper/900:19:1211
15185991615cyclictest0-21swapper/900:01:5911
15182991615cyclictest18001-21python23:00:258
15178991615cyclictest6850-21qemu-kvm21:08:187
15178991614cyclictest16165-21ssh00:18:187
15172991615cyclictest991850irq/53-eth0-rx-20:08:506
15172991615cyclictest991850irq/53-eth0-rx-00:11:436
15172991615cyclictest3094-21ssh22:23:436
1516599160cyclictest0-21swapper/300:10:215
15159991614cyclictest2308-21snmpd21:37:174
15159991614cyclictest2308-21snmpd00:27:484
15159991614cyclictest2308-21snmpd00:27:474
15159991614cyclictest2308-21snmpd00:07:164
15147991614cyclictest0-21swapper/020:08:230
15147991612cyclictest991850irq/53-eth0-rx-21:13:580
15147991612cyclictest991850irq/53-eth0-rx-21:13:580
15189991514cyclictest991850irq/53-eth0-rx-20:15:183
15185991514cyclictest991950irq/54-eth0-tx-21:12:2011
15185991514cyclictest991950irq/54-eth0-tx-21:12:1911
15185991514cyclictest0-21swapper/922:47:5911
15185991514cyclictest0-21swapper/919:43:1511
15185991514cyclictest0-21swapper/900:20:4911
1518499155cyclictest0-21swapper/820:40:0010
1518499155cyclictest0-21swapper/800:00:1810
15178991513cyclictest12054-21ssh21:39:337
1517899150cyclictest0-21swapper/523:45:107
15159991513cyclictest2308-21snmpd23:00:184
1515999150cyclictest0-21swapper/222:15:264
15189991413cyclictest991850irq/53-eth0-rx-21:26:413
15185991413cyclictest991850irq/53-eth0-rx-20:07:1511
15185991413cyclictest0-21swapper/922:42:5711
15185991413cyclictest0-21swapper/920:56:2711
15185991413cyclictest0-21swapper/920:11:3311
1518499144cyclictest0-21swapper/821:05:0110
1518499143cyclictest0-21swapper/821:05:0010
1518399145cyclictest0-21swapper/721:37:069
1518299145cyclictest0-21swapper/600:30:188
1518299145cyclictest0-21swapper/600:30:188
1518299142cyclictest0-21swapper/619:10:168
1516599140cyclictest0-21swapper/321:39:105
15159991412cyclictest2308-21snmpd21:58:314
15159991412cyclictest2308-21snmpd00:16:314
1514799142cyclictest31ksoftirqd/021:29:510
991950130irq/54-eth0-tx-0-21swapper/923:04:4411
5299130watchdog/60-21swapper/600:21:078
15185991312cyclictest0-21swapper/923:30:3011
15185991311cyclictest18512-21taskset19:11:3611
1518499133cyclictest0-21swapper/823:45:0110
1518299132cyclictest0-21swapper/623:05:178
15182991312cyclictest6850-21qemu-kvm21:08:388
1517899133cyclictest0-21swapper/519:35:147
15178991311cyclictest16399-21ssh21:41:217
1516599133cyclictest0-21swapper/322:10:145
1516599133cyclictest0-21swapper/321:55:145
1516599133cyclictest0-21swapper/321:20:155
1516599133cyclictest0-21swapper/319:25:185
1515999133cyclictest0-21swapper/222:00:144
1515999131cyclictest0-21swapper/223:35:244
1514899134cyclictest0-21swapper/123:25:011
1514799133cyclictest31ksoftirqd/022:15:210
1514799131cyclictest0-21swapper/022:42:320
1514799130cyclictest0-21swapper/022:52:230
1514799130cyclictest0-21swapper/021:44:550
1514799130cyclictest0-21swapper/020:10:200
991850120irq/53-eth0-rx-0-21swapper/423:26:436
6699120watchdog/80-21swapper/800:16:2610
341120ksoftirqd/30-21swapper/323:41:075
1518999123cyclictest0-21swapper/1119:40:153
1518499123cyclictest0-21swapper/821:45:0110
1518499123cyclictest0-21swapper/819:20:0110
1518499123cyclictest0-21swapper/800:30:0110
1518499123cyclictest0-21swapper/800:30:0110
1518499122cyclictest0-21swapper/821:31:4610
1518499121cyclictest0-21swapper/823:02:5910
1518399125cyclictest0-21swapper/721:23:149
1518399124cyclictest0-21swapper/719:45:009
1518399124cyclictest0-21swapper/719:10:019
1518399123cyclictest0-21swapper/722:10:009
1518399123cyclictest0-21swapper/720:45:029
1518299123cyclictest0-21swapper/623:45:148
1518299122cyclictest0-21swapper/621:25:018
1518299121cyclictest0-21swapper/600:20:018
15178991210cyclictest4078-21ssh00:08:307
15178991210cyclictest32380-21ssh23:12:577
15178991210cyclictest27731-21qemu-kvm20:14:537
15178991210cyclictest23359-21ssh21:20:387
15172991211cyclictest12850irq/42-ahci20:15:126
1515999122cyclictest0-21swapper/223:50:144
1515999122cyclictest0-21swapper/223:30:174
1515999122cyclictest0-21swapper/222:50:164
1515999121cyclictest0-21swapper/221:05:104
1514899122cyclictest0-21swapper/122:55:161
1514799124cyclictest0-21swapper/022:27:240
1514799122cyclictest0-21swapper/023:40:160
15147991211cyclictest31ksoftirqd/000:25:180
15147991211cyclictest31ksoftirqd/000:25:170
1514799121cyclictest0-21swapper/020:50:160
1514799120cyclictest0-21swapper/023:35:200
1514799120cyclictest0-21swapper/023:30:230
1514799120cyclictest0-21swapper/022:30:210
1514799120cyclictest0-21swapper/021:45:210
991950110irq/54-eth0-tx-0-21swapper/423:23:536
991850110irq/53-eth0-rx-0-21swapper/300:31:105
991850110irq/53-eth0-rx-0-21swapper/300:31:095
691110ksoftirqd/80-21swapper/823:41:0710
6899110migration/814982-21sh22:59:5210
621110ksoftirqd/70-21swapper/719:30:399
551110ksoftirqd/60-21swapper/619:30:398
551110ksoftirqd/60-21swapper/600:25:188
551110ksoftirqd/60-21swapper/600:25:178
5499110migration/632715-21cpuspeed_turbos21:00:118
5499110migration/630954-21timerwakeupswit20:10:268
481110ksoftirqd/50-21swapper/523:41:087
201110ksoftirqd/10-21swapper/119:30:401
1518999113cyclictest0-21swapper/1123:30:473
1518999113cyclictest0-21swapper/1122:07:493
1518999113cyclictest0-21swapper/1122:00:023
1518999113cyclictest0-21swapper/1121:02:163
1518999113cyclictest0-21swapper/1120:31:393
1518999112cyclictest0-21swapper/1121:39:393
1518999112cyclictest0-21swapper/1100:15:003
1518499113cyclictest0-21swapper/823:33:0310
1518499113cyclictest0-21swapper/822:40:4810
1518499113cyclictest0-21swapper/822:18:4410
1518499113cyclictest0-21swapper/821:55:0110
1518499113cyclictest0-21swapper/821:40:3310
1518499113cyclictest0-21swapper/821:37:1710
1518499113cyclictest0-21swapper/821:25:3210
1518499113cyclictest0-21swapper/820:55:5510
1518499113cyclictest0-21swapper/820:48:1710
1518499113cyclictest0-21swapper/820:07:4710
1518499113cyclictest0-21swapper/819:47:5410
1518499112cyclictest0-21swapper/823:37:4010
1518499112cyclictest0-21swapper/823:17:0210
1518499112cyclictest0-21swapper/823:10:1610
1518499112cyclictest0-21swapper/822:30:1710
1518499112cyclictest0-21swapper/819:11:4010
1518399114cyclictest0-21swapper/723:50:019
1518399114cyclictest0-21swapper/723:05:019
1518399113cyclictest0-21swapper/723:35:019
1518399113cyclictest0-21swapper/723:25:009
1518399113cyclictest0-21swapper/722:30:009
1518399113cyclictest0-21swapper/720:34:179
1518299113cyclictest0-21swapper/619:36:138
1518299112cyclictest0-21swapper/600:10:018
15182991110cyclictest28947-21python23:35:208
1517899119cyclictest6321-21ssh22:00:107
1517899113cyclictest0-21swapper/519:40:137
1517899113cyclictest0-21swapper/519:20:007
1517899112cyclictest0-21swapper/521:10:157
1517899112cyclictest0-21swapper/521:10:157
1517899110cyclictest0-21swapper/523:20:137
1517899110cyclictest0-21swapper/522:00:017
1517299113cyclictest0-21swapper/422:40:166
1516599119cyclictest0-21swapper/321:15:125
1516599113cyclictest0-21swapper/323:25:155
1516599113cyclictest0-21swapper/321:30:165
1516599113cyclictest0-21swapper/320:20:165
1516599113cyclictest0-21swapper/319:30:165
1516599112cyclictest0-21swapper/320:35:165
1516599111cyclictest0-21swapper/323:03:275
1516599110cyclictest0-21swapper/319:50:195
1516599110cyclictest0-21swapper/300:15:255
1515999118cyclictest0-21swapper/223:40:254
1515999113cyclictest0-21swapper/221:00:154
1515999110cyclictest0-21swapper/223:15:244
1514899113cyclictest0-21swapper/100:25:151
1514899113cyclictest0-21swapper/100:25:151
1514799119cyclictest151rcuc/019:15:130
1514799119cyclictest12850irq/42-ahci19:20:000
1514799119cyclictest0-21swapper/022:45:070
1514799119cyclictest0-21swapper/021:00:220
1514799119cyclictest0-21swapper/020:39:410
1514799118cyclictest0-21swapper/020:55:210
1514799118cyclictest0-21swapper/020:30:230
1514799118cyclictest0-21swapper/000:36:180
1514799118cyclictest0-21swapper/000:36:180
1514799113cyclictest0-21swapper/023:20:150
1514799113cyclictest0-21swapper/021:23:170
1514799113cyclictest0-21swapper/021:05:140
1514799113cyclictest0-21swapper/020:25:170
1514799113cyclictest0-21swapper/020:20:330
1514799112cyclictest0-21swapper/019:59:350
15147991110cyclictest31ksoftirqd/022:05:480
15147991110cyclictest31ksoftirqd/000:02:580
15147991110cyclictest0-21swapper/023:56:130
15147991110cyclictest0-21swapper/000:30:230
15147991110cyclictest0-21swapper/000:30:220
14050110irq/18-ehci_hcd0-21swapper/019:39:320
991950100irq/54-eth0-tx-0-21swapper/823:59:4010
991950100irq/54-eth0-tx-0-21swapper/821:59:1710
991950100irq/54-eth0-tx-0-21swapper/722:38:149
991950100irq/54-eth0-tx-0-21swapper/522:46:337
991950100irq/54-eth0-tx-0-21swapper/400:37:246
991950100irq/54-eth0-tx-0-21swapper/400:37:236
991950100irq/54-eth0-tx-0-21swapper/323:10:545
991950100irq/54-eth0-tx-0-21swapper/321:10:005
991950100irq/54-eth0-tx-0-21swapper/223:21:594
991850100irq/53-eth0-rx-0-21swapper/620:42:038
991850100irq/53-eth0-rx-0-21swapper/523:54:517
991850100irq/53-eth0-rx-0-21swapper/421:30:496
991850100irq/53-eth0-rx-0-21swapper/323:05:585
991850100irq/53-eth0-rx-0-21swapper/322:51:125
991850100irq/53-eth0-rx-0-21swapper/322:39:025
991850100irq/53-eth0-rx-0-21swapper/200:22:174
991850100irq/53-eth0-rx-0-21swapper/1121:16:513
901100ksoftirqd/110-21swapper/1123:41:083
901100ksoftirqd/110-21swapper/1122:31:533
901100ksoftirqd/110-21swapper/1121:08:183
901100ksoftirqd/110-21swapper/1119:50:153
901100ksoftirqd/110-21swapper/1119:35:583
901100ksoftirqd/110-21swapper/1100:25:173
901100ksoftirqd/110-21swapper/1100:25:173
8999100migration/113693-21latency_hist00:35:013
8999100migration/113693-21latency_hist00:35:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional