You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 19:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Fri Dec 19, 2025 12:46:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125501110irq/42-ahci0-21swapper/107:09:051
12550990irq/42-ahci0-21swapper/307:08:445
12550960irq/42-ahci0-21swapper/907:09:1311
12550950irq/42-ahci0-21swapper/207:08:374
2144629388sleep100-21swapper/1007:09:362
2126128778sleep00-21swapper/007:07:500
12550780irq/42-ahci0-21swapper/807:08:4110
2112227360sleep110-21swapper/1107:06:003
1830626755sleep60-21swapper/607:05:078
12550660irq/42-ahci0-21swapper/707:07:299
1491350600irq/53-eth0-rx-0-21swapper/407:05:146
1830525955sleep50-21swapper/507:05:067
21625992415cyclictest0-21swapper/908:35:1011
21582992120cyclictest0-21swapper/007:15:140
2162599200cyclictest0-21swapper/907:35:1411
2161699206cyclictest0-21swapper/710:20:029
2161699206cyclictest0-21swapper/710:20:019
21615992014cyclictest13166-21qemu-kvm09:14:558
2162699184cyclictest0-21swapper/1009:35:212
21626991817cyclictest31824-1kworker/10:2H07:11:152
2162699181cyclictest1491450irq/54-eth0-tx-10:20:252
2162699181cyclictest1491450irq/54-eth0-tx-10:20:242
2162699181cyclictest1491350irq/53-eth0-rx-11:49:052
2162699181cyclictest12550irq/42-ahci10:33:382
2162699181cyclictest12550irq/42-ahci10:26:492
2162699181cyclictest12550irq/42-ahci08:08:502
2162699181cyclictest12550irq/42-ahci07:30:132
2162599181cyclictest0-21swapper/910:55:2511
2162599181cyclictest0-21swapper/908:50:1511
2162599181cyclictest0-21swapper/907:50:1911
21616991816cyclictest5544-21munin-run08:14:599
21616991816cyclictest13877-21snmp_rack3slot907:40:159
21616991816cyclictest11960-21diskstats10:35:149
21613991816cyclictest16098-21snmp_rack3slot910:40:166
2158299180cyclictest0-21swapper/008:15:100
21626991716cyclictest31824-1kworker/10:2H08:58:292
21626991716cyclictest312362sleep1009:31:032
2162699170cyclictest93842sleep1009:01:482
2162699170cyclictest91932sleep1007:35:022
2162699170cyclictest831ksoftirqd/1011:30:172
2162699170cyclictest831ksoftirqd/1007:55:272
2162699170cyclictest82372chrt12:00:072
2162699170cyclictest71822chrt11:12:262
2162699170cyclictest61552sleep1009:41:052
2162699170cyclictest46062sleep1011:55:082
2162699170cyclictest42622sleep1012:37:132
2162699170cyclictest4202sleep1012:30:592
2162699170cyclictest321612sleep1011:01:012
2162699170cyclictest317752sleep1010:16:452
2162699170cyclictest307032chrt08:45:462
2162699170cyclictest293332sleep1012:26:582
2162699170cyclictest276192sleep1009:26:262
2162699170cyclictest274162sleep1011:40:172
2162699170cyclictest258492sleep1010:55:122
2162699170cyclictest258092sleep1007:15:112
2162699170cyclictest256522sleep1012:21:232
2162699170cyclictest242572sleep1008:40:092
2162699170cyclictest234592sleep1008:36:082
2162699170cyclictest233322sleep1009:20:252
2162699170cyclictest231582sleep1010:05:192
2162699170cyclictest231582sleep1010:05:192
2162699170cyclictest214702chrt07:50:162
2162699170cyclictest208042sleep1010:01:532
2162699170cyclictest203262sleep1009:16:262
2162699170cyclictest19732sleep1008:51:222
2162699170cyclictest193992sleep1007:47:262
2162699170cyclictest187242sleep1008:30:212
2162699170cyclictest180192chrt11:26:402
2162699170cyclictest171572sleep1009:57:172
2162699170cyclictest159912sleep1009:10:252
2162699170cyclictest155382sleep1012:10:082
2162699170cyclictest1491450irq/54-eth0-tx-12:15:142
2162699170cyclictest1491450irq/54-eth0-tx-07:40:132
2162699170cyclictest1491450irq/54-eth0-tx-07:25:282
2162699170cyclictest1491350irq/53-eth0-rx-11:50:122
2162699170cyclictest1491350irq/53-eth0-rx-11:20:172
2162699170cyclictest1491350irq/53-eth0-rx-10:10:232
2162699170cyclictest1491350irq/53-eth0-rx-09:52:262
2162699170cyclictest1491350irq/53-eth0-rx-08:26:552
2162699170cyclictest1491350irq/53-eth0-rx-08:15:122
2162699170cyclictest1491350irq/53-eth0-rx-08:14:372
2162699170cyclictest1491350irq/53-eth0-rx-07:20:092
2162699170cyclictest148062sleep1012:07:082
2162699170cyclictest129672sleep1009:06:112
2162699170cyclictest126322sleep1008:22:322
2162699170cyclictest12550irq/42-ahci11:06:332
2162699170cyclictest12550irq/42-ahci10:50:322
2162699170cyclictest12550irq/42-ahci10:45:312
2162699170cyclictest12550irq/42-ahci10:43:072
2162699170cyclictest108132sleep1011:17:262
2162699170cyclictest100442sleep1009:49:302
2162599174cyclictest0-21swapper/908:15:0011
21625991716cyclictest0-21swapper/907:40:2311
2162599170cyclictest12435-1kworker/9:2H08:17:2611
2162599170cyclictest0-21swapper/907:20:1811
21616991715cyclictest9667-21munin-node11:15:209
21616991715cyclictest32229-21snmp_rack3slot911:01:539
21616991715cyclictest22058-21snmp_rack3slot912:16:499
21616991715cyclictest14971-21snmp_rack3slot909:10:159
21614991715cyclictest24588-21qemu-kvm10:09:027
21614991715cyclictest24588-21qemu-kvm10:09:017
21613991716cyclictest2125-21lldpd07:22:566
21613991715cyclictest25675-21snmp_rack3slot912:21:386
21613991715cyclictest24362-21snmp_rack3slot910:05:486
21613991715cyclictest24362-21snmp_rack3slot910:05:486
1491350170irq/53-eth0-rx-0-21swapper/407:15:176
2162799160cyclictest0-21swapper/1109:27:213
21625991615cyclictest741rcuc/908:49:1011
21625991615cyclictest0-21swapper/907:12:4911
21625991614cyclictest26781-21expr11:40:1311
2162199163cyclictest0-21swapper/810:25:0010
2162199163cyclictest0-21swapper/810:25:0010
2161699165cyclictest0-21swapper/712:31:099
21616991614cyclictest7426-21snmp_rack3slot909:45:149
21616991614cyclictest30499-21snmp_easybox.os09:30:229
21616991614cyclictest29561-21munin-run12:30:019
21616991614cyclictest24952-21snmp_rack3slot912:20:249
21616991614cyclictest24251-21munin-run09:25:019
21615991615cyclictest24589-21qemu-kvm10:17:108
21613991614cyclictest3527-21iostat_ios07:25:186
21613991614cyclictest1393-21diskstats11:05:136
21613991614cyclictest13051-21snmp_rack3slot909:07:136
21582991615cyclictest7262-21kworker/0:009:29:440
21582991615cyclictest7262-21kworker/0:009:15:140
2158299160cyclictest0-21swapper/009:20:130
2162799150cyclictest0-21swapper/1107:58:203
2162599153cyclictest0-21swapper/910:45:0111
21625991514cyclictest12435-1kworker/9:2H10:08:4611
21625991514cyclictest12435-1kworker/9:2H10:08:4611
21625991514cyclictest0-21swapper/912:35:2911
21625991514cyclictest0-21swapper/911:50:2911
21621991513cyclictest23225-21snmp_easybox.os09:20:2410
2161699154cyclictest0-21swapper/712:05:009
2161699154cyclictest0-21swapper/710:10:019
2161699154cyclictest0-21swapper/710:10:019
2161699154cyclictest0-21swapper/708:50:029
2161699154cyclictest0-21swapper/707:35:029
2161699153cyclictest0-21swapper/710:15:029
21616991513cyclictest2785-21snmp_rack3slot911:05:239
21616991513cyclictest19879-21munin-node10:00:219
21616991513cyclictest14919-21snmp_rack3slot910:40:119
2161499150cyclictest0-21swapper/507:15:177
21613991513cyclictest5729-21snmp_rack3slot908:57:036
21613991513cyclictest26660-21snmp_rack3slot907:57:026
2161399150cyclictest0-21swapper/411:10:126
2159199150cyclictest0-21swapper/109:20:121
21582991514cyclictest7262-21kworker/0:009:10:250
21582991514cyclictest55152sleep008:14:440
12550150irq/42-ahci12435-1kworker/9:2H10:15:3211
8799140watchdog/110-21swapper/1107:19:523
3199140watchdog/30-21swapper/309:16:595
21627991413cyclictest12550irq/42-ahci09:15:543
21627991413cyclictest12550irq/42-ahci08:21:283
2162599144cyclictest0-21swapper/909:49:5111
21625991412cyclictest14556-21taskset11:23:5811
2162199145cyclictest0-21swapper/807:15:0110
21621991412cyclictest18745-21diskstats10:00:1210
2161699144cyclictest0-21swapper/711:45:019
2161699144cyclictest0-21swapper/710:55:009
2161699144cyclictest0-21swapper/709:50:019
2161699144cyclictest0-21swapper/709:40:019
2161699144cyclictest0-21swapper/709:00:009
2161699144cyclictest0-21swapper/708:05:019
2161699144cyclictest0-21swapper/707:19:509
2161699143cyclictest0-21swapper/709:15:019
21615991412cyclictest24588-21qemu-kvm10:10:018
21615991412cyclictest24588-21qemu-kvm10:10:008
21613991412cyclictest29151-21snmp_rack3slot908:45:146
21613991412cyclictest12843-21snmp_easybox.os07:40:136
21604991412cyclictest2088-21snmpd12:02:524
2158299140cyclictest0-21swapper/010:09:110
2158299140cyclictest0-21swapper/010:09:110
901130ksoftirqd/110-21swapper/1111:42:253
691130ksoftirqd/80-21swapper/812:30:5410
551130ksoftirqd/60-21swapper/611:42:258
551130ksoftirqd/60-21swapper/611:35:248
481130ksoftirqd/50-21swapper/511:35:257
31130ksoftirqd/00-21swapper/012:30:540
31130ksoftirqd/00-21swapper/011:35:240
271130ksoftirqd/20-21swapper/212:30:544
2162699134cyclictest0-21swapper/1010:39:362
2162599134cyclictest0-21swapper/910:00:0011
2162599133cyclictest0-21swapper/911:38:3711
2162599133cyclictest0-21swapper/911:34:2111
2162599133cyclictest0-21swapper/911:02:0611
2162599133cyclictest0-21swapper/910:34:0411
2162599133cyclictest0-21swapper/909:55:5111
21625991312cyclictest0-21swapper/909:40:0311
21625991312cyclictest0-21swapper/908:57:2711
21625991311cyclictest30531-21taskset08:04:4511
21625991311cyclictest11046-21chrt12:00:5411
2162599131cyclictest0-21swapper/912:20:1311
2162199133cyclictest0-21swapper/810:15:0410
2162199133cyclictest0-21swapper/809:50:0410
21621991311cyclictest28802-21munin-run11:00:0110
2161699134cyclictest0-21swapper/712:00:019
2161699134cyclictest0-21swapper/710:20:019
2161699134cyclictest0-21swapper/709:05:019
2161699134cyclictest0-21swapper/708:05:029
2161699133cyclictest0-21swapper/712:35:389
2161699133cyclictest0-21swapper/711:56:379
2161699133cyclictest0-21swapper/711:53:079
2161699133cyclictest0-21swapper/711:23:159
2161699133cyclictest0-21swapper/711:11:339
2161699133cyclictest0-21swapper/710:28:219
2161699133cyclictest0-21swapper/709:42:339
2161699133cyclictest0-21swapper/708:56:319
2161699133cyclictest0-21swapper/708:35:019
2161699133cyclictest0-21swapper/708:30:009
2161699133cyclictest0-21swapper/708:27:299
2161699133cyclictest0-21swapper/708:15:589
2161699133cyclictest0-21swapper/707:52:459
2161699133cyclictest0-21swapper/707:48:579
2161699133cyclictest0-21swapper/707:30:019
2161699133cyclictest0-21swapper/707:28:219
2161699133cyclictest0-21swapper/707:10:019
21616991312cyclictest28755-21diskstats08:45:139
21616991312cyclictest25628-21diskstats09:25:149
21616991311cyclictest30644-21snmp_easybox.os07:20:109
21616991311cyclictest15103-21munin-node09:55:129
2161499133cyclictest0-21swapper/508:35:177
2161399133cyclictest0-21swapper/412:30:186
2161399133cyclictest0-21swapper/410:55:176
2161399133cyclictest0-21swapper/408:50:186
2161399133cyclictest0-21swapper/408:20:176
21613991311cyclictest8530-21snmp_easybox.os09:00:246
21613991311cyclictest21469-21snmp_rack3slot908:35:136
2160499133cyclictest0-21swapper/210:25:174
2159199133cyclictest0-21swapper/111:45:181
2158299133cyclictest0-21swapper/011:40:180
2158299133cyclictest0-21swapper/009:50:010
2158299130cyclictest0-21swapper/009:50:230
201130ksoftirqd/10-21swapper/112:30:541
15050130irq/18-uhci_hcd0-21swapper/008:25:230
901120ksoftirqd/110-21swapper/1112:27:333
901120ksoftirqd/110-21swapper/1112:17:533
691120ksoftirqd/814994-21grep09:10:1510
691120ksoftirqd/80-21swapper/812:17:5410
691120ksoftirqd/80-21swapper/811:42:2410
481120ksoftirqd/50-21swapper/512:27:337
481120ksoftirqd/50-21swapper/511:42:257
341120ksoftirqd/30-21swapper/312:30:545
341120ksoftirqd/30-21swapper/312:14:225
341120ksoftirqd/30-21swapper/311:35:245
341120ksoftirqd/30-21swapper/309:10:155
31120ksoftirqd/00-21swapper/012:27:330
31120ksoftirqd/00-21swapper/012:21:020
271120ksoftirqd/20-21swapper/212:27:334
271120ksoftirqd/20-21swapper/212:17:544
271120ksoftirqd/20-21swapper/211:42:254
2162699122cyclictest0-21swapper/1011:36:222
2162699122cyclictest0-21swapper/1008:02:592
2162599122cyclictest0-21swapper/909:30:2011
2162599122cyclictest0-21swapper/909:15:5611
2162599122cyclictest0-21swapper/908:06:5811
21625991211cyclictest748-21awk12:35:0011
21625991211cyclictest741rcuc/908:25:0711
21625991211cyclictest0-21swapper/910:25:1011
21625991211cyclictest0-21swapper/907:25:1111
21625991210cyclictest7029-21expr09:00:1311
2162599120cyclictest0-21swapper/912:16:3611
2162599120cyclictest0-21swapper/909:50:1111
2162199128cyclictest0-21swapper/809:45:2110
21621991211cyclictest7184-21irqstats07:30:2110
21621991211cyclictest3543-21irqstats07:25:2010
21621991211cyclictest2939-21iostat12:35:1710
2162199120cyclictest0-21swapper/812:05:0110
2161699123cyclictest0-21swapper/712:10:009
2161699123cyclictest0-21swapper/711:46:079
2161699123cyclictest0-21swapper/708:40:019
2161699123cyclictest0-21swapper/708:00:019
2161699122cyclictest0-21swapper/711:38:069
2161699122cyclictest0-21swapper/710:46:229
2161699122cyclictest0-21swapper/708:23:009
2161599124cyclictest18271-21munin-run11:30:018
2161499122cyclictest0-21swapper/507:55:177
2161399122cyclictest0-21swapper/408:20:006
21613991210cyclictest4694-21snmp_rack3slot909:40:176
21613991210cyclictest17121-21snmp_rack3slot909:56:476
2161099120cyclictest0-21swapper/311:55:235
2161099120cyclictest0-21swapper/311:40:265
2160499122cyclictest0-21swapper/209:10:004
2160499122cyclictest0-21swapper/207:50:174
2159199122cyclictest0-21swapper/110:00:161
21591991210cyclictest0-21swapper/111:15:111
2158299124cyclictest0-21swapper/012:15:170
21582991211cyclictest7262-21kworker/0:009:09:440
21582991211cyclictest1491350irq/53-eth0-rx-07:25:240
2158299120cyclictest0-21swapper/010:40:260
2158299120cyclictest0-21swapper/008:40:240
201120ksoftirqd/10-21swapper/112:27:321
201120ksoftirqd/10-21swapper/112:21:031
201120ksoftirqd/10-21swapper/111:42:241
901110ksoftirqd/110-21swapper/1111:25:183
901110ksoftirqd/110-21swapper/1110:10:293
761110ksoftirqd/90-21swapper/910:10:2911
761110ksoftirqd/90-21swapper/909:10:1411
761110ksoftirqd/90-21swapper/907:45:1011
551110ksoftirqd/624588-21qemu-kvm10:10:308
551110ksoftirqd/60-21swapper/612:04:568
551110ksoftirqd/60-21swapper/609:22:468
481110ksoftirqd/50-21swapper/512:17:537
481110ksoftirqd/50-21swapper/512:04:567
481110ksoftirqd/50-21swapper/511:47:227
481110ksoftirqd/50-21swapper/509:10:147
481110ksoftirqd/50-21swapper/507:28:467
411110ksoftirqd/40-21swapper/412:27:326
411110ksoftirqd/40-21swapper/412:04:576
341110ksoftirqd/30-21swapper/311:47:235
341110ksoftirqd/30-21swapper/307:45:105
31110ksoftirqd/00-21swapper/012:04:570
31110ksoftirqd/00-21swapper/011:47:230
31110ksoftirqd/00-21swapper/007:15:000
271110ksoftirqd/20-21swapper/212:21:024
271110ksoftirqd/20-21swapper/210:10:304
2162799113cyclictest0-21swapper/1112:23:423
2162799113cyclictest0-21swapper/1111:47:553
2162799113cyclictest0-21swapper/1108:58:153
2162799110cyclictest0-21swapper/1107:45:133
2162599113cyclictest0-21swapper/909:36:5611
2162599113cyclictest0-21swapper/908:42:2911
2162599113cyclictest0-21swapper/907:18:3411
21625991110cyclictest0-21swapper/912:13:1411
21625991110cyclictest0-21swapper/911:48:3611
2162599111cyclictest0-21swapper/911:13:0711
2162599111cyclictest0-21swapper/911:05:0711
2162599111cyclictest0-21swapper/910:43:3411
2162599111cyclictest0-21swapper/909:08:0111
2162599110cyclictest0-21swapper/912:26:4411
2162599110cyclictest0-21swapper/912:05:2511
2162599110cyclictest0-21swapper/911:57:0511
2162199119cyclictest2281-21munin-run08:55:0010
2162199114cyclictest0-21swapper/809:35:0110
2162199113cyclictest0-21swapper/810:30:0010
2162199113cyclictest0-21swapper/810:25:0310
2162199113cyclictest0-21swapper/809:10:0010
2162199113cyclictest0-21swapper/808:02:2810
2162199113cyclictest0-21swapper/807:23:5710
2162199111cyclictest0-21swapper/812:27:2110
2162199111cyclictest0-21swapper/810:05:4610
2162199111cyclictest0-21swapper/810:05:4610
2162199110cyclictest0-21swapper/812:06:4510
2161699119cyclictest8328-21snmp_rack3slot910:30:129
2161699113cyclictest0-21swapper/711:32:059
2161699113cyclictest0-21swapper/711:25:039
2161699113cyclictest0-21swapper/710:50:359
2161599115cyclictest0-21swapper/609:20:008
2161599113cyclictest0-21swapper/611:57:388
2161599113cyclictest0-21swapper/607:16:108
2161599111cyclictest0-21swapper/607:51:588
2161499113cyclictest0-21swapper/511:00:017
2161499113cyclictest0-21swapper/510:00:157
2161499110cyclictest0-21swapper/511:25:297
2161399113cyclictest345-21taskset11:50:006
2161099111cyclictest0-21swapper/312:35:165
2161099110cyclictest0-21swapper/312:29:475
2161099110cyclictest0-21swapper/312:21:355
2161099110cyclictest0-21swapper/312:15:335
2161099110cyclictest0-21swapper/312:07:275
2161099110cyclictest0-21swapper/312:00:285
2161099110cyclictest0-21swapper/311:54:455
2160499113cyclictest0-21swapper/209:30:154
2160499113cyclictest0-21swapper/207:20:164
2160499111cyclictest0-21swapper/211:30:214
2159199110cyclictest0-21swapper/107:50:001
2158299119cyclictest17462chrt08:09:080
2158299119cyclictest0-21swapper/008:45:240
2158299113cyclictest0-21swapper/010:45:180
2158299113cyclictest0-21swapper/010:27:200
2158299113cyclictest0-21swapper/007:55:180
21582991110cyclictest7262-21kworker/0:009:30:090
2158299111cyclictest0-21swapper/010:15:130
2158299110cyclictest0-21swapper/008:35:260
2158299110cyclictest0-21swapper/008:20:250
2158299110cyclictest0-21swapper/007:50:240
2158299110cyclictest0-21swapper/007:30:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional