You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-19 - 17:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Wed Nov 19, 2025 12:46:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19456210893sleep80-21swapper/807:07:5210
19368210894sleep90-21swapper/907:06:3911
30663501060irq/52-eth0-rx-0-21swapper/107:08:561
122501020irq/42-ahci0-21swapper/207:09:074
3066450950irq/53-eth0-tx-0-21swapper/307:05:255
3066350920irq/52-eth0-rx-0-21swapper/407:05:566
3066350900irq/52-eth0-rx-0-21swapper/1107:07:543
3066350880irq/52-eth0-rx-0-21swapper/507:06:227
3066350860irq/52-eth0-rx-0-21swapper/707:05:199
1938926653sleep00-21swapper/007:06:550
1930326553sleep60-21swapper/607:05:498
1649426253sleep100-21swapper/1007:05:042
19820993617cyclictest0-21swapper/1107:12:343
19820992827cyclictest29666-1kworker/11:0H09:09:563
14850190irq/18-uhci_hcd0-21swapper/411:25:266
19819991817cyclictest30892sleep1007:27:562
1981999181cyclictest12250irq/42-ahci09:47:282
1981999181cyclictest12250irq/42-ahci07:56:442
1981899181cyclictest0-21swapper/910:40:2511
1981899181cyclictest0-21swapper/909:10:3011
1980699180cyclictest0-21swapper/407:35:176
19819991716cyclictest27249-1kworker/10:0H08:08:392
19819991716cyclictest0-21swapper/1009:51:312
1981999170cyclictest93432sleep1012:01:142
1981999170cyclictest91142chrt11:18:192
1981999170cyclictest85822sleep1010:31:522
1981999170cyclictest75912chrt09:01:412
1981999170cyclictest70752sleep1008:15:482
1981999170cyclictest5912sleep1009:35:322
1981999170cyclictest45992sleep1009:44:102
1981999170cyclictest39292sleep1008:56:522
1981999170cyclictest35532sleep1008:12:222
1981999170cyclictest308762sleep1011:47:362
1981999170cyclictest3066350irq/52-eth0-rx-12:35:312
1981999170cyclictest3066350irq/52-eth0-rx-12:10:172
1981999170cyclictest3066350irq/52-eth0-rx-11:56:272
1981999170cyclictest3066350irq/52-eth0-rx-10:20:332
1981999170cyclictest3066350irq/52-eth0-rx-10:00:342
1981999170cyclictest3066350irq/52-eth0-rx-09:25:232
1981999170cyclictest3066350irq/52-eth0-rx-07:30:152
1981999170cyclictest304822sleep1011:02:062
1981999170cyclictest301102chrt10:18:142
1981999170cyclictest295602sleep1009:32:332
1981999170cyclictest276172sleep1012:27:292
1981999170cyclictest276172sleep1012:27:282
1981999170cyclictest234812sleep1011:35:592
1981999170cyclictest227312sleep1010:07:362
1981999170cyclictest226972sleep1008:40:142
1981999170cyclictest222052chrt09:21:322
1981999170cyclictest222052chrt09:21:312
1981999170cyclictest21922sleep1011:54:122
1981999170cyclictest196082sleep1012:15:272
1981999170cyclictest185532sleep1009:16:312
1981999170cyclictest185532sleep1009:16:312
1981999170cyclictest182552sleep1008:34:262
1981999170cyclictest177462sleep1007:49:212
1981999170cyclictest170242sleep1011:30:102
1981999170cyclictest16452sleep1011:06:442
1981999170cyclictest162022sleep1011:25:582
1981999170cyclictest154902sleep1009:58:352
1981999170cyclictest145422sleep1008:28:252
1981999170cyclictest126002sleep1011:21:222
1981999170cyclictest12250irq/42-ahci12:20:212
1981999170cyclictest12250irq/42-ahci11:40:012
1981999170cyclictest12250irq/42-ahci11:10:062
1981999170cyclictest12250irq/42-ahci10:55:002
1981999170cyclictest12250irq/42-ahci10:46:172
1981999170cyclictest12250irq/42-ahci10:25:002
1981999170cyclictest12250irq/42-ahci10:10:262
1981999170cyclictest12250irq/42-ahci09:10:042
1981999170cyclictest12250irq/42-ahci08:24:222
1981999170cyclictest12250irq/42-ahci08:01:572
1981999170cyclictest12250irq/42-ahci07:40:432
1981999170cyclictest12250irq/42-ahci07:10:262
19818991715cyclictest10193-21taskset07:35:3411
1981899170cyclictest0-21swapper/909:25:1411
1981899170cyclictest0-21swapper/909:00:1811
1980699179cyclictest18320-21sensors10:00:266
19806991715cyclictest29327-21sensors10:15:266
1982099160cyclictest0-21swapper/1108:26:003
19819991615cyclictest31971-21python08:50:282
19819991615cyclictest27249-1kworker/10:0H10:40:482
19818991615cyclictest0-21swapper/910:55:1611
19818991615cyclictest0-21swapper/909:08:1011
1981699167cyclictest0-21swapper/710:15:219
19807991615cyclictest13146-21cpuspeed_turbos10:40:137
19807991614cyclictest32313-21qemu-kvm08:08:387
19806991614cyclictest14665-21sensors09:55:266
1980599160cyclictest0-21swapper/310:00:235
1979299160cyclictest0-21swapper/111:55:191
1979299160cyclictest0-21swapper/110:25:211
19819991514cyclictest27249-1kworker/10:0H09:08:522
1981899155cyclictest0-21swapper/912:05:0111
19818991514cyclictest0-21swapper/907:20:1511
1981899150cyclictest0-21swapper/909:55:2511
1981699155cyclictest0-21swapper/710:35:019
1981699155cyclictest0-21swapper/708:40:019
1981699154cyclictest0-21swapper/712:05:019
19816991513cyclictest6877-21crond07:34:599
1981699151cyclictest22972-21munin-run10:10:019
19807991514cyclictest11377-21qemu-kvm09:09:437
1980799150cyclictest0-21swapper/512:05:227
1980799150cyclictest0-21swapper/511:00:257
1980699152cyclictest0-21swapper/408:10:186
19792991514cyclictest3066350irq/52-eth0-rx-10:18:361
1981999143cyclictest0-21swapper/1007:15:012
1981899145cyclictest0-21swapper/912:10:0011
1981899144cyclictest0-21swapper/908:10:0011
1981899144cyclictest0-21swapper/907:40:0011
1981899143cyclictest0-21swapper/909:35:0111
19818991413cyclictest0-21swapper/911:55:3211
19818991413cyclictest0-21swapper/911:35:1611
19818991413cyclictest0-21swapper/908:28:2411
1981699145cyclictest0-21swapper/712:05:019
1981699144cyclictest0-21swapper/710:40:009
1981699144cyclictest0-21swapper/710:00:009
1981699144cyclictest0-21swapper/707:15:019
1981699144cyclictest0-21swapper/707:15:019
19807991413cyclictest30535-21python12:30:297
19807991413cyclictest30535-21python12:30:297
1980799140cyclictest0-21swapper/508:55:327
19792991413cyclictest3066350irq/52-eth0-rx-08:02:211
1699140watchdog/00-21swapper/009:15:310
1699140watchdog/00-21swapper/009:15:300
13450140irq/18-ehci_hcd0-21swapper/012:10:260
31130ksoftirqd/00-21swapper/007:50:250
1982099135cyclictest0-21swapper/1107:17:263
1982099133cyclictest0-21swapper/1112:10:163
19820991312cyclictest12250irq/42-ahci07:24:513
1981999133cyclictest0-21swapper/1008:45:022
19819991312cyclictest202652sleep1007:50:232
19819991312cyclictest0-21swapper/1010:50:072
1981899138cyclictest0-21swapper/912:05:1211
1981899138cyclictest0-21swapper/910:15:0111
1981899136cyclictest0-21swapper/912:27:3411
1981899136cyclictest0-21swapper/912:27:3311
1981899136cyclictest0-21swapper/908:15:0511
1981899135cyclictest0-21swapper/911:19:5911
1981899134cyclictest0-21swapper/910:33:0111
1981899134cyclictest0-21swapper/909:20:0111
1981899134cyclictest0-21swapper/909:20:0111
1981899134cyclictest0-21swapper/908:50:2511
1981899134cyclictest0-21swapper/908:22:2311
1981899134cyclictest0-21swapper/907:50:0211
1981899133cyclictest0-21swapper/910:27:3811
1981899133cyclictest0-21swapper/908:08:4411
1981899133cyclictest0-21swapper/907:10:0211
1981899132cyclictest816-21df_abs07:25:1511
19818991311cyclictest22946-21taskset10:09:4811
1981899130cyclictest0-21swapper/909:50:2911
1981899130cyclictest0-21swapper/909:46:2711
1981699134cyclictest0-21swapper/710:55:009
1981699134cyclictest0-21swapper/709:55:019
1981699134cyclictest0-21swapper/709:10:029
1981699133cyclictest0-21swapper/709:55:019
1980799134cyclictest0-21swapper/507:30:207
1980799133cyclictest0-21swapper/507:50:187
19807991312cyclictest28841-21python09:30:277
19807991312cyclictest2260-21latency_hist11:55:007
19807991311cyclictest11377-21qemu-kvm09:43:257
19806991312cyclictest31964-21sensors08:50:266
1979299133cyclictest0-21swapper/112:05:181
19782991311cyclictest0-21swapper/009:20:280
19782991311cyclictest0-21swapper/009:20:280
3899120watchdog/40-21swapper/410:38:236
1982099124cyclictest0-21swapper/1111:55:013
1982099124cyclictest0-21swapper/1111:30:013
1982099124cyclictest0-21swapper/1109:50:073
1982099122cyclictest0-21swapper/1110:38:433
1982099122cyclictest0-21swapper/1107:39:023
19820991211cyclictest12250irq/42-ahci10:30:163
1981999120cyclictest31444-21turbostat.cron12:35:012
1981999120cyclictest31444-21turbostat.cron12:35:012
1981899124cyclictest0-21swapper/912:37:4211
1981899124cyclictest0-21swapper/912:21:0311
1981899124cyclictest0-21swapper/911:40:0311
1981899124cyclictest0-21swapper/911:20:2111
1981899124cyclictest0-21swapper/908:01:0511
1981899124cyclictest0-21swapper/907:15:1611
1981899123cyclictest0-21swapper/911:30:0111
1981899122cyclictest0-21swapper/910:52:1011
19818991211cyclictest0-21swapper/909:15:1511
19818991211cyclictest0-21swapper/909:15:1511
19818991210cyclictest12348-21taskset10:38:4411
1981899121cyclictest0-21swapper/912:15:5111
1981899121cyclictest0-21swapper/911:50:1411
1981899121cyclictest0-21swapper/911:45:2111
1981899121cyclictest0-21swapper/911:05:2011
1981899121cyclictest0-21swapper/911:00:5111
1981899121cyclictest0-21swapper/910:45:1411
1981899121cyclictest0-21swapper/910:20:1311
1981899121cyclictest0-21swapper/910:00:1911
1981899121cyclictest0-21swapper/909:40:1611
1981899121cyclictest0-21swapper/909:35:1911
1981899121cyclictest0-21swapper/908:55:1311
1981899121cyclictest0-21swapper/908:45:1311
1981899121cyclictest0-21swapper/908:40:1811
1981899121cyclictest0-21swapper/908:35:1611
1981899121cyclictest0-21swapper/907:55:1511
1981899121cyclictest0-21swapper/907:45:2011
1981899120cyclictest0-21swapper/911:11:1611
1981899120cyclictest0-21swapper/908:31:4611
1981699123cyclictest0-21swapper/711:25:009
1981699123cyclictest0-21swapper/711:10:019
1981699123cyclictest0-21swapper/707:35:019
1981699122cyclictest0-21swapper/707:27:029
1980799122cyclictest0-21swapper/510:25:217
1980799122cyclictest0-21swapper/510:20:007
1980799121cyclictest0-21swapper/507:25:197
1980599123cyclictest0-21swapper/309:40:205
1979299120cyclictest0-21swapper/109:40:161
19782991210cyclictest0-21swapper/009:45:270
1978299120cyclictest0-21swapper/007:10:250
13450120irq/18-ehci_hcd0-21swapper/007:15:000
551110ksoftirqd/60-21swapper/607:10:148
5499110migration/628342-21munin-node08:45:288
481110ksoftirqd/50-21swapper/510:20:177
31110ksoftirqd/00-21swapper/011:20:270
31110ksoftirqd/00-21swapper/010:10:260
2499110watchdog/20-21swapper/209:34:264
1982099115cyclictest0-21swapper/1112:17:233
1982099115cyclictest0-21swapper/1111:02:183
1982099113cyclictest0-21swapper/1112:30:013
1982099113cyclictest0-21swapper/1112:30:013
1982099113cyclictest0-21swapper/1111:45:413
1982099113cyclictest0-21swapper/1110:17:523
1982099113cyclictest0-21swapper/1109:55:593
1982099113cyclictest0-21swapper/1109:13:423
1982099113cyclictest0-21swapper/1108:57:223
1982099113cyclictest0-21swapper/1107:27:113
1982099112cyclictest0-21swapper/1111:36:153
1982099112cyclictest0-21swapper/1107:44:443
1981999114cyclictest0-21swapper/1007:40:002
19819991110cyclictest27249-1kworker/10:0H07:24:132
19819991110cyclictest11554-21python10:35:302
1981899111cyclictest0-21swapper/912:30:1611
1981899111cyclictest0-21swapper/912:30:1611
1981899111cyclictest0-21swapper/911:30:1211
1981899111cyclictest0-21swapper/907:30:1511
1981899110cyclictest0-21swapper/910:15:0211
1981699114cyclictest0-21swapper/712:25:019
1981699114cyclictest0-21swapper/712:25:019
1981699113cyclictest0-21swapper/712:37:449
1981699113cyclictest0-21swapper/711:15:009
1981699113cyclictest0-21swapper/709:18:529
1981699113cyclictest0-21swapper/709:18:519
1981699113cyclictest0-21swapper/708:20:019
1981699112cyclictest0-21swapper/707:45:139
1981699111cyclictest0-21swapper/710:10:149
1981699110cyclictest0-21swapper/709:35:259
1981099110cyclictest0-21swapper/610:58:118
19807991110cyclictest22026-21switchtime10:05:317
19807991110cyclictest10224-21cstates11:20:157
1980699113cyclictest0-21swapper/409:05:186
1980599113cyclictest0-21swapper/311:30:015
1980599113cyclictest0-21swapper/309:45:195
1979899119cyclictest0-21swapper/208:25:154
1979899111cyclictest0-21swapper/207:50:164
1979299118cyclictest0-21swapper/110:50:151
1979299113cyclictest0-21swapper/109:05:181
1978299118cyclictest0-21swapper/011:25:250
8999100migration/1125260-21munin-node08:40:343
6899100migration/84206-21marklog11:55:1910
6899100migration/828799-21latency10:15:2210
621100ksoftirqd/70-21swapper/709:08:369
6199100migration/719179-21munin-node07:50:149
551100ksoftirqd/60-21swapper/610:05:458
5499100migration/62125-21latency_hist11:10:008
5499100migration/620666-21gltestperf09:20:188
5499100migration/620666-21gltestperf09:20:188
5499100migration/610352-21munin-node09:50:208
481100ksoftirqd/511377-21qemu-kvm09:25:147
4599100watchdog/50-21swapper/509:48:197
411100ksoftirqd/40-21swapper/407:10:156
341100ksoftirqd/323759-21snmp_rack3slot909:25:145
3199100watchdog/30-21swapper/311:46:195
3199100watchdog/30-21swapper/311:15:195
2499100watchdog/20-21swapper/209:51:394
2499100watchdog/20-21swapper/208:04:504
201100ksoftirqd/10-21swapper/109:20:161
201100ksoftirqd/10-21swapper/109:20:151
1982099109cyclictest12250irq/42-ahci10:14:423
1982099104cyclictest0-21swapper/1111:22:263
1982099104cyclictest0-21swapper/1109:43:273
1982099104cyclictest0-21swapper/1109:30:023
1982099104cyclictest0-21swapper/1109:01:023
1982099103cyclictest0-21swapper/1110:56:123
1982099103cyclictest0-21swapper/1107:46:143
1982099102cyclictest0-21swapper/1111:07:323
1982099102cyclictest0-21swapper/1108:11:333
1982099101cyclictest0-21swapper/1107:52:303
1981999102cyclictest0-21swapper/1008:36:342
1981799109cyclictest0-21swapper/808:40:2710
1981799100cyclictest0-21swapper/811:20:1710
1981799100cyclictest0-21swapper/808:08:2610
1981699102cyclictest0-21swapper/710:27:309
1981699102cyclictest0-21swapper/708:17:529
1981699100cyclictest0-21swapper/711:50:149
1981099108cyclictest32313-21qemu-kvm08:40:178
1981099100cyclictest0-21swapper/610:17:098
1980799109cyclictest11377-21qemu-kvm09:36:567
1980799102cyclictest0-21swapper/508:40:207
1980699109cyclictest13749-21sensors08:25:256
1980699108cyclictest26093-21sensors10:55:266
1980699108cyclictest17893-21sensors09:15:266
1980699108cyclictest17893-21sensors09:15:266
1980699103cyclictest0-21swapper/409:40:016
1980599100cyclictest0-21swapper/309:12:145
1980599100cyclictest0-21swapper/308:08:185
1980599100cyclictest0-21swapper/307:15:185
1979899109cyclictest0-21swapper/211:05:164
1979899101cyclictest0-21swapper/209:25:234
1979299109cyclictest0-21swapper/107:55:141
1979299102cyclictest0-21swapper/109:25:191
1979299102cyclictest0-21swapper/108:55:191
1979299100cyclictest0-21swapper/110:35:191
1979299100cyclictest0-21swapper/108:25:151
1979299100cyclictest0-21swapper/108:08:151
1979299100cyclictest0-21swapper/107:45:141
1978299109cyclictest0-21swapper/012:30:270
1978299109cyclictest0-21swapper/012:30:260
1978299109cyclictest0-21swapper/012:20:270
1978299108cyclictest0-21swapper/010:45:260
1978299108cyclictest0-21swapper/010:30:110
1978299108cyclictest0-21swapper/007:25:270
1978299107cyclictest0-21swapper/011:55:270
1978299100cyclictest0-21swapper/012:15:260
1978299100cyclictest0-21swapper/012:05:250
1978299100cyclictest0-21swapper/012:00:260
1978299100cyclictest0-21swapper/011:45:270
1978299100cyclictest0-21swapper/011:40:240
1978299100cyclictest0-21swapper/011:10:270
1978299100cyclictest0-21swapper/011:00:280
1978299100cyclictest0-21swapper/010:40:260
1978299100cyclictest0-21swapper/010:25:280
1978299100cyclictest0-21swapper/010:05:270
1978299100cyclictest0-21swapper/009:55:260
1978299100cyclictest0-21swapper/009:35:130
1978299100cyclictest0-21swapper/009:30:270
1978299100cyclictest0-21swapper/009:10:280
1978299100cyclictest0-21swapper/008:50:250
1978299100cyclictest0-21swapper/008:40:280
1978299100cyclictest0-21swapper/008:30:280
1978299100cyclictest0-21swapper/008:15:260
1978299100cyclictest0-21swapper/008:05:260
1978299100cyclictest0-21swapper/008:00:270
1978299100cyclictest0-21swapper/007:30:270
1978299100cyclictest0-21swapper/007:20:260
1799100watchdog/10-21swapper/111:40:351
1699100watchdog/00-21swapper/012:35:510
1699100watchdog/00-21swapper/012:26:110
1699100watchdog/00-21swapper/012:26:110
1699100watchdog/00-21swapper/011:38:510
1699100watchdog/00-21swapper/009:25:580
1699100watchdog/00-21swapper/008:27:350
1699100watchdog/00-21swapper/007:40:270
14850100irq/18-uhci_hcd0-21swapper/507:35:277
14850100irq/18-uhci_hcd0-21swapper/010:50:260
124050100irq/18-i801_smb0-21swapper/010:55:260
90190ksoftirqd/110-21swapper/1112:05:063
90190ksoftirqd/110-21swapper/1110:45:303
90190ksoftirqd/110-21swapper/1110:40:143
90190ksoftirqd/110-21swapper/1110:20:513
90190ksoftirqd/110-21swapper/1109:28:133
899990migration/115722-21needreboot07:30:243
899990migration/1118025-21runrttasks08:31:133
899990migration/1114575-21fschecks_time11:25:153
879990watchdog/110-21swapper/1110:50:103
879990watchdog/110-21swapper/1110:06:313
879990watchdog/110-21swapper/1110:04:483
879990watchdog/110-21swapper/1108:45:023
879990watchdog/110-21swapper/1108:37:433
879990watchdog/110-21swapper/1108:17:363
83190ksoftirqd/100-21swapper/1012:05:192
69190ksoftirqd/80-21swapper/812:25:1810
69190ksoftirqd/80-21swapper/812:25:1810
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional