You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 05:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3.osadl.org (updated Mon Dec 08, 2025 00:46:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25085211197sleep40-21swapper/419:05:386
30663501030irq/52-eth0-rx-0-21swapper/819:07:5610
3066350970irq/52-eth0-rx-0-21swapper/219:05:344
12250960irq/42-ahci0-21swapper/119:09:021
3066350920irq/52-eth0-rx-0-21swapper/319:05:035
2539929085sleep70-21swapper/719:09:059
2522828981sleep90-21swapper/919:07:3211
2546026664sleep100-21swapper/1019:09:572
2512526653sleep00-21swapper/019:06:090
2518926354sleep110-21swapper/1119:06:583
2511726055sleep50-21swapper/519:06:037
2510125955sleep60-21swapper/619:05:528
25610992914cyclictest0-21swapper/1120:10:243
12250290irq/42-ahci0-21swapper/221:17:594
25573992725cyclictest243122sleep021:16:010
25573992514cyclictest0-21swapper/020:10:330
2561099240cyclictest0-21swapper/1121:18:463
2557399230cyclictest0-21swapper/023:15:330
2557399210cyclictest0-21swapper/023:20:260
25610992018cyclictest0-21swapper/1119:25:223
2557399200cyclictest0-21swapper/022:45:290
2557399200cyclictest0-21swapper/021:55:320
2557399200cyclictest0-21swapper/021:55:320
2557399200cyclictest0-21swapper/019:10:320
2561099195cyclictest0-21swapper/1120:25:293
2561099190cyclictest0-21swapper/1121:08:293
2557399190cyclictest0-21swapper/020:50:330
25609991817cyclictest47192sleep1020:05:272
2560999181cyclictest12250irq/42-ahci19:58:282
2560999181cyclictest12250irq/42-ahci19:16:022
2560899181cyclictest0-21swapper/921:40:1111
2560899181cyclictest0-21swapper/921:05:1911
2560899181cyclictest0-21swapper/919:10:3711
25607991816cyclictest9659-21memory22:25:2310
25607991816cyclictest9517-21diskstats23:55:1610
25607991816cyclictest8433-21snmp_easybox.os20:55:2610
25607991816cyclictest830-21df_inode21:30:1710
25607991816cyclictest5978-21snmp_easybox.os19:25:1310
25607991816cyclictest467-21snmp_rack3slot923:41:1410
25607991816cyclictest30525-21snmp_easybox.os00:25:1510
25607991816cyclictest29908-21snmp_rack3slot919:15:1310
25607991816cyclictest26954-21snmp_rack3slot919:10:1710
25607991816cyclictest24833-21irqstats00:15:2110
25607991816cyclictest24642-21snmp_easybox.os20:35:1410
25607991816cyclictest20781-21iostat_ios23:25:2110
25607991816cyclictest19657-21snmp_easybox.os00:10:1110
25607991816cyclictest18826-21snmp_easybox.os22:40:1310
25607991816cyclictest18063-21snmp_rack3slot920:25:1510
25607991816cyclictest14148-21snmp_rack3slot920:20:1510
25607991816cyclictest1243-21df22:15:1410
25607991816cyclictest12218-21snmp_rack3slot922:30:1410
25607991816cyclictest11405-21munin-run23:14:5910
25598991816cyclictest28618-21qemu-kvm22:13:217
25598991816cyclictest25327-21qemu-kvm19:47:237
25598991816cyclictest25327-21qemu-kvm19:14:257
25573991816cyclictest0-21swapper/021:08:230
2557399180cyclictest0-21swapper/021:50:280
2557399180cyclictest0-21swapper/021:30:310
25609991716cyclictest377-1kworker/10:1H23:47:552
25609991716cyclictest377-1kworker/10:1H00:31:572
25609991716cyclictest377-1kworker/10:1H00:31:572
25609991716cyclictest28275-21python22:50:312
2560999170cyclictest92432sleep1020:11:012
2560999170cyclictest87802chrt19:26:342
2560999170cyclictest86502chrt23:55:042
2560999170cyclictest78752sleep1020:55:202
2560999170cyclictest71682sleep1022:22:532
2560999170cyclictest69982sleep1000:35:202
2560999170cyclictest68612sleep1023:05:362
2560999170cyclictest58682sleep1023:50:162
2560999170cyclictest51542chrt19:21:452
2560999170cyclictest5132chrt23:41:502
2560999170cyclictest34272sleep1022:16:292
2560999170cyclictest316952sleep1021:27:112
2560999170cyclictest3066450irq/53-eth0-tx-20:00:262
2560999170cyclictest3066450irq/53-eth0-tx-20:00:252
2560999170cyclictest3066350irq/52-eth0-rx-22:55:192
2560999170cyclictest3066350irq/52-eth0-rx-22:40:282
2560999170cyclictest3066350irq/52-eth0-rx-21:50:232
2560999170cyclictest3066350irq/52-eth0-rx-20:50:292
2560999170cyclictest3066350irq/52-eth0-rx-20:40:402
2560999170cyclictest3066350irq/52-eth0-rx-20:16:072
2560999170cyclictest3066350irq/52-eth0-rx-19:45:182
2560999170cyclictest3066350irq/52-eth0-rx-19:30:152
2560999170cyclictest296672sleep1000:20:422
2560999170cyclictest29542sleep1021:31:482
2560999170cyclictest293292sleep1023:36:392
2560999170cyclictest289552sleep1019:11:572
2560999170cyclictest284242sleep1022:06:152
2560999170cyclictest276712sleep1020:39:062
2560999170cyclictest266512sleep1021:20:232
2560999170cyclictest260782chrt00:16:182
2560999170cyclictest243092sleep1021:15:572
2560999170cyclictest239782chrt22:45:202
2560999170cyclictest239232chrt22:00:272
2560999170cyclictest239232chrt22:00:272
2560999170cyclictest225902chrt00:13:302
2560999170cyclictest220032sleep1023:26:022
2560999170cyclictest209692sleep1020:30:052
2560999170cyclictest194782chrt19:40:352
2560999170cyclictest188132sleep1000:06:282
2560999170cyclictest183562sleep1023:20:482
2560999170cyclictest182612sleep1021:55:022
2560999170cyclictest182612sleep1021:55:022
2560999170cyclictest179492sleep1022:35:552
2560999170cyclictest173322sleep1020:25:042
2560999170cyclictest172072sleep1021:08:332
2560999170cyclictest16762sleep1020:45:302
2560999170cyclictest165432sleep1020:21:162
2560999170cyclictest152532sleep1000:02:292
2560999170cyclictest145642sleep1022:34:312
2560999170cyclictest141362sleep1023:15:342
2560999170cyclictest134122sleep1021:02:072
2560999170cyclictest12250irq/42-ahci23:30:082
2560999170cyclictest12250irq/42-ahci22:10:042
2560999170cyclictest12250irq/42-ahci21:46:302
2560999170cyclictest12250irq/42-ahci21:40:122
2560999170cyclictest12250irq/42-ahci21:10:172
2560999170cyclictest12250irq/42-ahci19:50:082
2560999170cyclictest12250irq/42-ahci19:35:012
2560999170cyclictest12250irq/42-ahci19:35:012
2560999170cyclictest111152sleep1023:11:112
2560999170cyclictest11032chrt00:29:202
2560999170cyclictest106942sleep1022:26:182
2560899170cyclictest17168-1kworker/9:2H22:10:3411
25607991715cyclictest9625-21snmp_easybox.os19:30:1410
25607991715cyclictest8947-21iostat_ios21:40:2110
25607991715cyclictest8360-21snmp_easybox.os20:10:2710
25607991715cyclictest7540-21snmp_rack3slot923:06:5610
25607991715cyclictest735-21snmp_easybox.os20:00:2510
25607991715cyclictest735-21snmp_easybox.os20:00:2510
25607991715cyclictest6180-21perl23:50:1610
25607991715cyclictest32353-21snmp_rack3slot920:45:1510
25607991715cyclictest30558-21df_inode22:55:1510
25607991715cyclictest30547-21snmp_rack3slot922:10:1710
25607991715cyclictest29360-21iostat_ios19:55:2110
25607991715cyclictest29300-21snmp_rack3slot923:36:1410
25607991715cyclictest28847-21snmp_easybox.os21:25:1210
25607991715cyclictest28325-21snmp_easybox.os20:40:1410
25607991715cyclictest27197-21irqstats22:05:2410
25607991715cyclictest24013-21perl23:30:1710
25607991715cyclictest22643-21snmp_rack3slot921:15:1610
25607991715cyclictest2217-21snmp_easybox.os19:20:1210
25607991715cyclictest21113-21snmp_rack3slot921:56:2710
25607991715cyclictest21113-21snmp_rack3slot921:56:2610
25607991715cyclictest20477-21snmp_easybox.os19:45:1110
25607991715cyclictest16890-21snmp_easybox.os19:40:1110
25607991715cyclictest16625-21snmp_easybox.os21:50:2510
25607991715cyclictest16331-21snmp_rack3slot922:35:1610
25607991715cyclictest13768-21snmp_rack3slot919:35:1410
25607991715cyclictest13768-21snmp_rack3slot919:35:1410
25607991715cyclictest12785-21snmp_easybox.os21:45:2610
25607991715cyclictest11689-21perl21:00:1610
25607991715cyclictest10117-21snmp_easybox.os20:15:1410
25598991716cyclictest25327-21qemu-kvm19:40:147
25583991716cyclictest27802-21python22:05:321
2557399170cyclictest130692sleep020:18:420
2557399170cyclictest0-21swapper/021:20:330
2557399170cyclictest0-21swapper/020:00:300
2557399170cyclictest0-21swapper/020:00:300
2560999160cyclictest67292sleep1021:38:492
2560999160cyclictest40592chrt23:03:582
25608991615cyclictest17168-1kworker/9:2H20:10:4811
25608991615cyclictest0-21swapper/923:50:1411
2560799164cyclictest0-21swapper/822:20:0110
25607991614cyclictest7021-21irqstats00:35:2210
25607991614cyclictest4793-21iostat_ios20:50:2410
25607991614cyclictest3371-21iostat_ios00:30:1810
25607991614cyclictest3371-21iostat_ios00:30:1810
25607991614cyclictest2967-21iostat23:45:1810
25607991614cyclictest28980-21snmp_rack3slot922:52:1410
25607991614cyclictest28892-21ntp_states00:20:2510
25607991614cyclictest24345-21snmp_rack3slot919:50:1510
25607991614cyclictest19659-21memory21:10:2510
25607991614cyclictest17333-21munin-run21:10:0010
25607991614cyclictest16011-21snmp_rack3slot923:20:1210
25607991614cyclictest15191-21snmp_rack3slot900:01:4110
25607991614cyclictest13058-21perl23:15:1910
2560699164cyclictest0-21swapper/720:20:029
25606991610cyclictest0-21swapper/700:04:359
25598991615cyclictest770-21gltestperf20:45:177
25598991615cyclictest28619-21qemu-kvm22:15:477
2559599160cyclictest0-21swapper/300:38:035
2559599160cyclictest0-21swapper/300:10:345
25583991615cyclictest761-21python19:15:361
25583991615cyclictest26349-21python19:50:341
25583991615cyclictest19562-21python20:25:341
2557399160cyclictest0-21swapper/021:00:300
2561099154cyclictest0-21swapper/1121:20:373
2560899154cyclictest0-21swapper/922:00:0111
2560899154cyclictest0-21swapper/922:00:0111
25608991514cyclictest741rcuc/900:34:3111
25608991514cyclictest741rcuc/900:34:3111
25608991514cyclictest3370-21taskset22:15:4011
25608991513cyclictest15280-21chrt00:02:5211
2560899150cyclictest0-21swapper/921:55:3711
2560899150cyclictest0-21swapper/921:55:3711
25607991513cyclictest5506-21yum20:05:3710
25607991513cyclictest3843-21snmp_rack3slot923:01:0210
25607991513cyclictest23522-21irqstats22:00:2310
25607991513cyclictest23522-21irqstats22:00:2310
25607991513cyclictest23283-21snmp_rack3slot922:45:1610
25607991513cyclictest18019-21snmp_easybox.os00:05:2510
2560699154cyclictest18213-21entropy20:25:169
2560699154cyclictest0-21swapper/721:30:019
25606991512cyclictest26382-21perl21:20:179
25605991514cyclictest17174-21qemu-kvm21:24:258
25598991514cyclictest29977-21python19:55:327
25598991514cyclictest25328-21qemu-kvm19:35:057
25598991514cyclictest25328-21qemu-kvm19:35:047
25596991513cyclictest24604-21sensors22:45:296
2559599150cyclictest0-21swapper/321:52:455
2559599150cyclictest0-21swapper/320:15:405
25587991513cyclictest2406-21snmpd23:11:044
25587991513cyclictest2406-21snmpd21:37:494
25583991514cyclictest8636-21python20:10:321
25583991514cyclictest20476-21python21:55:331
25583991514cyclictest20476-21python21:55:331
25583991514cyclictest16360-21python21:05:351
2558399150cyclictest0-21swapper/122:20:331
2558399150cyclictest0-21swapper/121:30:141
2557399151cyclictest0-21swapper/020:35:170
2557399150cyclictest0-21swapper/023:40:260
2560899145cyclictest0-21swapper/900:05:2011
2560899143cyclictest0-21swapper/922:49:1811
25608991413cyclictest928-21taskset00:26:5311
25608991413cyclictest2331-21taskset20:46:2211
25608991413cyclictest0-21swapper/923:10:3411
25608991413cyclictest0-21swapper/921:54:0711
25608991413cyclictest0-21swapper/920:10:0111
25608991413cyclictest0-21swapper/919:20:1611
25608991412cyclictest25731-21chrt23:32:0111
25608991412cyclictest22093-21perl20:30:1611
2560699145cyclictest0-21swapper/723:10:019
2560699144cyclictest0-21swapper/721:40:029
2560699144cyclictest0-21swapper/700:20:029
2560699143cyclictest0-21swapper/719:15:289
2560699143cyclictest0-21swapper/700:25:189
25606991413cyclictest0-21swapper/721:52:459
2560599142cyclictest0-21swapper/620:38:138
25598991413cyclictest30169-21cstates22:55:147
25598991413cyclictest27337-21cstates00:20:137
25598991413cyclictest26936-21cstates23:35:147
25598991413cyclictest26061-21cstates22:05:147
25596991412cyclictest14483-21sensors00:00:296
2559599140cyclictest0-21swapper/323:55:085
2559599140cyclictest0-21swapper/320:35:185
2558799143cyclictest0-21swapper/220:49:204
25583991413cyclictest9561-21python21:40:291
25583991413cyclictest21794-21python00:10:241
25583991413cyclictest12685-21python21:00:311
2557399149cyclictest0-21swapper/021:40:290
2557399147cyclictest0-21swapper/019:15:330
2557399147cyclictest0-21swapper/000:00:280
2557399145cyclictest0-21swapper/023:38:210
2557399144cyclictest0-21swapper/021:11:090
2557399140cyclictest0-21swapper/023:55:140
2557399140cyclictest0-21swapper/023:50:450
2557399140cyclictest0-21swapper/023:00:010
2557399140cyclictest0-21swapper/022:50:330
2557399140cyclictest0-21swapper/021:35:240
2557399140cyclictest0-21swapper/020:46:040
2557399140cyclictest0-21swapper/020:35:000
2557399140cyclictest0-21swapper/020:26:590
2557399140cyclictest0-21swapper/019:30:280
2557399140cyclictest0-21swapper/019:20:010
411130ksoftirqd/40-21swapper/400:38:036
2561099135cyclictest0-21swapper/1120:17:033
2560899135cyclictest0-21swapper/923:55:0111
2560899134cyclictest0-21swapper/923:45:2111
2560899134cyclictest0-21swapper/923:35:2111
2560899134cyclictest0-21swapper/921:00:0111
2560899133cyclictest0-21swapper/923:44:1911
2560899133cyclictest0-21swapper/923:09:1911
2560899133cyclictest0-21swapper/920:54:3311
2560899133cyclictest0-21swapper/919:57:4811
2560899133cyclictest0-21swapper/919:48:4711
25608991312cyclictest0-21swapper/923:00:1611
25608991312cyclictest0-21swapper/920:40:1911
25608991312cyclictest0-21swapper/920:15:3311
25608991311cyclictest31287-21chrt22:55:2011
25607991311cyclictest22573-21iostat20:30:2110
2560699135cyclictest0-21swapper/722:47:279
2560699135cyclictest0-21swapper/700:30:189
2560699135cyclictest0-21swapper/700:30:179
2560699134cyclictest0-21swapper/723:30:019
2560699134cyclictest0-21swapper/721:40:019
2560699134cyclictest0-21swapper/720:15:019
2560699133cyclictest0-21swapper/722:38:489
2560699133cyclictest0-21swapper/722:30:189
2560699133cyclictest0-21swapper/721:26:169
2560699133cyclictest0-21swapper/720:25:019
2560699133cyclictest0-21swapper/700:36:239
2560699132cyclictest0-21swapper/720:30:029
25606991310cyclictest0-21swapper/720:57:049
2560699131cyclictest0-21swapper/721:45:189
2560599133cyclictest0-21swapper/619:34:568
2560599133cyclictest0-21swapper/619:26:128
25598991312cyclictest25381-21timerwakeupswit23:30:337
25598991312cyclictest14616-21cstates21:05:177
2559599130cyclictest0-21swapper/323:21:135
2559599130cyclictest0-21swapper/322:01:385
2559599130cyclictest0-21swapper/322:01:375
2559599130cyclictest0-21swapper/321:25:295
2559599130cyclictest0-21swapper/321:20:325
2559599130cyclictest0-21swapper/321:13:375
2559599130cyclictest0-21swapper/320:25:175
2559599130cyclictest0-21swapper/319:20:275
2559599130cyclictest0-21swapper/319:18:305
25587991311cyclictest14111-21turbostat21:50:014
2558399133cyclictest0-21swapper/123:55:201
25583991312cyclictest13713-21python22:30:301
2557399136cyclictest0-21swapper/019:50:180
2557399136cyclictest0-21swapper/019:25:380
2557399136cyclictest0-21swapper/000:25:420
2557399136cyclictest0-21swapper/000:05:210
2557399134cyclictest19195-21munin-node23:25:290
2557399134cyclictest0-21swapper/000:10:140
2557399133cyclictest2691-21runrttasks23:13:460
2557399133cyclictest2691-21runrttasks22:55:110
2557399133cyclictest2691-21runrttasks22:35:170
2557399131cyclictest0-21swapper/023:05:480
2557399131cyclictest0-21swapper/019:45:350
2557399131cyclictest0-21swapper/019:40:350
2557399131cyclictest0-21swapper/019:35:160
2557399131cyclictest0-21swapper/019:35:160
2557399131cyclictest0-21swapper/000:35:350
2557399131cyclictest0-21swapper/000:20:350
2557399130cyclictest6836-21munin-node20:55:310
2557399130cyclictest10455-21latency_hist21:45:010
2557399130cyclictest0-21swapper/022:40:010
2557399130cyclictest0-21swapper/022:30:140
2557399130cyclictest0-21swapper/022:25:130
2557399130cyclictest0-21swapper/022:22:030
2557399130cyclictest0-21swapper/022:15:160
2557399130cyclictest0-21swapper/022:15:010
2557399130cyclictest0-21swapper/022:08:540
2557399130cyclictest0-21swapper/022:00:010
2557399130cyclictest0-21swapper/022:00:010
2557399130cyclictest0-21swapper/020:40:170
2557399130cyclictest0-21swapper/020:07:100
2557399130cyclictest0-21swapper/019:55:050
2557399130cyclictest0-21swapper/000:16:490
201130ksoftirqd/10-21swapper/100:38:031
5299120watchdog/60-21swapper/622:59:558
481120ksoftirqd/50-21swapper/500:10:347
2561099124cyclictest0-21swapper/1123:35:013
2561099123cyclictest0-21swapper/1123:35:003
2561099123cyclictest0-21swapper/1119:50:023
2561099123cyclictest0-21swapper/1119:45:013
25610991210cyclictest0-21swapper/1121:10:173
2560899124cyclictest0-21swapper/919:25:0211
2560899123cyclictest0-21swapper/919:54:1811
2560899122cyclictest0-21swapper/920:02:4811
2560899122cyclictest0-21swapper/920:02:4711
2560699124cyclictest0-21swapper/723:18:089
2560699124cyclictest0-21swapper/719:54:319
2560699124cyclictest0-21swapper/719:35:389
2560699124cyclictest0-21swapper/719:35:389
2560699123cyclictest0-21swapper/722:10:019
2560699122cyclictest0-21swapper/723:35:289
2560699122cyclictest0-21swapper/722:00:259
2560699122cyclictest0-21swapper/722:00:259
2560699122cyclictest0-21swapper/721:09:459
2560699122cyclictest0-21swapper/720:43:499
2560699122cyclictest0-21swapper/719:29:289
25606991211cyclictest0-21swapper/723:47:219
25606991211cyclictest0-21swapper/719:20:279
25606991211cyclictest0-21swapper/700:08:589
25606991210cyclictest0-21swapper/722:21:249
25606991210cyclictest0-21swapper/721:17:379
25606991210cyclictest0-21swapper/720:47:579
25606991210cyclictest0-21swapper/720:35:179
25606991210cyclictest0-21swapper/719:45:129
25606991210cyclictest0-21swapper/700:18:449
2560699121cyclictest0-21swapper/723:25:059
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional