You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 16:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Mon Dec 01, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55662195160,12sleep30-21swapper/307:05:123
76572193177,11sleep10-21swapper/107:08:271
75442190174,12sleep00-21swapper/007:06:590
7695210689,12sleep20-21swapper/207:08:562
269962450,0sleep10-21swapper/110:25:201
285102430,0sleep10-21swapper/110:59:021
190282430,0sleep30-21swapper/309:16:443
170272430,0sleep20-21swapper/209:31:482
22422270,0sleep361-21kswapd011:18:063
196382100,0sleep00-21swapper/009:33:260
18732100,0sleep00-21swapper/010:29:350
79529980,4cyclictest10309-21munin-run07:15:010
8523250,0sleep10-21swapper/110:15:551
79669955,0cyclictest25877-21kworker/3:111:52:073
79669954,1cyclictest3984-21munin-run09:10:013
79669950,5cyclictest0-21swapper/310:40:163
79669950,4cyclictest0-21swapper/311:45:133
79629955,0cyclictest0-21swapper/212:32:482
79629954,1cyclictest31686-21rm11:32:422
79629950,5cyclictest0-21swapper/211:38:502
79629950,5cyclictest0-21swapper/210:23:532
79629950,5cyclictest0-21swapper/210:17:112
79629950,5cyclictest0-21swapper/209:45:202
79629950,4cyclictest0-21swapper/209:55:122
79629950,0cyclictest0-21swapper/209:35:432
79579951,2cyclictest0-21swapper/111:10:121
79579950,5cyclictest0-21swapper/109:15:111
79529955,0cyclictest0-21swapper/011:36:250
79529951,2cyclictest0-21swapper/007:20:120
79529950,5cyclictest0-21swapper/011:57:480
79529950,5cyclictest0-21swapper/011:33:210
79529950,5cyclictest0-21swapper/011:15:010
79529950,5cyclictest0-21swapper/010:53:470
79529950,5cyclictest0-21swapper/010:16:580
79529950,5cyclictest0-21swapper/009:35:130
79669944,0cyclictest0-21swapper/312:25:453
79669944,0cyclictest0-21swapper/311:01:053
79669944,0cyclictest0-21swapper/307:15:143
79669943,1cyclictest15536-21/usr/sbin/munin10:20:143
79669942,1cyclictest714-21snmpd08:42:263
79669942,1cyclictest24891-21/usr/sbin/munin12:35:133
79669940,4cyclictest4116-21ssh09:57:563
79669940,4cyclictest17102-21hddtemp_smartct07:25:173
79669940,4cyclictest13796-21apt-get07:20:113
79669940,4cyclictest12649-21ssh11:06:463
79669940,4cyclictest0-21swapper/312:30:123
79669940,4cyclictest0-21swapper/312:05:123
79669940,4cyclictest0-21swapper/311:55:263
79669940,4cyclictest0-21swapper/311:10:123
79669940,4cyclictest0-21swapper/310:10:123
79669940,4cyclictest0-21swapper/309:10:123
79669940,3cyclictest8587-21df07:10:143
79669940,3cyclictest6402-21cat08:10:013
79669940,3cyclictest4032-21hddtemp_smartct10:30:173
79669940,3cyclictest30274-21latency_hist12:05:003
79669940,3cyclictest29063-21dpkg08:55:003
79669940,3cyclictest28080-21ssh09:37:273
79669940,3cyclictest26964-21ssh10:25:193
79669940,3cyclictest26429-21sh10:09:233
79669940,3cyclictest23347-21ssh12:17:303
79669940,3cyclictest20046-21rm09:50:013
79669940,3cyclictest19020-21cut08:35:003
79669940,3cyclictest12666-21ssh12:11:593
79669940,3cyclictest12010-21ssh10:01:353
79669940,3cyclictest11478-21hddtemp_smartct10:50:143
79669940,3cyclictest0-21swapper/307:55:143
79669940,2cyclictest11262-21ssh11:22:303
79669940,1cyclictest620-21/usr/sbin/munin10:45:223
79669940,1cyclictest5533-21/usr/sbin/munin10:15:123
79669940,1cyclictest31684-21/usr/sbin/munin09:00:113
79669940,1cyclictest26582-21cut08:50:113
79669940,1cyclictest22009-21ntp_states10:55:193
79669940,1cyclictest21198-21/usr/sbin/munin07:35:123
79669940,1cyclictest19095-21/usr/sbin/munin08:35:153
79669940,1cyclictest15967-21/usr/sbin/munin11:25:163
79669940,1cyclictest14155-21/usr/sbin/munin08:25:163
79669940,1cyclictest1165-21/usr/sbin/munin08:00:133
79669940,1cyclictest1077-21fschecks_time09:40:153
79669940,1cyclictest0-21swapper/309:20:153
79669940,0cyclictest0-21swapper/311:40:473
79669940,0cyclictest0-21swapper/309:26:123
79629944,0cyclictest0-21swapper/210:47:092
79629944,0cyclictest0-21swapper/209:26:512
79629942,1cyclictest714-21snmpd09:40:332
79629941,3cyclictest714-21snmpd11:48:182
79629941,2cyclictest714-21snmpd07:56:022
79629940,4cyclictest30552-21apt-get11:00:042
79629940,4cyclictest0-21swapper/212:25:122
79629940,4cyclictest0-21swapper/212:20:112
79629940,4cyclictest0-21swapper/212:10:112
79629940,4cyclictest0-21swapper/212:00:102
79629940,4cyclictest0-21swapper/211:57:522
79629940,4cyclictest0-21swapper/211:50:152
79629940,4cyclictest0-21swapper/211:40:132
79629940,4cyclictest0-21swapper/210:55:132
79629940,4cyclictest0-21swapper/210:30:142
79629940,4cyclictest0-21swapper/210:05:152
79629940,4cyclictest0-21swapper/208:50:112
79629940,4cyclictest0-21swapper/208:25:122
79629940,4cyclictest0-21swapper/208:20:002
79629940,4cyclictest0-21swapper/207:10:132
79629940,3cyclictest745-21sh11:17:092
79629940,3cyclictest6500-21apt-get08:10:012
79629940,3cyclictest3978-21diskmemload09:10:012
79629940,3cyclictest30607-21/usr/sbin/munin12:05:152
79629940,3cyclictest29631-21/usr/sbin/munin10:10:212
79629940,3cyclictest27804-21ssh12:35:522
79629940,3cyclictest27529-21ssh09:20:422
79629940,3cyclictest2735-21sort10:30:012
79629940,3cyclictest25903-21rm10:40:502
79629940,3cyclictest19658-21awk11:10:172
79629940,3cyclictest15981-21ssh11:25:122
79629940,3cyclictest13840-21perl10:35:152
79629940,3cyclictest12801-21rm11:23:292
79629940,1cyclictest20572-21cut09:50:132
79629940,0cyclictest0-21swapper/209:15:032
79579944,0cyclictest0-21swapper/111:17:251
79579944,0cyclictest0-21swapper/110:43:561
79579944,0cyclictest0-21swapper/109:38:541
79579942,1cyclictest0-21swapper/111:40:131
79579941,2cyclictest0-21swapper/111:50:151
79579941,2cyclictest0-21swapper/110:20:131
79579941,2cyclictest0-21swapper/109:45:141
79579941,2cyclictest0-21swapper/108:10:111
79579941,2cyclictest0-21swapper/107:15:111
79579940,4cyclictest0-21swapper/112:28:331
79579940,4cyclictest0-21swapper/112:00:201
79579940,0cyclictest0-21swapper/110:06:241
79579940,0cyclictest0-21swapper/109:54:281
79579940,0cyclictest0-21swapper/108:07:401
79579940,0cyclictest0-21swapper/107:52:401
79529944,0cyclictest0-21swapper/012:11:280
79529944,0cyclictest0-21swapper/012:04:380
79529944,0cyclictest0-21swapper/011:54:450
79529944,0cyclictest0-21swapper/010:50:000
79529944,0cyclictest0-21swapper/010:04:190
79529944,0cyclictest0-21swapper/008:52:510
79529942,1cyclictest0-21swapper/007:29:560
79529941,3cyclictest24614-21awk07:40:150
79529941,2cyclictest0-21swapper/008:35:140
79529941,2cyclictest0-21swapper/008:05:160
79529941,2cyclictest0-21swapper/007:15:120
79529941,1cyclictest0-21swapper/011:45:130
79529941,1cyclictest0-21swapper/009:40:120
79529941,1cyclictest0-21swapper/008:30:120
79529941,1cyclictest0-21swapper/008:20:120
79529941,1cyclictest0-21swapper/008:15:130
79529940,4cyclictest3978-21diskmemload11:01:230
79529940,4cyclictest27461-21munin-run10:10:010
79529940,4cyclictest26299-21munin-run08:50:000
79529940,4cyclictest0-21swapper/012:25:090
79529940,4cyclictest0-21swapper/010:59:080
79529940,4cyclictest0-21swapper/010:40:160
79529940,4cyclictest0-21swapper/010:35:130
79529940,4cyclictest0-21swapper/010:21:370
79529940,4cyclictest0-21swapper/009:19:120
79529940,4cyclictest0-21swapper/008:40:110
79529940,4cyclictest0-21swapper/007:30:120
79529940,3cyclictest8687-21ssh10:32:340
79529940,3cyclictest5505-21ssh11:20:010
79529940,3cyclictest31687-21apt-get09:00:110
79529940,3cyclictest29905-21ntp_states07:50:180
79529940,3cyclictest28886-21ssh12:36:340
79529940,3cyclictest26644-21ssh09:53:010
79529940,3cyclictest15667-21cp11:25:020
79529940,3cyclictest13788-21ssh09:14:480
79529940,3cyclictest13081-21ssh11:40:010
79529940,3cyclictest10959-21ssh09:45:150
79669932,1cyclictest12850-21ssh10:35:033
79669930,3cyclictest9825-21hddtemp_smartct08:15:163
79669930,3cyclictest3280-21ssh11:35:073
79669930,3cyclictest27875-21aten2_r5power_v12:20:123
79669930,3cyclictest26341-21cstates11:30:143
79669930,3cyclictest11238-21apt-get08:20:003
79669930,3cyclictest10325-21ssh09:45:113
79669930,3cyclictest0-21swapper/309:30:033
79669930,3cyclictest0-21swapper/308:45:153
79669930,3cyclictest0-21swapper/308:05:013
79669930,3cyclictest0-21swapper/307:50:103
79669930,3cyclictest0-21swapper/307:45:013
79669930,3cyclictest0-21swapper/307:40:113
79669930,3cyclictest0-21swapper/307:30:123
79629932,1cyclictest714-21snmpd07:35:112
79629931,2cyclictest714-21snmpd08:40:112
79629931,1cyclictest1743-21apt-get09:05:142
79629930,3cyclictest8878-21hddtemp_smartct10:00:142
79629930,3cyclictest17382-21grep08:30:152
79629930,3cyclictest11043-21basename07:15:012
79629930,3cyclictest0-21swapper/212:15:022
79629930,3cyclictest0-21swapper/211:05:072
79629930,3cyclictest0-21swapper/210:50:122
79629930,3cyclictest0-21swapper/208:55:102
79629930,3cyclictest0-21swapper/208:45:112
79629930,3cyclictest0-21swapper/208:35:142
79629930,3cyclictest0-21swapper/208:15:112
79629930,3cyclictest0-21swapper/208:05:162
79629930,3cyclictest0-21swapper/208:00:102
79629930,3cyclictest0-21swapper/207:50:122
79629930,3cyclictest0-21swapper/207:45:132
79629930,3cyclictest0-21swapper/207:40:112
79629930,3cyclictest0-21swapper/207:30:102
79629930,3cyclictest0-21swapper/207:25:132
79629930,3cyclictest0-21swapper/207:20:122
79629930,2cyclictest316772sleep209:00:042
79579933,0cyclictest0-21swapper/110:01:101
79579931,1cyclictest0-21swapper/112:35:131
79579931,1cyclictest0-21swapper/112:30:121
79579931,1cyclictest0-21swapper/111:55:101
79579931,1cyclictest0-21swapper/111:45:141
79579931,1cyclictest0-21swapper/111:30:131
79579931,1cyclictest0-21swapper/111:05:121
79579931,1cyclictest0-21swapper/110:50:121
79579931,1cyclictest0-21swapper/110:35:131
79579931,1cyclictest0-21swapper/110:30:141
79579931,1cyclictest0-21swapper/109:55:131
79579931,1cyclictest0-21swapper/109:30:121
79579931,1cyclictest0-21swapper/109:20:121
79579931,1cyclictest0-21swapper/108:50:111
79579931,1cyclictest0-21swapper/108:40:111
79579931,1cyclictest0-21swapper/108:30:131
79579931,1cyclictest0-21swapper/108:25:111
79579931,1cyclictest0-21swapper/107:55:131
79579931,1cyclictest0-21swapper/107:45:131
79579931,1cyclictest0-21swapper/107:30:121
79579931,1cyclictest0-21swapper/107:20:111
79579931,1cyclictest0-21swapper/107:10:131
79579930,3cyclictest0-21swapper/108:56:151
79579930,2cyclictest4196-21chrt12:24:421
79579930,2cyclictest27920-21chrt10:10:101
79579930,2cyclictest25734-21chrt07:42:421
79579930,2cyclictest0-21swapper/112:15:131
79579930,2cyclictest0-21swapper/110:45:131
79529932,1cyclictest714-21snmpd08:00:050
79529932,1cyclictest714-21snmpd07:35:050
79529931,1cyclictest714-21snmpd07:55:080
79529931,1cyclictest0-21swapper/007:45:140
79529930,3cyclictest3978-21diskmemload11:10:100
79529930,3cyclictest3123-21diskstats09:25:140
79529930,3cyclictest305912sleep012:05:110
79529930,3cyclictest27945-21ssh10:10:110
79529930,3cyclictest24850-21ssh09:20:100
79529930,3cyclictest16147-21irqstats12:30:160
79529930,3cyclictest0-21swapper/012:20:110
79529930,3cyclictest0-21swapper/011:05:110
79529930,3cyclictest0-21swapper/009:55:040
79529930,3cyclictest0-21swapper/009:05:150
79529930,3cyclictest0-21swapper/008:55:110
79529930,3cyclictest0-21swapper/008:25:110
79529930,3cyclictest0-21swapper/008:10:100
79529930,1cyclictest17763-21ssh12:15:060
21755230,0sleep10-21swapper/107:35:131
79579921,1cyclictest190842chrt08:35:051
79579921,1cyclictest0-21swapper/111:00:131
79579921,1cyclictest0-21swapper/109:05:141
79579921,1cyclictest0-21swapper/108:45:141
79579921,1cyclictest0-21swapper/107:25:131
79579921,0cyclictest0-21swapper/108:00:101
79579920,1cyclictest6344-21taskset11:20:121
79579920,1cyclictest0-21swapper/112:10:121
79579920,1cyclictest0-21swapper/112:05:121
79579920,1cyclictest0-21swapper/111:35:101
79579920,1cyclictest0-21swapper/111:25:021
79579920,1cyclictest0-21swapper/109:40:121
79579920,1cyclictest0-21swapper/109:25:131
79579920,1cyclictest0-21swapper/109:10:121
79579920,1cyclictest0-21swapper/109:00:121
79579920,1cyclictest0-21swapper/108:20:121
79579920,1cyclictest0-21swapper/108:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional