You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 17:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Thu Nov 06, 2025 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
69632189174,10sleep10-21swapper/107:09:521
66262187170,13sleep20-21swapper/207:05:282
69692186169,13sleep00-21swapper/007:09:540
68362184167,12sleep30-21swapper/307:08:133
143322480,0sleep20-21swapper/208:25:182
245832470,0sleep30-21swapper/311:29:553
226582450,0sleep20-21swapper/209:35:162
105792450,0sleep10-21swapper/110:34:051
89562440,0sleep30-21swapper/311:38:003
250932410,0sleep10-21swapper/109:36:201
140932120,0sleep10-21swapper/110:51:291
174122110,0sleep20-21swapper/209:16:302
204382100,0sleep00-21swapper/011:43:570
7567290,0sleep10-21swapper/109:44:201
71389973,4cyclictest9522-21perf07:15:000
71389971,5cyclictest0-21swapper/007:40:110
71389970,3cyclictest32083-21perf10:45:010
1981270,0sleep20-21swapper/210:29:582
71489966,0cyclictest391ktimersoftd/308:50:163
71489965,1cyclictest40-21ksoftirqd/312:10:123
71489965,1cyclictest40-21ksoftirqd/308:00:163
71489965,0cyclictest391ktimersoftd/311:20:163
71489964,2cyclictest40-21ksoftirqd/310:10:213
71489963,3cyclictest40-21ksoftirqd/307:55:103
27328260,0sleep10-21swapper/110:10:101
25182260,0sleep00-21swapper/009:36:230
71489955,0cyclictest40-21ksoftirqd/312:25:123
71489955,0cyclictest40-21ksoftirqd/311:49:593
71489955,0cyclictest40-21ksoftirqd/310:30:103
71489955,0cyclictest40-21ksoftirqd/310:00:133
71489955,0cyclictest40-21ksoftirqd/308:55:123
71489955,0cyclictest40-21ksoftirqd/308:35:143
71489955,0cyclictest40-21ksoftirqd/308:05:173
71489955,0cyclictest391ktimersoftd/312:30:113
71489955,0cyclictest391ktimersoftd/311:05:173
71489955,0cyclictest391ktimersoftd/311:05:163
71489955,0cyclictest391ktimersoftd/309:20:123
71489954,1cyclictest40-21ksoftirqd/307:50:153
71489953,2cyclictest40-21ksoftirqd/309:40:003
71489953,1cyclictest391ktimersoftd/312:00:123
71489952,0cyclictest22852-21apt-get08:45:123
71489951,3cyclictest31248-21sh10:27:573
71489950,5cyclictest0-21swapper/309:30:553
71489950,4cyclictest924-21perl11:50:143
71449955,0cyclictest0-21swapper/211:38:202
71449950,5cyclictest0-21swapper/210:07:412
71449950,4cyclictest5124-21ssh11:20:022
71449950,4cyclictest0-21swapper/209:00:012
71449950,0cyclictest0-21swapper/211:47:222
71449950,0cyclictest0-21swapper/210:58:202
71399955,0cyclictest0-21swapper/108:40:141
71399951,2cyclictest0-21swapper/107:50:101
71399950,5cyclictest0-21swapper/111:02:151
71399950,5cyclictest0-21swapper/109:26:051
71389955,0cyclictest0-21swapper/010:45:320
71389950,5cyclictest0-21swapper/009:11:510
71389950,4cyclictest18266-21ssh12:31:280
71489944,0cyclictest40-21ksoftirqd/312:15:003
71489944,0cyclictest40-21ksoftirqd/310:55:143
71489944,0cyclictest40-21ksoftirqd/310:40:153
71489944,0cyclictest40-21ksoftirqd/309:25:123
71489944,0cyclictest40-21ksoftirqd/309:15:153
71489944,0cyclictest40-21ksoftirqd/309:00:003
71489944,0cyclictest40-21ksoftirqd/308:25:023
71489944,0cyclictest40-21ksoftirqd/307:45:163
71489944,0cyclictest40-21ksoftirqd/307:25:163
71489944,0cyclictest40-21ksoftirqd/307:20:143
71489944,0cyclictest391ktimersoftd/310:15:173
71489944,0cyclictest391ktimersoftd/310:05:183
71489944,0cyclictest0-21swapper/309:47:313
71489943,1cyclictest40-21ksoftirqd/308:10:153
71489942,2cyclictest40-21ksoftirqd/309:11:533
71489942,1cyclictest714-21snmpd08:16:443
71489940,4cyclictest0-21swapper/312:20:123
71489940,4cyclictest0-21swapper/312:05:123
71489940,4cyclictest0-21swapper/311:15:323
71489940,4cyclictest0-21swapper/310:50:533
71489940,4cyclictest0-21swapper/310:21:143
71489940,4cyclictest0-21swapper/309:50:543
71489940,4cyclictest0-21swapper/309:43:093
71489940,3cyclictest9813-21python07:15:003
71489940,3cyclictest501-21apt09:05:143
71489940,3cyclictest23420-21diskstats07:40:123
71489940,3cyclictest2228-21rm10:45:213
71489940,3cyclictest18871-21/usr/sbin/munin11:10:173
71489940,3cyclictest15663-21grep08:30:123
71489940,3cyclictest15102-21sh11:40:333
71489940,3cyclictest10906-21tune2fs08:20:143
71489940,3cyclictest0-21swapper/311:30:113
71489940,3cyclictest0-21swapper/311:00:083
71489940,3cyclictest0-21swapper/310:35:143
71489940,1cyclictest10934-21grep11:55:143
71449944,0cyclictest0-21swapper/211:02:062
71449944,0cyclictest0-21swapper/210:39:242
71449942,2cyclictest714-21snmpd10:46:402
71449942,1cyclictest714-21snmpd10:02:362
71449942,1cyclictest415-21wget08:00:152
71449942,1cyclictest24731-21ssh12:02:012
71449941,3cyclictest9283-21ssh09:29:012
71449941,3cyclictest714-21snmpd12:30:182
71449941,3cyclictest28702-21cat08:55:152
71449940,4cyclictest7793-21ssh11:05:122
71449940,4cyclictest7793-21ssh11:05:122
71449940,4cyclictest29617-21ssh10:10:272
71449940,4cyclictest28196-21ssh09:21:552
71449940,4cyclictest2776-21diskmemload12:10:112
71449940,4cyclictest25098-21perf08:49:592
71449940,4cyclictest17927-21apt-get07:30:112
71449940,4cyclictest0-21swapper/212:25:102
71449940,4cyclictest0-21swapper/212:06:542
71449940,4cyclictest0-21swapper/211:55:112
71449940,4cyclictest0-21swapper/211:50:112
71449940,4cyclictest0-21swapper/211:41:552
71449940,4cyclictest0-21swapper/211:30:182
71449940,4cyclictest0-21swapper/211:25:232
71449940,4cyclictest0-21swapper/211:10:442
71449940,4cyclictest0-21swapper/210:40:082
71449940,4cyclictest0-21swapper/210:23:462
71449940,4cyclictest0-21swapper/209:55:392
71449940,4cyclictest0-21swapper/209:40:132
71449940,4cyclictest0-21swapper/209:11:572
71449940,4cyclictest0-21swapper/209:05:142
71449940,4cyclictest0-21swapper/208:53:172
71449940,4cyclictest0-21swapper/208:20:122
71449940,4cyclictest0-21swapper/208:15:162
71449940,4cyclictest0-21swapper/207:55:162
71449940,4cyclictest0-21swapper/207:40:122
71449940,3cyclictest8842-21ssh10:16:262
71449940,3cyclictest31808-21ssh11:16:402
71449940,3cyclictest2320-21rm10:30:012
71449940,3cyclictest19407-21python08:35:212
71449940,3cyclictest17287-21/usr/sbin/munin12:15:182
71449940,3cyclictest0-21swapper/207:10:142
71449940,0cyclictest0-21swapper/209:48:032
71399944,0cyclictest0-21swapper/112:01:101
71399944,0cyclictest0-21swapper/111:56:391
71399944,0cyclictest0-21swapper/111:27:171
71399944,0cyclictest0-21swapper/110:41:001
71399944,0cyclictest0-21swapper/110:37:131
71399944,0cyclictest0-21swapper/109:22:171
71399941,2cyclictest0-21swapper/111:45:111
71399941,2cyclictest0-21swapper/109:00:131
71399941,1cyclictest0-21swapper/112:35:121
71399941,1cyclictest0-21swapper/108:45:111
71399940,4cyclictest0-21swapper/112:19:571
71399940,4cyclictest0-21swapper/111:40:041
71399940,4cyclictest0-21swapper/108:58:421
71399940,4cyclictest0-21swapper/108:30:111
71399940,4cyclictest0-21swapper/107:12:211
71399940,2cyclictest0-21swapper/109:55:161
71399940,0cyclictest0-21swapper/110:00:081
71389944,0cyclictest0-21swapper/010:53:060
71389944,0cyclictest0-21swapper/009:23:540
71389943,1cyclictest18983-21ssh12:15:210
71389942,1cyclictest683-21df11:50:140
71389942,1cyclictest0-21swapper/011:30:120
71389941,2cyclictest0-21swapper/011:45:100
71389941,2cyclictest0-21swapper/010:55:120
71389941,2cyclictest0-21swapper/009:55:150
71389941,2cyclictest0-21swapper/008:55:110
71389941,2cyclictest0-21swapper/008:45:120
71389941,2cyclictest0-21swapper/007:50:100
71389941,1cyclictest0-21swapper/011:10:130
71389941,1cyclictest0-21swapper/010:00:120
71389940,4cyclictest32651-21ssh10:12:220
71389940,4cyclictest19996-21ssh12:00:120
71389940,4cyclictest15316-21apt-get11:25:110
71389940,4cyclictest0-21swapper/012:25:110
71389940,4cyclictest0-21swapper/012:20:130
71389940,4cyclictest0-21swapper/012:11:210
71389940,4cyclictest0-21swapper/011:35:150
71389940,4cyclictest0-21swapper/011:15:120
71389940,4cyclictest0-21swapper/010:20:120
71389940,4cyclictest0-21swapper/010:15:450
71389940,4cyclictest0-21swapper/009:45:130
71389940,4cyclictest0-21swapper/009:40:140
71389940,4cyclictest0-21swapper/009:30:110
71389940,4cyclictest0-21swapper/008:50:100
71389940,4cyclictest0-21swapper/008:35:120
71389940,4cyclictest0-21swapper/007:25:100
71389940,3cyclictest9625-21users08:15:190
71389940,3cyclictest8377-21ssh10:32:400
71389940,3cyclictest6628-21memory11:20:180
71389940,3cyclictest3630-21ssh12:07:570
71389940,3cyclictest2778-21latency_hist09:10:000
71389940,3cyclictest2776-21diskmemload11:00:020
71389940,3cyclictest25043-21ssh10:25:110
71389940,3cyclictest16673-21tr08:30:170
71389940,3cyclictest15953-21ssh09:15:370
71389940,3cyclictest12298-21ssh11:06:550
71389940,3cyclictest12298-21ssh11:06:550
71389940,3cyclictest11729-21ssh11:55:190
71389940,3cyclictest0-21swapper/009:50:140
71389940,3cyclictest0-21swapper/008:40:110
71389940,3cyclictest0-21swapper/008:25:020
71389940,3cyclictest0-21swapper/008:05:140
71389940,3cyclictest0-21swapper/008:00:150
71389940,0cyclictest0-21swapper/012:35:320
71489933,0cyclictest40-21ksoftirqd/309:55:013
71489930,3cyclictest7450-21grep07:10:153
71489930,3cyclictest24233-21sh12:35:103
71489930,3cyclictest20483-21tr07:35:133
71489930,3cyclictest0-21swapper/308:40:023
71489930,3cyclictest0-21swapper/307:30:113
71449932,1cyclictest714-21snmpd07:50:232
71449932,1cyclictest714-21snmpd07:45:022
71449932,1cyclictest714-21snmpd07:35:062
71449932,1cyclictest714-21snmpd07:25:172
71449931,1cyclictest225-21systemd-journal08:30:002
71449931,1cyclictest10273-21aten2_r5power_c07:15:012
71449930,3cyclictest21621-21/usr/sbin/munin08:40:172
71449930,3cyclictest19021-21ssh09:50:062
71449930,3cyclictest11777-21grep09:30:122
71449930,3cyclictest10059-21ssh10:50:072
71449930,3cyclictest0-21swapper/212:35:032
71449930,3cyclictest0-21swapper/212:20:002
71449930,3cyclictest0-21swapper/208:10:122
71449930,3cyclictest0-21swapper/208:05:142
71449930,3cyclictest0-21swapper/207:20:132
71399933,0cyclictest0-21swapper/112:34:121
71399933,0cyclictest0-21swapper/112:10:551
71399933,0cyclictest0-21swapper/110:55:251
71399933,0cyclictest0-21swapper/110:07:421
71399933,0cyclictest0-21swapper/109:18:301
71399933,0cyclictest0-21swapper/109:14:441
71399933,0cyclictest0-21swapper/108:53:191
71399933,0cyclictest0-21swapper/108:10:501
71399933,0cyclictest0-21swapper/108:02:581
71399933,0cyclictest0-21swapper/107:30:571
71399933,0cyclictest0-21swapper/107:20:471
71399933,0cyclictest0-21swapper/107:15:241
71399931,1cyclictest0-21swapper/112:05:111
71399931,1cyclictest0-21swapper/111:30:121
71399931,1cyclictest0-21swapper/111:15:121
71399931,1cyclictest0-21swapper/110:15:121
71399931,1cyclictest0-21swapper/109:50:111
71399931,1cyclictest0-21swapper/109:45:111
71399931,1cyclictest0-21swapper/109:05:151
71399931,1cyclictest0-21swapper/108:35:131
71399931,1cyclictest0-21swapper/108:25:011
71399931,1cyclictest0-21swapper/108:20:111
71399931,1cyclictest0-21swapper/107:45:121
71399931,1cyclictest0-21swapper/107:35:121
71399930,2cyclictest17523-21chrt07:28:001
71399930,2cyclictest0-21swapper/110:20:121
71399930,1cyclictest0-21swapper/111:10:121
71399930,0cyclictest0-21swapper/107:57:261
71389931,1cyclictest714-21snmpd07:15:120
71389931,1cyclictest1307-21apt-get09:25:120
71389931,1cyclictest0-21swapper/008:20:120
71389931,1cyclictest0-21swapper/007:45:110
71389930,3cyclictest5311-21apt-get08:10:120
71389930,3cyclictest20397-21apt07:35:120
71389930,3cyclictest17193-21ssh10:05:150
71389930,3cyclictest0-21swapper/010:35:030
71389930,3cyclictest0-21swapper/009:00:000
71389930,3cyclictest0-21swapper/007:55:100
71389930,3cyclictest0-21swapper/007:30:090
71389930,3cyclictest0-21swapper/007:20:140
71399921,1cyclictest0-21swapper/111:05:131
71399921,1cyclictest0-21swapper/111:05:121
71399921,1cyclictest0-21swapper/109:30:121
71399921,1cyclictest0-21swapper/108:20:011
71399921,1cyclictest0-21swapper/108:05:131
71399921,1cyclictest0-21swapper/107:40:121
71399920,2cyclictest4157-21taskset11:51:351
71399920,1cyclictest4943-21chrt10:47:011
71399920,1cyclictest27086-21chrt12:20:101
71399920,1cyclictest0-21swapper/112:25:101
71399920,1cyclictest0-21swapper/111:35:141
71399920,1cyclictest0-21swapper/111:20:021
71399920,1cyclictest0-21swapper/110:25:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional