You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-29 - 17:43
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Oct 29, 2025 12:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160572213149,23sleep20-21swapper/207:09:282
158422202162,26sleep30-21swapper/307:06:393
160192198159,26sleep10-21swapper/107:09:001
157822198160,25sleep00-21swapper/007:05:520
148842660,0sleep10-21swapper/111:30:111
1620299180,17cyclictest0-21swapper/111:05:201
16193991818,0cyclictest9-21ksoftirqd/012:10:150
16193991716,1cyclictest9-21ksoftirqd/010:35:240
16193991716,1cyclictest9-21ksoftirqd/007:35:170
16193991716,1cyclictest9-21ksoftirqd/007:35:160
1621099160,15cyclictest30953-21fschecks_count08:45:142
1621099160,15cyclictest28885-21apt-get10:20:122
16193991616,0cyclictest9-21ksoftirqd/010:10:120
16193991616,0cyclictest9-21ksoftirqd/010:02:320
1621099150,14cyclictest9495-21diskmemload12:30:152
1621099150,14cyclictest9495-21diskmemload09:15:172
1621099150,14cyclictest32633-21sort11:10:012
1621099150,14cyclictest0-21swapper/208:05:122
16193991515,0cyclictest9-21ksoftirqd/010:53:150
16193991514,1cyclictest9-21ksoftirqd/009:37:510
16193991514,1cyclictest9-21ksoftirqd/008:30:200
16193991514,1cyclictest9-21ksoftirqd/008:30:190
16193991511,3cyclictest9-21ksoftirqd/011:00:000
1621099140,13cyclictest32654-21basename10:25:142
1621099140,13cyclictest32654-21basename10:25:132
1621099140,13cyclictest28555-21cut09:35:012
1621099140,13cyclictest25885-21apt11:45:152
1621099140,13cyclictest21664-21fschecks_time09:25:162
1621099140,13cyclictest19788-21awk10:05:242
1621099140,13cyclictest18030-21ssh11:34:362
1621099140,13cyclictest0-21swapper/207:30:142
16193991414,0cyclictest9-21ksoftirqd/012:31:030
16193991414,0cyclictest9-21ksoftirqd/010:28:090
16193991414,0cyclictest9-21ksoftirqd/010:28:090
16193991414,0cyclictest9-21ksoftirqd/009:52:000
16193991414,0cyclictest9-21ksoftirqd/009:30:520
1621099132,10cyclictest29823-21hostname11:50:152
1621099130,13cyclictest0-21swapper/211:35:182
1621099130,13cyclictest0-21swapper/211:00:132
1621099130,12cyclictest8569-21ntp_states10:35:232
1621099130,12cyclictest0-21swapper/212:05:202
1621099130,12cyclictest0-21swapper/211:20:152
1621099130,12cyclictest0-21swapper/210:59:032
1621099130,12cyclictest0-21swapper/210:30:152
1621099130,12cyclictest0-21swapper/207:40:162
1621099130,0cyclictest0-21swapper/209:41:542
1621099130,0cyclictest0-21swapper/208:10:142
16193991313,0cyclictest9-21ksoftirqd/012:21:290
16193991313,0cyclictest9-21ksoftirqd/012:16:310
16193991313,0cyclictest9-21ksoftirqd/012:05:030
16193991313,0cyclictest9-21ksoftirqd/011:36:180
16193991313,0cyclictest9-21ksoftirqd/011:22:170
16193991313,0cyclictest9-21ksoftirqd/011:00:150
16193991313,0cyclictest9-21ksoftirqd/009:40:260
16193991313,0cyclictest9-21ksoftirqd/009:26:080
16193991312,1cyclictest9-21ksoftirqd/012:25:120
16193991312,1cyclictest9-21ksoftirqd/011:51:350
16193991312,1cyclictest9-21ksoftirqd/011:20:000
16193991312,1cyclictest9-21ksoftirqd/011:10:130
16193991312,1cyclictest9-21ksoftirqd/008:25:140
16193991311,1cyclictest9-21ksoftirqd/010:30:220
1621099122,9cyclictest0-21swapper/207:56:072
1621099120,9cyclictest19408-21ntp_offset10:50:182
1621099120,12cyclictest0-21swapper/209:50:122
1621099120,12cyclictest0-21swapper/207:25:132
1621099120,11cyclictest5096-21grep11:15:222
1621099120,11cyclictest247822chrt11:42:352
1621099120,11cyclictest22822-21ntp_states10:10:192
1621099120,11cyclictest0-21swapper/212:25:132
1621099120,11cyclictest0-21swapper/212:01:002
1621099120,11cyclictest0-21swapper/211:28:062
1621099120,11cyclictest0-21swapper/210:46:542
1621099120,11cyclictest0-21swapper/210:16:492
1621099120,11cyclictest0-21swapper/209:20:142
1621099120,11cyclictest0-21swapper/208:20:152
1621099120,10cyclictest0-21swapper/208:40:222
1621099120,0cyclictest0-21swapper/208:35:012
1621099120,0cyclictest0-21swapper/208:35:002
1621099120,0cyclictest0-21swapper/207:50:192
16193991212,0cyclictest9-21ksoftirqd/011:40:150
16193991211,1cyclictest9-21ksoftirqd/012:00:010
16193991211,1cyclictest9-21ksoftirqd/011:30:120
16193991211,1cyclictest9-21ksoftirqd/011:25:110
16193991211,1cyclictest9-21ksoftirqd/010:45:130
16193991211,1cyclictest9-21ksoftirqd/010:40:130
16193991211,1cyclictest9-21ksoftirqd/010:15:170
16193991211,1cyclictest9-21ksoftirqd/009:55:130
16193991211,1cyclictest9-21ksoftirqd/009:45:140
16193991211,1cyclictest9-21ksoftirqd/009:15:180
16193991211,1cyclictest9-21ksoftirqd/008:50:130
16193991211,1cyclictest9-21ksoftirqd/007:35:010
16193991210,1cyclictest9-21ksoftirqd/011:55:170
16193991210,1cyclictest9-21ksoftirqd/011:09:590
16193991210,1cyclictest9-21ksoftirqd/009:10:130
16193991210,1cyclictest9-21ksoftirqd/007:55:000
291372110,1sleep10-21swapper/112:33:131
1621099111,9cyclictest30658-21run-parts07:35:232
1621099111,9cyclictest30658-21run-parts07:35:222
1621099110,8cyclictest3144-21timerwakeupswit07:45:222
1621099110,11cyclictest0-21swapper/211:55:072
1621099110,11cyclictest0-21swapper/211:11:182
1621099110,11cyclictest0-21swapper/209:35:282
1621099110,11cyclictest0-21swapper/208:25:142
1621099110,10cyclictest7870-21df09:05:112
1621099110,10cyclictest21216-21chrt07:15:482
1621099110,10cyclictest13115-21awk12:10:192
1621099110,10cyclictest0-21swapper/212:39:142
1621099110,10cyclictest0-21swapper/212:20:022
1621099110,10cyclictest0-21swapper/212:15:032
1621099110,10cyclictest0-21swapper/209:58:432
1621099110,10cyclictest0-21swapper/209:46:092
1621099110,10cyclictest0-21swapper/209:10:392
1621099110,10cyclictest0-21swapper/208:15:202
1621099110,0cyclictest0-21swapper/210:43:302
1619399119,1cyclictest9-21ksoftirqd/009:05:120
1619399119,1cyclictest9-21ksoftirqd/008:35:150
1619399119,1cyclictest9-21ksoftirqd/007:45:000
1619399113,8cyclictest9-21ksoftirqd/007:25:570
16193991111,0cyclictest9-21ksoftirqd/011:45:290
16193991110,1cyclictest9-21ksoftirqd/012:35:160
16193991110,1cyclictest9-21ksoftirqd/010:20:120
16193991110,1cyclictest9-21ksoftirqd/010:08:230
16193991110,1cyclictest9-21ksoftirqd/009:20:190
16193991110,1cyclictest9-21ksoftirqd/008:45:120
16193991110,1cyclictest9-21ksoftirqd/008:40:010
16193991110,1cyclictest9-21ksoftirqd/008:00:140
16193991110,1cyclictest9-21ksoftirqd/007:59:590
16193991110,1cyclictest9-21ksoftirqd/007:20:140
16193991110,1cyclictest9-21ksoftirqd/007:20:000
1621099100,10cyclictest0-21swapper/210:00:082
1621099100,0cyclictest0-21swapper/207:10:192
1619399109,1cyclictest9-21ksoftirqd/009:00:210
1619399109,1cyclictest9-21ksoftirqd/008:55:130
1619399109,1cyclictest9-21ksoftirqd/008:20:140
1619399109,1cyclictest9-21ksoftirqd/008:15:180
1619399109,1cyclictest9-21ksoftirqd/008:10:130
1619399109,1cyclictest9-21ksoftirqd/007:45:150
1619399109,1cyclictest9-21ksoftirqd/007:10:010
1619399108,1cyclictest9-21ksoftirqd/008:05:120
162159992,6cyclictest18552-21munin-node07:27:103
162109991,7cyclictest27542-21cron08:40:002
162109990,0cyclictest0-21swapper/208:55:172
162159982,2cyclictest3946-21apt-get07:50:143
162159980,6cyclictest2651-21apt-get08:55:133
162159980,5cyclictest1-21systemd11:10:403
162159980,5cyclictest0-21swapper/312:31:033
162159980,4cyclictest29683-21apt-get11:50:133
162159980,3cyclictest5026-21apt-get09:00:133
162109981,6cyclictest1061-21expr08:50:172
162109980,5cyclictest254-21systemd-journal09:00:202
162029981,4cyclictest0-21swapper/109:24:501
162029980,7cyclictest0-21swapper/112:05:191
162159976,1cyclictest35-21ksoftirqd/308:30:013
162159976,1cyclictest1164-21cat08:50:163
162159975,0cyclictest9495-21diskmemload11:28:323
162159974,2cyclictest9495-21diskmemload10:25:173
162159974,2cyclictest9495-21diskmemload10:25:163
162159974,1cyclictest9495-21diskmemload09:28:213
162159974,1cyclictest26050-21telnet11:45:173
162159973,1cyclictest9495-21diskmemload10:18:173
162159972,2cyclictest9495-21diskmemload11:43:163
162159972,2cyclictest9495-21diskmemload11:05:363
162159972,2cyclictest9495-21diskmemload09:35:043
162159972,2cyclictest3671-21apt-get09:45:123
162159972,2cyclictest1894-21users09:40:253
162159971,3cyclictest9495-21diskmemload11:30:483
162159971,3cyclictest9495-21diskmemload10:50:353
162159970,6cyclictest15558-21ssh09:16:143
162159970,4cyclictest0-21swapper/310:09:203
162159970,2cyclictest12321-21runrttasks09:12:453
162159970,2cyclictest0-21swapper/311:15:153
162159970,2cyclictest0-21swapper/310:55:113
162159970,2cyclictest0-21swapper/309:58:003
162109972,4cyclictest8954-21grep08:00:152
162109970,6cyclictest22526-21perl07:20:172
162029970,7cyclictest0-21swapper/111:45:011
162029970,4cyclictest0-21swapper/110:30:131
162029970,4cyclictest0-21swapper/109:50:151
162029970,3cyclictest0-21swapper/111:13:271
162029970,1cyclictest0-21swapper/112:15:171
162029970,1cyclictest0-21swapper/109:30:181
162159965,1cyclictest35-21ksoftirqd/309:07:403
162159965,1cyclictest35-21ksoftirqd/307:24:173
162159965,1cyclictest28381-21ssh11:03:373
162159965,1cyclictest23490-21ssh10:10:363
162159965,1cyclictest19021-21ssh09:20:243
162159965,1cyclictest1772-21cat11:55:183
162159965,1cyclictest16969-21ssh10:47:033
162159965,1cyclictest16296-21ssh10:00:353
162159965,1cyclictest14254-21ssh12:11:513
162159964,1cyclictest5707-21ssh10:30:573
162159964,1cyclictest35-21ksoftirqd/307:57:383
162159963,3cyclictest26923-21/usr/sbin/munin07:30:153
162159963,2cyclictest9495-21diskmemload10:21:073
162159962,2cyclictest9495-21diskmemload10:40:293
162159962,2cyclictest8118-21df_inode11:20:143
162159962,2cyclictest570-21systemd-logind08:45:213
162159962,1cyclictest9495-21diskmemload12:06:363
162159962,1cyclictest254-21systemd-journal10:36:083
162159961,1cyclictest9495-21diskmemload12:25:223
162159960,6cyclictest28210-21ssh09:34:273
162159960,6cyclictest0-21swapper/312:16:113
162159960,4cyclictest0-21swapper/311:36:113
162159960,4cyclictest0-21swapper/309:53:253
162159960,2cyclictest0-21swapper/312:20:433
162159960,1cyclictest7349-21rm12:03:023
162029965,0cyclictest0-21swapper/111:01:431
162029961,3cyclictest0-21swapper/111:25:001
162029961,3cyclictest0-21swapper/109:36:011
162029961,1cyclictest0-21swapper/109:42:301
162029960,6cyclictest0-21swapper/111:42:261
162029960,6cyclictest0-21swapper/111:26:591
162029960,5cyclictest0-21swapper/110:17:091
162029960,5cyclictest0-21swapper/109:55:231
162029960,3cyclictest0-21swapper/111:17:391
162029960,3cyclictest0-21swapper/109:17:541
162029960,2cyclictest0-21swapper/110:59:441
162029960,1cyclictest0-21swapper/109:49:341
162029960,1cyclictest0-21swapper/109:25:131
162159954,1cyclictest35-21ksoftirqd/308:40:003
162159953,1cyclictest23837-21tr08:30:173
162159953,1cyclictest23837-21tr08:30:163
162159952,2cyclictest28915-21irqstats08:40:203
162159952,1cyclictest11418-21cstates08:05:153
162159951,2cyclictest13427-21apt-get08:10:133
162159951,1cyclictest9722-21missed_timers08:00:183
162159951,1cyclictest32229-21cut07:40:183
162159951,1cyclictest0-21swapper/312:36:573
162159950,5cyclictest0-21swapper/308:17:463
162159950,5cyclictest0-21swapper/307:46:573
162029955,0cyclictest0-21swapper/112:10:241
162029955,0cyclictest0-21swapper/110:48:181
162029955,0cyclictest0-21swapper/110:10:181
162029953,1cyclictest18169-21chrt10:50:031
162029952,2cyclictest0-21swapper/107:50:181
162029951,2cyclictest0-21swapper/108:45:121
162029950,4cyclictest0-21swapper/110:01:371
162029950,3cyclictest0-21swapper/112:35:151
162029950,3cyclictest0-21swapper/112:26:181
162029950,3cyclictest0-21swapper/112:00:311
162029950,3cyclictest0-21swapper/111:56:251
162029950,3cyclictest0-21swapper/110:28:081
162029950,3cyclictest0-21swapper/110:28:071
162029950,3cyclictest0-21swapper/110:20:181
162029950,3cyclictest0-21swapper/110:06:011
162029950,3cyclictest0-21swapper/108:40:151
162029950,2cyclictest0-21swapper/110:36:121
162029950,2cyclictest0-21swapper/109:13:381
162029950,1cyclictest0-21swapper/108:10:211
162029950,0cyclictest0-21swapper/111:50:331
162029950,0cyclictest0-21swapper/107:30:211
162159943,0cyclictest19442-21apt-get07:15:153
162159943,0cyclictest18367-21apt-get08:20:123
162159941,2cyclictest16390-21apt-get07:10:133
162159941,1cyclictest29283-21apt-get07:35:143
162159941,1cyclictest29283-21apt-get07:35:143
162029944,0cyclictest0-21swapper/108:16:301
162029944,0cyclictest0-21swapper/107:43:461
162029943,1cyclictest0-21swapper/108:20:211
162029941,2cyclictest0-21swapper/108:02:391
162029941,2cyclictest0-21swapper/107:55:131
162029941,1cyclictest0-21swapper/112:21:111
162029941,1cyclictest0-21swapper/109:05:131
162029940,4cyclictest0-21swapper/107:37:041
162029940,4cyclictest0-21swapper/107:37:031
162029940,4cyclictest0-21swapper/107:20:491
162029940,4cyclictest0-21swapper/107:15:171
162029940,3cyclictest0-21swapper/108:25:141
162029940,2cyclictest0-21swapper/110:40:131
162029940,2cyclictest0-21swapper/108:34:041
162029940,2cyclictest0-21swapper/108:34:031
162029940,1cyclictest0-21swapper/111:36:591
162029940,1cyclictest0-21swapper/109:00:131
162029940,1cyclictest0-21swapper/108:55:211
162029940,1cyclictest0-21swapper/107:10:141
162029931,1cyclictest0-21swapper/108:35:131
162029931,1cyclictest0-21swapper/108:05:131
162029930,1cyclictest0-21swapper/108:50:131
162029930,1cyclictest0-21swapper/107:45:141
162029930,1cyclictest0-21swapper/107:25:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional