You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-19 - 14:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Thu Mar 19, 2026 00:45:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293632205172,22sleep20-21swapper/219:08:192
291592204170,23sleep00-21swapper/019:05:390
293062203169,23sleep30-21swapper/319:07:353
292152202168,23sleep10-21swapper/119:06:251
29795997110,59cyclictest0-21swapper/100:00:531
150412630,2sleep30-21swapper/320:50:283
2979499629,10cyclictest4114-21awk21:35:260
2979699591,17cyclictest13231-21grep20:49:592
2979699565,7cyclictest16518-21cut20:55:192
2979699546,6cyclictest11011-21sed23:00:152
2979599540,52cyclictest0-21swapper/121:30:331
29794995411,11cyclictest24287-21threads21:10:260
139391540,1ptp4l401ktimersoftd/321:36:203
2979699536,6cyclictest19188-21date00:25:002
139391530,1ptp4l401ktimersoftd/322:20:323
139391530,1ptp4l401ktimersoftd/320:57:173
2979699526,7cyclictest12023-21date00:10:012
2979699521,10cyclictest22532-21sed00:30:182
2979699516,11cyclictest16886-21fschecks_count19:50:162
2979699512,9cyclictest25086-21ps20:05:212
2979699511,9cyclictest32219-21ls23:45:002
2979699504,7cyclictest19499-21cat21:00:242
2979499504,7cyclictest22723-21apt-get23:25:130
2979499504,11cyclictest9485-21apt-get21:50:100
2979499503,15cyclictest1300-21snmpd00:36:150
2979699495,6cyclictest31272-21df20:20:132
2979699494,7cyclictest19172-21df_abs19:55:142
2979699490,17cyclictest1399-21sed23:45:242
2979499493,7cyclictest5156-21taskset22:46:310
2979699482,10cyclictest23971-21expr22:20:152
2979699481,9cyclictest21655-21sed00:30:012
2979499483,14cyclictest29908-21apt-get23:40:120
2979699472,10cyclictest2243-21date21:35:002
2979699461,16cyclictest28087-21awk23:35:182
2979499465,7cyclictest23739-21apt-get22:20:130
2979499463,12cyclictest25547-21unixbench_singl20:05:250
139391460,35ptp4l0-21swapper/319:10:013
2979699450,10cyclictest15239-21irqrtprio00:15:172
2979499453,7cyclictest5891-21apt-get22:50:100
2979499453,7cyclictest20750-21python00:25:230
2979499453,6cyclictest13291-21apt-get20:50:110
2979599445,38cyclictest0-21swapper/122:21:131
2979499444,8cyclictest5038-21df21:40:140
2979499444,8cyclictest5038-21df21:40:140
2979499443,7cyclictest32190-21apt-get19:15:110
2979499443,11cyclictest7299-21cpuspeed_turbos21:45:140
139391440,0ptp4l401ktimersoftd/323:33:443
2979699432,5cyclictest33-21ksoftirqd/221:25:232
2979699431,12cyclictest24465-21users23:25:282
2979499435,7cyclictest26174-21memory23:30:210
2979499435,7cyclictest22458-21meminfo20:00:210
2979499434,8cyclictest19267-21df22:10:130
2979499434,7cyclictest3963-21df_inode20:30:120
2979499434,7cyclictest32563-21df23:45:120
2979499434,7cyclictest12236-21df_inode21:55:130
139391430,2ptp4l0-21swapper/321:43:293
139391430,2ptp4l0-21swapper/321:43:293
139391430,0ptp4l401ktimersoftd/321:49:063
139391430,0ptp4l401ktimersoftd/300:11:153
29797994230,3cyclictest41-21ksoftirqd/321:05:263
2979699426,7cyclictest22022-21cat21:05:262
2979699426,5cyclictest25673-21grep21:15:152
2979699421,15cyclictest3819-21cstates20:30:112
2979499424,8cyclictest11376-21users00:05:250
2979499424,7cyclictest30466-21iostat19:10:160
2979499424,7cyclictest28974-21diskstats20:15:150
2979499423,7cyclictest29243-21ls21:20:260
2979699411,16cyclictest28852-21expr20:15:132
2979699410,5cyclictest0-21swapper/219:40:152
2979499414,8cyclictest17531-21irqstats22:05:180
2979499414,7cyclictest18400-21iostat_ios23:15:180
29794994135,3cyclictest19235-21fschecks_count19:55:150
29797994034,3cyclictest41-21ksoftirqd/319:20:003
2979799402,3cyclictest121rcu_preempt21:55:233
2979699406,6cyclictest15743-21unixbench_multi19:45:262
2979699402,6cyclictest33-21ksoftirqd/200:05:002
2979499404,7cyclictest7557-21df00:00:140
2979499404,7cyclictest5388-21hddtemp_smartct23:55:160
2979499404,7cyclictest3161-21irqstats19:20:170
2979499404,7cyclictest31184-21df22:35:120
2979499404,7cyclictest26230-21meminfo21:15:190
57898390,7rtkit-daemon0-21swapper/119:19:501
29797993934,3cyclictest41-21ksoftirqd/323:00:003
29797993931,5cyclictest41-21ksoftirqd/300:35:123
2979699393,2cyclictest33-21ksoftirqd/222:40:162
2979699390,7cyclictest4425-21apt-get23:55:032
2979499394,8cyclictest28541-21meminfo23:35:210
2979499394,7cyclictest7895-21irqstats19:30:180
2979499394,7cyclictest18434-21diskstats21:00:150
2979499394,7cyclictest17355-21diskstats00:20:140
29797993833,3cyclictest41-21ksoftirqd/323:40:003
29797993832,3cyclictest41-21ksoftirqd/322:25:193
29796993831,4cyclictest33-21ksoftirqd/220:54:582
2979499384,8cyclictest30255-21df21:25:120
29797993732,3cyclictest41-21ksoftirqd/320:40:013
29797993732,3cyclictest41-21ksoftirqd/320:00:003
29797993732,2cyclictest41-21ksoftirqd/300:00:143
29795993731,4cyclictest25-21ksoftirqd/122:45:121
29797993630,3cyclictest41-21ksoftirqd/320:10:183
29797993630,3cyclictest41-21ksoftirqd/320:05:183
29797993630,3cyclictest41-21ksoftirqd/300:05:103
2979699366,5cyclictest33-21ksoftirqd/222:55:242
2979699360,5cyclictest33-21ksoftirqd/219:35:102
29795993631,3cyclictest25-21ksoftirqd/121:55:011
29795993630,4cyclictest25-21ksoftirqd/120:25:541
29795993630,4cyclictest25-21ksoftirqd/120:22:061
29795993630,4cyclictest25-21ksoftirqd/119:49:171
29795993630,4cyclictest25-21ksoftirqd/119:35:101
2979499363,7cyclictest14786-21sshd23:05:370
29794993631,3cyclictest9-21ksoftirqd/019:45:010
29794993630,4cyclictest9-21ksoftirqd/020:49:320
139391360,0ptp4l401ktimersoftd/319:35:213
29797993530,3cyclictest41-21ksoftirqd/321:20:193
29797993529,4cyclictest41-21ksoftirqd/322:44:053
29797993529,4cyclictest41-21ksoftirqd/319:27:333
29797993528,3cyclictest41-21ksoftirqd/322:45:273
29796993530,3cyclictest33-21ksoftirqd/223:10:462
29796993530,3cyclictest33-21ksoftirqd/222:25:592
29796993529,4cyclictest33-21ksoftirqd/221:46:282
29796993529,3cyclictest585-21turbostat.cron22:39:592
2979699352,4cyclictest33-21ksoftirqd/222:19:232
29795993529,4cyclictest25-21ksoftirqd/123:34:131
29795993529,4cyclictest25-21ksoftirqd/122:53:021
29795993529,4cyclictest25-21ksoftirqd/122:28:021
29795993529,4cyclictest25-21ksoftirqd/120:41:521
29795993529,4cyclictest25-21ksoftirqd/119:54:021
29795993529,4cyclictest25-21ksoftirqd/119:29:111
29795993529,4cyclictest25-21ksoftirqd/100:10:311
29795993517,16cyclictest0-21swapper/121:35:231
139391350,0ptp4l401ktimersoftd/323:55:013
57898340,1rtkit-daemon0-21swapper/121:48:171
29797993430,2cyclictest41-21ksoftirqd/300:20:183
29797993429,3cyclictest41-21ksoftirqd/323:10:123
29797993429,3cyclictest41-21ksoftirqd/322:40:003
29797993429,3cyclictest41-21ksoftirqd/321:00:103
29797993429,3cyclictest41-21ksoftirqd/320:45:033
29797993429,3cyclictest41-21ksoftirqd/319:41:583
29797993428,4cyclictest41-21ksoftirqd/322:05:543
29796993428,4cyclictest33-21ksoftirqd/219:16:242
29796993428,4cyclictest33-21ksoftirqd/219:11:152
2979699340,4cyclictest33-21ksoftirqd/222:46:382
29795993429,3cyclictest25-21ksoftirqd/123:59:551
29795993428,4cyclictest25-21ksoftirqd/123:26:061
29795993428,4cyclictest25-21ksoftirqd/121:05:501
29795993428,4cyclictest25-21ksoftirqd/120:31:001
29795993413,18cyclictest29332-21awk21:20:271
29797993330,2cyclictest41-21ksoftirqd/323:45:003
29797993329,2cyclictest41-21ksoftirqd/323:50:173
29797993328,3cyclictest41-21ksoftirqd/323:47:193
29797993328,3cyclictest41-21ksoftirqd/321:25:183
29797993328,3cyclictest41-21ksoftirqd/319:30:183
29797993327,4cyclictest41-21ksoftirqd/323:03:143
29796993328,3cyclictest33-21ksoftirqd/221:38:372
29796993327,4cyclictest33-21ksoftirqd/219:33:092
2979699330,4cyclictest33-21ksoftirqd/220:35:012
2979699330,4cyclictest33-21ksoftirqd/219:27:092
29795993328,3cyclictest25-21ksoftirqd/122:04:551
29795993328,3cyclictest25-21ksoftirqd/120:57:491
29795993328,3cyclictest25-21ksoftirqd/100:39:511
29795993327,4cyclictest25-21ksoftirqd/122:08:491
29795993327,4cyclictest25-21ksoftirqd/121:25:081
29795993327,4cyclictest25-21ksoftirqd/121:01:461
29795993327,4cyclictest25-21ksoftirqd/120:37:301
29795993327,4cyclictest25-21ksoftirqd/120:19:501
29795993327,4cyclictest25-21ksoftirqd/119:59:321
29794993327,4cyclictest9-21ksoftirqd/021:08:070
29794993326,5cyclictest9-21ksoftirqd/023:50:280
276723328,2sleep3401ktimersoftd/320:25:253
139391330,0ptp4l401ktimersoftd/321:15:183
29797993228,3cyclictest41-21ksoftirqd/320:05:003
29797993228,3cyclictest41-21ksoftirqd/319:45:133
29797993227,3cyclictest41-21ksoftirqd/322:35:003
29797993227,3cyclictest41-21ksoftirqd/322:02:373
29797993227,3cyclictest41-21ksoftirqd/321:50:183
29797993227,3cyclictest41-21ksoftirqd/300:34:593
29797993226,4cyclictest41-21ksoftirqd/321:31:043
29797993226,4cyclictest41-21ksoftirqd/321:13:033
29797993226,4cyclictest41-21ksoftirqd/319:24:483
29797993226,3cyclictest41-21ksoftirqd/322:15:163
29797993226,3cyclictest41-21ksoftirqd/320:20:003
29797993220,10cyclictest41-21ksoftirqd/323:20:253
29796993227,3cyclictest33-21ksoftirqd/223:20:112
29796993227,3cyclictest33-21ksoftirqd/220:42:372
29796993226,4cyclictest33-21ksoftirqd/223:18:342
29796993226,4cyclictest33-21ksoftirqd/222:53:262
29796993226,4cyclictest33-21ksoftirqd/222:04:562
29796993226,4cyclictest33-21ksoftirqd/221:51:522
2979699320,5cyclictest33-21ksoftirqd/219:24:292
29795993227,3cyclictest25-21ksoftirqd/120:10:001
29795993226,4cyclictest25-21ksoftirqd/122:32:351
29795993226,4cyclictest25-21ksoftirqd/120:04:491
29795993226,4cyclictest25-21ksoftirqd/100:31:341
29795993226,4cyclictest25-21ksoftirqd/100:19:501
29795993214,15cyclictest16029-21iostat23:10:171
29795993210,3cyclictest30061-21expr19:10:111
29795993210,3cyclictest13855-21cut23:05:181
29794993226,4cyclictest9-21ksoftirqd/023:23:180
29794993226,4cyclictest9-21ksoftirqd/022:25:570
29794993226,4cyclictest9-21ksoftirqd/020:20:410
29794993226,4cyclictest9-21ksoftirqd/019:39:210
139391320,0ptp4l401ktimersoftd/300:15:143
29797993126,3cyclictest41-21ksoftirqd/300:30:013
29797993119,9cyclictest41-21ksoftirqd/320:20:233
2979799310,2cyclictest121rcu_preempt22:54:383
2979699313,6cyclictest33-21ksoftirqd/223:33:092
29796993125,4cyclictest33-21ksoftirqd/221:22:362
2979699311,4cyclictest33-21ksoftirqd/222:05:242
29795993126,3cyclictest25-21ksoftirqd/100:20:101
29795993110,3cyclictest24243-21sed21:10:241
2979499315,7cyclictest16466-21apt-get19:50:130
2979499313,15cyclictest32338-21apt-get21:30:110
29794993126,3cyclictest9-21ksoftirqd/020:25:140
29794993125,4cyclictest9-21ksoftirqd/020:38:140
29797993026,3cyclictest41-21ksoftirqd/323:05:183
29797993025,3cyclictest41-21ksoftirqd/320:32:443
29797993023,4cyclictest41-21ksoftirqd/323:15:113
2979599309,3cyclictest21921-21if_enp4s022:15:141
2979599308,3cyclictest2199-21ptp4l22:40:221
29795993024,4cyclictest25-21ksoftirqd/123:16:361
29795993024,4cyclictest25-21ksoftirqd/122:59:201
29795993023,4cyclictest25-21ksoftirqd/122:10:051
29795993012,3cyclictest2134-21cat23:50:001
29794993024,4cyclictest9-21ksoftirqd/019:49:320
139391300,0ptp4l401ktimersoftd/323:27:333
29797992924,3cyclictest41-21ksoftirqd/320:45:013
29797992923,3cyclictest41-21ksoftirqd/322:10:123
29796992924,3cyclictest33-21ksoftirqd/220:26:132
29796992923,4cyclictest33-21ksoftirqd/222:34:122
29796992923,4cyclictest33-21ksoftirqd/222:12:472
29796992923,4cyclictest33-21ksoftirqd/220:11:112
29796992923,3cyclictest207-21systemd-journal20:02:122
2979599297,3cyclictest27674-21switchtime20:10:251
29795992924,3cyclictest25-21ksoftirqd/123:04:581
29795992924,3cyclictest25-21ksoftirqd/121:59:091
29795992923,4cyclictest25-21ksoftirqd/119:42:261
2979499294,15cyclictest9355-21ls22:55:210
29794992924,3cyclictest9-21ksoftirqd/000:34:450
29794992923,4cyclictest9-21ksoftirqd/023:11:020
29794992923,4cyclictest9-21ksoftirqd/022:33:550
29794992923,4cyclictest9-21ksoftirqd/022:18:030
29794992923,4cyclictest9-21ksoftirqd/020:58:510
29794992923,4cyclictest9-21ksoftirqd/020:14:180
29794992923,4cyclictest9-21ksoftirqd/000:13:280
139391290,0ptp4l401ktimersoftd/319:53:323
29796992823,3cyclictest33-21ksoftirqd/221:57:142
29796992823,3cyclictest33-21ksoftirqd/200:13:472
29796992822,4cyclictest33-21ksoftirqd/221:13:262
29795992823,3cyclictest25-21ksoftirqd/122:39:211
29795992823,3cyclictest25-21ksoftirqd/120:52:001
29795992822,4cyclictest25-21ksoftirqd/121:43:291
29795992822,4cyclictest25-21ksoftirqd/121:43:291
29795992822,3cyclictest25-21ksoftirqd/119:30:091
29795992811,2cyclictest21565-21phc2sys-jitter23:20:221
29795992810,3cyclictest1317-21runrttasks19:22:441
2979599280,26cyclictest0-21swapper/100:25:381
2979599278,3cyclictest2458-21cstates23:50:121
29795992721,4cyclictest25-21ksoftirqd/123:41:511
29795992720,5cyclictest25-21ksoftirqd/123:37:501
29795992710,3cyclictest12285-21mailstats20:45:241
2979499272,11cyclictest0-21swapper/000:15:260
2979699264,7cyclictest33-21ksoftirqd/200:35:262
29796992621,3cyclictest33-21ksoftirqd/221:44:272
29796992621,3cyclictest33-21ksoftirqd/221:44:272
29794992621,3cyclictest9-21ksoftirqd/022:00:100
29796992519,4cyclictest33-21ksoftirqd/223:53:592
29796992519,4cyclictest33-21ksoftirqd/223:06:592
29794992520,3cyclictest9-21ksoftirqd/023:02:360
29794992519,4cyclictest9-21ksoftirqd/022:44:580
2979599241,21cyclictest0-21swapper/100:05:241
29795992217,3cyclictest25-21ksoftirqd/121:16:261
2979499223,2cyclictest57898rtkit-daemon19:29:550
2979499213,4cyclictest0-21swapper/020:40:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional