You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 05:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot4.osadl.org (updated Sun Mar 29, 2026 00:45:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149812205171,23sleep30-21swapper/319:09:543
147092203170,23sleep10-21swapper/119:06:281
147102199167,21sleep20-21swapper/219:06:282
148132196163,23sleep00-21swapper/019:07:420
1881921480,5sleep01528199cyclictest19:15:200
15283997221,8cyclictest33-21ksoftirqd/219:15:252
15283997130,11cyclictest33-21ksoftirqd/200:15:192
15283997025,12cyclictest33-21ksoftirqd/223:45:002
138491700,1ptp4l10334-21/usr/sbin/munin22:15:273
15283996928,10cyclictest33-21ksoftirqd/223:35:002
15283996923,9cyclictest33-21ksoftirqd/223:54:592
15283996832,9cyclictest33-21ksoftirqd/220:20:182
15283996729,12cyclictest33-21ksoftirqd/223:20:002
15283996729,12cyclictest33-21ksoftirqd/223:20:002
15283996630,5cyclictest33-21ksoftirqd/222:35:012
15283996629,4cyclictest33-21ksoftirqd/221:20:002
15283996627,13cyclictest33-21ksoftirqd/222:05:182
15283996530,11cyclictest33-21ksoftirqd/222:00:182
15283996528,11cyclictest33-21ksoftirqd/221:35:192
15283996527,9cyclictest33-21ksoftirqd/220:15:012
15283996526,11cyclictest33-21ksoftirqd/221:30:012
15283996428,9cyclictest33-21ksoftirqd/221:55:192
15283996428,10cyclictest33-21ksoftirqd/220:00:192
15283996427,5cyclictest33-21ksoftirqd/223:35:202
15283996328,11cyclictest33-21ksoftirqd/222:25:002
15283996326,10cyclictest33-21ksoftirqd/220:50:182
15283996325,10cyclictest33-21ksoftirqd/221:30:012
15283996320,9cyclictest33-21ksoftirqd/220:30:192
15284996223,3cyclictest41-21ksoftirqd/320:05:003
15283996226,9cyclictest33-21ksoftirqd/222:40:262
15283996226,11cyclictest33-21ksoftirqd/223:49:592
15283996225,11cyclictest33-21ksoftirqd/219:25:192
15283996225,10cyclictest33-21ksoftirqd/200:10:192
15283996224,5cyclictest33-21ksoftirqd/220:05:182
15283996127,12cyclictest33-21ksoftirqd/222:45:182
15283996125,11cyclictest33-21ksoftirqd/200:30:192
15283996123,6cyclictest33-21ksoftirqd/219:45:282
15283996123,10cyclictest33-21ksoftirqd/223:05:002
15283996122,12cyclictest33-21ksoftirqd/222:55:142
15283996113,9cyclictest33-21ksoftirqd/223:25:122
15284996029,4cyclictest41-21ksoftirqd/323:30:013
15283996028,4cyclictest33-21ksoftirqd/200:35:162
15283996027,12cyclictest33-21ksoftirqd/200:00:142
15283996026,4cyclictest33-21ksoftirqd/220:55:242
15283996025,10cyclictest33-21ksoftirqd/220:35:132
15283996019,4cyclictest33-21ksoftirqd/200:20:172
15283996017,4cyclictest33-21ksoftirqd/221:45:182
1528399599,10cyclictest33-21ksoftirqd/220:40:242
15283995927,4cyclictest33-21ksoftirqd/222:25:192
15283995921,9cyclictest33-21ksoftirqd/219:55:002
15283995915,8cyclictest33-21ksoftirqd/219:35:002
15281995924,5cyclictest9-21ksoftirqd/020:25:000
15281995924,4cyclictest9-21ksoftirqd/021:30:010
15281995923,4cyclictest9-21ksoftirqd/020:20:000
15281995919,7cyclictest9-21ksoftirqd/020:05:230
15283995821,11cyclictest33-21ksoftirqd/223:10:142
15283995820,5cyclictest33-21ksoftirqd/220:25:242
15283995819,10cyclictest33-21ksoftirqd/223:20:212
15281995828,4cyclictest9-21ksoftirqd/023:05:150
15281995827,4cyclictest9-21ksoftirqd/023:20:300
15281995827,4cyclictest9-21ksoftirqd/021:30:120
15281995826,5cyclictest9-21ksoftirqd/022:37:590
15281995824,4cyclictest9-21ksoftirqd/022:45:180
219792570,1sleep30-21swapper/323:40:243
15283995726,10cyclictest33-21ksoftirqd/222:35:192
15283995725,4cyclictest33-21ksoftirqd/219:10:122
15283995724,4cyclictest33-21ksoftirqd/219:35:312
15283995724,10cyclictest33-21ksoftirqd/219:40:122
15283995719,5cyclictest33-21ksoftirqd/221:45:012
15283995719,5cyclictest33-21ksoftirqd/221:00:172
15281995720,8cyclictest9-21ksoftirqd/021:20:160
15284995610,5cyclictest41-21ksoftirqd/322:05:003
1528399569,9cyclictest33-21ksoftirqd/222:10:132
15283995620,10cyclictest33-21ksoftirqd/200:05:272
15283995619,5cyclictest33-21ksoftirqd/222:50:182
15281995624,5cyclictest9-21ksoftirqd/020:55:200
15281995620,8cyclictest9-21ksoftirqd/021:00:280
15281995610,7cyclictest9-21ksoftirqd/023:55:200
15283995526,10cyclictest33-21ksoftirqd/223:55:152
15283995525,10cyclictest33-21ksoftirqd/220:45:132
15283995520,5cyclictest33-21ksoftirqd/222:20:002
15283995512,4cyclictest33-21ksoftirqd/221:10:182
1528299552,6cyclictest30458-21basename00:00:001
15281995527,6cyclictest9-21ksoftirqd/020:25:230
15281995524,4cyclictest9-21ksoftirqd/021:45:120
15281995524,4cyclictest9-21ksoftirqd/021:15:280
15281995519,7cyclictest9-21ksoftirqd/020:30:210
15283995422,5cyclictest33-21ksoftirqd/221:20:142
15283995420,4cyclictest33-21ksoftirqd/221:05:222
15283995418,9cyclictest33-21ksoftirqd/221:50:172
15283995411,10cyclictest33-21ksoftirqd/219:20:132
1528299543,7cyclictest29875-21grep19:40:011
1528199546,2cyclictest121rcu_preempt21:40:000
15281995423,5cyclictest9-21ksoftirqd/022:50:230
15281995423,4cyclictest9-21ksoftirqd/022:20:230
15281995422,5cyclictest9-21ksoftirqd/000:15:140
15281995416,7cyclictest9-21ksoftirqd/022:25:260
15284995315,5cyclictest41-21ksoftirqd/319:19:593
15283995316,10cyclictest33-21ksoftirqd/223:05:332
1528299532,5cyclictest241ktimersoftd/121:30:001
15281995333,9cyclictest9-21ksoftirqd/022:05:240
15281995333,5cyclictest9-21ksoftirqd/021:10:000
15281995333,11cyclictest9-21ksoftirqd/019:10:180
15281995324,4cyclictest9-21ksoftirqd/020:00:280
15283995211,10cyclictest33-21ksoftirqd/220:15:172
1528299520,6cyclictest0-21swapper/122:05:001
15281995234,10cyclictest9-21ksoftirqd/020:10:250
15281995224,4cyclictest9-21ksoftirqd/000:25:130
15281995221,6cyclictest9-21ksoftirqd/023:45:180
15281995210,3cyclictest9-21ksoftirqd/022:15:000
15284995113,6cyclictest41-21ksoftirqd/323:25:013
1528299514,6cyclictest15745-21tune2fs21:20:161
1528299513,5cyclictest13861-21grep20:10:241
15281995141,2cyclictest9-21ksoftirqd/021:55:000
15281995132,11cyclictest9-21ksoftirqd/000:30:250
15281995132,10cyclictest9-21ksoftirqd/000:20:210
1528199510,8cyclictest9-21ksoftirqd/019:35:000
1528299505,5cyclictest31416-21ps19:40:221
1528299503,6cyclictest25478-21grep22:45:001
1528199507,3cyclictest9-21ksoftirqd/023:35:200
1528199504,8cyclictest9-21ksoftirqd/023:50:120
15281995025,7cyclictest9-21ksoftirqd/020:55:010
15281995017,4cyclictest9-21ksoftirqd/023:40:160
1528499498,9cyclictest41-21ksoftirqd/300:15:013
15284994920,4cyclictest41-21ksoftirqd/322:25:263
15284994915,6cyclictest41-21ksoftirqd/321:00:013
1528299494,7cyclictest28229-21grep21:45:151
15281994936,6cyclictest9-21ksoftirqd/022:40:140
15281994936,6cyclictest9-21ksoftirqd/019:25:140
1528199492,6cyclictest9-21ksoftirqd/021:15:000
15281994920,7cyclictest9-21ksoftirqd/022:55:280
15281994918,9cyclictest9-21ksoftirqd/023:20:000
15281994918,9cyclictest9-21ksoftirqd/023:19:590
15281994910,3cyclictest9-21ksoftirqd/022:15:260
15284994835,3cyclictest41-21ksoftirqd/323:00:003
15284994816,9cyclictest41-21ksoftirqd/321:30:183
15283994829,8cyclictest33-21ksoftirqd/200:25:202
1528299483,7cyclictest13741-21sed00:30:141
1528299483,7cyclictest10213-21head00:20:271
1528299483,6cyclictest1379-21ps20:50:231
1528299482,5cyclictest241ktimersoftd/121:40:221
1528299481,7cyclictest31261-21irqrtprio22:55:191
1528299480,6cyclictest241ktimersoftd/122:30:161
15281994834,4cyclictest9-21ksoftirqd/022:05:000
15281994822,9cyclictest9-21ksoftirqd/020:46:360
15281994820,10cyclictest9-21ksoftirqd/022:30:120
15281994818,6cyclictest9-21ksoftirqd/019:20:190
1528199481,3cyclictest9-21ksoftirqd/021:55:150
15284994715,3cyclictest41-21ksoftirqd/323:55:233
15284994711,5cyclictest41-21ksoftirqd/323:20:003
15284994711,5cyclictest41-21ksoftirqd/323:20:003
15283994713,4cyclictest33-21ksoftirqd/219:57:232
1528299473,5cyclictest15909-21sed23:30:141
1528299472,5cyclictest126592sleep123:23:371
1528199477,7cyclictest9-21ksoftirqd/000:05:230
1528199476,3cyclictest9-21ksoftirqd/023:10:230
1528199475,6cyclictest9-21ksoftirqd/021:40:180
1528199473,6cyclictest9-21ksoftirqd/019:45:140
1528199473,5cyclictest9-21ksoftirqd/023:30:000
15281994731,4cyclictest9-21ksoftirqd/020:35:120
15281994730,5cyclictest9-21ksoftirqd/000:10:170
1528199472,5cyclictest9-21ksoftirqd/000:00:170
15281994722,7cyclictest9-21ksoftirqd/000:37:360
1528199470,2cyclictest121rcu_preempt19:40:000
1528499468,11cyclictest41-21ksoftirqd/320:15:133
15284994621,4cyclictest41-21ksoftirqd/322:45:243
15284994616,4cyclictest41-21ksoftirqd/319:40:003
15284994613,6cyclictest41-21ksoftirqd/321:05:003
1528299464,5cyclictest8341-21sed21:05:181
1528299462,6cyclictest241ktimersoftd/119:25:141
1528299462,5cyclictest10964-21/usr/sbin/munin21:10:191
1528299462,5cyclictest0-21swapper/120:31:571
1528299461,6cyclictest241ktimersoftd/121:35:161
1528299461,5cyclictest31874-21timerwakeupswit21:50:261
1528299461,5cyclictest241ktimersoftd/122:25:261
1528199462,3cyclictest9-21ksoftirqd/019:40:240
1528199461,2cyclictest121rcu_preempt23:30:120
1528499453,2cyclictest121rcu_preempt20:40:003
1528499453,2cyclictest121rcu_preempt19:25:003
1528499450,2cyclictest121rcu_preempt21:10:003
1528299458,2cyclictest25-21ksoftirqd/119:14:531
1528299454,6cyclictest25273-21dpkg23:50:001
1528299453,8cyclictest2538-21grep00:05:261
1528299453,6cyclictest28571-21fschecks_count22:50:151
1528299451,7cyclictest12885-21df_abs21:15:151
1528299451,5cyclictest241ktimersoftd/119:50:001
1528299450,6cyclictest7796-21cstates20:00:151
1528199456,3cyclictest9-21ksoftirqd/020:40:140
1528199452,7cyclictest121rcu_preempt20:00:000
1528199452,5cyclictest9-21ksoftirqd/023:00:210
1528199451,6cyclictest9-21ksoftirqd/019:50:240
1528499444,3cyclictest23592-21ps23:45:193
15284994414,6cyclictest41-21ksoftirqd/322:10:273
15284994412,7cyclictest41-21ksoftirqd/321:50:153
1528299449,7cyclictest25-21ksoftirqd/123:50:261
1528299446,6cyclictest25-21ksoftirqd/123:40:231
1528299445,6cyclictest25-21ksoftirqd/119:20:221
1528299445,6cyclictest22412-21ls22:35:251
1528299443,7cyclictest4826-21awk21:00:011
1528299443,6cyclictest6835-21cut00:15:191
1528299443,5cyclictest10180-21latency_hist22:14:591
1528299442,6cyclictest6181-21chrt22:05:181
1528299441,7cyclictest241ktimersoftd/119:55:001
1528299441,6cyclictest17917-21cstates20:20:121
1528299441,5cyclictest241ktimersoftd/121:55:141
1528299441,5cyclictest241ktimersoftd/100:10:161
15282994412,5cyclictest25-21ksoftirqd/120:36:031
1528299440,5cyclictest0-21swapper/119:20:001
1528499435,11cyclictest41-21ksoftirqd/300:30:183
1528499435,10cyclictest41-21ksoftirqd/320:45:133
15284994337,3cyclictest223-21systemd-journal19:34:563
15284994310,10cyclictest41-21ksoftirqd/321:15:143
1528499430,3cyclictest13060-21cron00:30:003
1528299435,6cyclictest25-21ksoftirqd/120:25:131
1528299434,5cyclictest14555-21sed23:25:251
1528299433,6cyclictest3728-21idleruntime23:05:161
1528299433,6cyclictest20288-21cat21:30:011
1528299433,5cyclictest27872-21awk22:50:001
1528299432,4cyclictest0-21swapper/123:15:411
1528299432,4cyclictest0-21swapper/123:15:411
1528299431,5cyclictest241ktimersoftd/123:10:131
1528499427,11cyclictest41-21ksoftirqd/321:25:253
1528499422,8cyclictest41-21ksoftirqd/322:20:143
1528499422,2cyclictest121rcu_preempt20:25:003
1528499422,10cyclictest41-21ksoftirqd/321:15:003
1528499421,3cyclictest32642-21cpu21:55:133
15284994212,3cyclictest41-21ksoftirqd/300:39:593
1528499420,2cyclictest121rcu_preempt20:30:003
1528299427,5cyclictest25-21ksoftirqd/122:20:271
1528299423,5cyclictest19616-21sed23:35:261
138491420,0ptp4l401ktimersoftd/321:49:413
1528499416,7cyclictest41-21ksoftirqd/320:05:193
1528499415,10cyclictest41-21ksoftirqd/322:05:183
15284994136,3cyclictest41-21ksoftirqd/323:04:593
1528499413,2cyclictest121rcu_preempt20:50:113
15284994129,3cyclictest41-21ksoftirqd/322:50:263
15284994113,5cyclictest41-21ksoftirqd/322:35:203
15284994113,5cyclictest41-21ksoftirqd/320:15:003
1528299412,6cyclictest1631-21latency23:00:191
1528299412,5cyclictest0-21swapper/119:34:161
1528299410,6cyclictest241ktimersoftd/120:05:271
1528499408,7cyclictest41-21ksoftirqd/322:30:203
1528499407,7cyclictest41-21ksoftirqd/323:35:143
1528499403,3cyclictest121rcu_preempt00:05:133
1528499403,11cyclictest41-21ksoftirqd/322:45:003
15284994010,7cyclictest41-21ksoftirqd/321:20:243
1528299401,7cyclictest32172-21grep00:00:241
15282994012,2cyclictest25-21ksoftirqd/119:57:561
1528499398,7cyclictest41-21ksoftirqd/323:30:133
1528499396,3cyclictest41-21ksoftirqd/319:46:553
1528499395,7cyclictest41-21ksoftirqd/323:05:273
1528499391,3cyclictest17270-21taskset19:11:583
1528499390,2cyclictest24819-21sshd21:37:473
1528299393,6cyclictest16427-21cat00:35:181
15284993833,3cyclictest41-21ksoftirqd/319:55:163
1528499383,2cyclictest41-21ksoftirqd/323:15:003
1528499383,10cyclictest41-21ksoftirqd/321:40:113
15284993828,3cyclictest41-21ksoftirqd/323:50:183
1528499382,3cyclictest41-21ksoftirqd/319:25:243
1528499381,2cyclictest121rcu_preempt00:20:153
1528299380,5cyclictest241ktimersoftd/100:25:171
1528499376,3cyclictest41-21ksoftirqd/320:40:233
1528499375,2cyclictest41-21ksoftirqd/300:00:133
1528499373,7cyclictest41-21ksoftirqd/300:15:243
15284993724,4cyclictest41-21ksoftirqd/319:55:003
15284993711,5cyclictest41-21ksoftirqd/320:30:183
1528299371,7cyclictest12824-21latency_hist22:20:011
15284993631,3cyclictest41-21ksoftirqd/319:40:183
1528299353,5cyclictest5097-21/usr/sbin/munin21:00:121
1528299352,5cyclictest25-21ksoftirqd/120:40:041
15282993514,6cyclictest25-21ksoftirqd/120:19:341
15282993126,3cyclictest25-21ksoftirqd/120:47:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional