You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 17:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Wed Mar 11, 2026 12:45:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139491231163,23phc2sys0-21swapper/307:06:303
287462203169,23sleep00-21swapper/007:08:560
287792201168,22sleep10-21swapper/107:09:221
287482201168,22sleep20-21swapper/207:08:582
2912399689,12cyclictest10857-21cut07:40:002
29123996610,11cyclictest17716-21fschecks_count11:15:172
2912399657,16cyclictest28257-21/usr/sbin/munin09:20:222
279772650,2sleep20-21swapper/208:15:012
2912399607,11cyclictest25633-21date08:10:012
2912399598,11cyclictest22195-21wc11:25:132
2912399595,12cyclictest18274-21irqrtprio09:00:192
2912399588,17cyclictest5373-21systemctl11:55:222
2912399586,17cyclictest0-21swapper/211:53:452
2912399586,17cyclictest0-21swapper/211:53:452
2912399586,12cyclictest14852-21mailstats12:15:232
2912399578,10cyclictest25889-21systemctl09:15:242
2912399577,11cyclictest1744-21cpuspeed_turbos09:35:112
2912399566,11cyclictest30448-21ptp4l07:10:242
2912399558,10cyclictest9247-21which12:05:152
2912399557,9cyclictest30725-21grep11:40:262
2912399557,12cyclictest8322-21sed10:55:192
2912399557,11cyclictest24459-21ls12:35:252
2912399556,11cyclictest0-21swapper/209:50:222
2912399556,10cyclictest17293-21systemctl10:05:242
2912399555,10cyclictest25437-21latency11:30:172
2912399548,10cyclictest8546-21cut07:35:012
2912199547,6cyclictest9877-21date08:45:000
134391540,2getstats0-21swapper/312:10:283
2912399537,11cyclictest23591-21cstates10:20:112
2912399527,9cyclictest5370-21ptp4l09:40:252
2912399527,7cyclictest30454-21nfs4_client09:25:222
2912399524,9cyclictest23684-21cat09:10:252
29123995210,10cyclictest10166-21cat11:00:112
29123995210,10cyclictest10166-21cat11:00:112
2912399517,9cyclictest21257-21wc09:05:272
2912399515,15cyclictest1317-21runrttasks08:54:062
90112500,2sleep30-21swapper/309:50:123
2912399506,12cyclictest12447-21systemctl07:40:242
2912399496,11cyclictest22237-21switchtime08:00:252
2912199492,6cyclictest1603-21cpuspeed_turbos07:20:140
134391490,2getstats0-21swapper/308:25:273
2912399466,9cyclictest15057-21ls07:45:242
2912199465,9cyclictest18508-21open_files11:15:230
2912199464,6cyclictest21127-21cstates10:15:120
2912199462,6cyclictest101ktimersoftd/007:40:140
2912199461,5cyclictest0-21swapper/009:50:190
2912399459,7cyclictest2518-21gnome-shell11:08:582
2912399458,9cyclictest30997-21if_enp1s010:35:182
134391450,1getstats0-21swapper/311:05:283
57898440,10rtkit-daemon0-21swapper/111:49:411
2912499442,39cyclictest10442-21fschecks_count08:45:143
2912399445,8cyclictest16961-21ls12:20:202
2912399445,8cyclictest16961-21ls12:20:202
2912399445,7cyclictest27182-21ls10:25:232
29122994438,3cyclictest9790-21cron08:45:011
29124994337,3cyclictest41-21ksoftirqd/311:39:593
29124994331,10cyclictest41-21ksoftirqd/308:15:243
2912399439,6cyclictest2518-21gnome-shell10:32:592
139391430,0ptp4l401ktimersoftd/307:38:083
2912499401,5cyclictest121rcu_preempt12:10:003
2912399403,33cyclictest207-21systemd-journal09:50:012
2912199405,6cyclictest15083-21cpuspeed_turbos11:10:130
139391400,1ptp4l401ktimersoftd/308:58:483
2912499398,7cyclictest41-21ksoftirqd/309:40:013
29124993935,2cyclictest41-21ksoftirqd/309:35:003
29124993934,3cyclictest41-21ksoftirqd/312:20:013
139391390,0ptp4l401ktimersoftd/308:05:273
57898380,3rtkit-daemon7582-21apt-get10:55:111
2912499387,3cyclictest41-21ksoftirqd/309:50:003
2912499386,8cyclictest41-21ksoftirqd/310:15:013
29124993834,3cyclictest41-21ksoftirqd/307:59:593
29124993834,2cyclictest41-21ksoftirqd/308:40:003
29124993833,3cyclictest41-21ksoftirqd/309:00:183
29124993833,3cyclictest41-21ksoftirqd/308:04:593
29123993832,3cyclictest4967-21cron10:50:002
2912199388,4cyclictest57898rtkit-daemon08:35:110
2912199385,7cyclictest14938-21latency_hist08:55:010
2912199383,5cyclictest0-21swapper/010:40:250
29124993734,2cyclictest41-21ksoftirqd/309:59:593
29124993733,2cyclictest41-21ksoftirqd/309:20:263
29124993733,2cyclictest41-21ksoftirqd/308:55:003
29124993732,3cyclictest41-21ksoftirqd/312:30:153
29124993732,3cyclictest41-21ksoftirqd/311:50:013
29124993732,3cyclictest41-21ksoftirqd/308:45:013
29124993732,2cyclictest41-21ksoftirqd/311:30:163
29122993732,3cyclictest25-21ksoftirqd/109:56:191
29122993731,4cyclictest25-21ksoftirqd/109:34:031
29122993731,4cyclictest25-21ksoftirqd/108:35:581
57898360,3rtkit-daemon23188-21meminfo09:10:201
2912499366,2cyclictest41-21ksoftirqd/310:00:123
2912499365,3cyclictest41-21ksoftirqd/307:25:153
29124993632,3cyclictest41-21ksoftirqd/310:20:183
29124993632,2cyclictest41-21ksoftirqd/310:35:243
29124993631,3cyclictest41-21ksoftirqd/312:00:163
29124993631,3cyclictest41-21ksoftirqd/311:55:253
29124993631,3cyclictest41-21ksoftirqd/310:50:173
29124993631,3cyclictest41-21ksoftirqd/309:05:213
29124993631,3cyclictest41-21ksoftirqd/308:10:113
29124993631,3cyclictest41-21ksoftirqd/307:20:253
29124993630,3cyclictest41-21ksoftirqd/307:45:163
29124993627,2cyclictest41-21ksoftirqd/311:50:203
29124993627,2cyclictest41-21ksoftirqd/311:50:203
29122993630,4cyclictest25-21ksoftirqd/112:04:051
29122993630,4cyclictest25-21ksoftirqd/111:55:551
29122993630,4cyclictest25-21ksoftirqd/111:32:041
29122993630,4cyclictest25-21ksoftirqd/111:29:511
29122993630,4cyclictest25-21ksoftirqd/107:44:351
2912199366,6cyclictest29943-21iostat_ios09:25:180
29121993630,4cyclictest9-21ksoftirqd/012:15:270
29121993630,4cyclictest9-21ksoftirqd/011:33:550
2912199360,7cyclictest32158-21iostat07:15:170
2912199360,4cyclictest9-21ksoftirqd/009:35:230
2912499356,3cyclictest41-21ksoftirqd/307:50:203
2912499355,3cyclictest41-21ksoftirqd/310:45:133
2912499354,3cyclictest41-21ksoftirqd/310:05:193
29124993531,2cyclictest41-21ksoftirqd/310:40:173
29124993531,2cyclictest41-21ksoftirqd/309:40:273
29124993530,3cyclictest41-21ksoftirqd/311:25:123
29124993530,3cyclictest41-21ksoftirqd/311:00:173
29124993530,3cyclictest41-21ksoftirqd/311:00:173
29124993530,3cyclictest41-21ksoftirqd/308:35:003
29124993529,4cyclictest41-21ksoftirqd/310:30:013
29124993529,4cyclictest41-21ksoftirqd/309:12:383
29123993530,3cyclictest33-21ksoftirqd/210:43:342
29123993529,4cyclictest33-21ksoftirqd/207:58:042
29123993529,4cyclictest33-21ksoftirqd/207:18:572
29123993513,20cyclictest20480-21latency_hist10:15:002
29122993530,3cyclictest25-21ksoftirqd/107:35:121
29122993529,4cyclictest25-21ksoftirqd/108:50:091
29122993528,4cyclictest25-21ksoftirqd/109:40:081
29121993528,4cyclictest9-21ksoftirqd/011:02:580
29121993528,4cyclictest9-21ksoftirqd/011:02:580
134391350,1getstats0-21swapper/312:25:273
2912499345,2cyclictest41-21ksoftirqd/311:20:003
2912499344,7cyclictest41-21ksoftirqd/309:15:203
2912499343,4cyclictest41-21ksoftirqd/311:40:243
29124993431,2cyclictest41-21ksoftirqd/307:20:003
29124993430,3cyclictest41-21ksoftirqd/311:10:203
29124993430,3cyclictest41-21ksoftirqd/308:20:133
29124993430,2cyclictest41-21ksoftirqd/310:35:003
29124993429,2cyclictest41-21ksoftirqd/307:40:143
29124993428,4cyclictest41-21ksoftirqd/307:15:003
29122993429,3cyclictest27984-21nfs4_client11:35:201
29122993428,4cyclictest25-21ksoftirqd/112:27:281
29122993428,4cyclictest25-21ksoftirqd/108:34:331
29121993428,4cyclictest9-21ksoftirqd/010:23:350
29121993428,4cyclictest9-21ksoftirqd/009:06:180
29121993428,4cyclictest9-21ksoftirqd/009:00:120
29121993428,4cyclictest9-21ksoftirqd/008:46:400
2912199342,29cyclictest31342-21cron11:45:000
2912499333,3cyclictest121rcu_preempt07:35:013
29124993329,2cyclictest41-21ksoftirqd/312:35:253
29124993329,2cyclictest41-21ksoftirqd/312:20:173
29124993329,2cyclictest41-21ksoftirqd/312:20:173
29124993329,2cyclictest41-21ksoftirqd/310:20:013
29124993328,3cyclictest41-21ksoftirqd/310:55:203
29124993328,3cyclictest41-21ksoftirqd/309:30:003
2912499331,8cyclictest41-21ksoftirqd/311:20:233
2912399336,18cyclictest0-21swapper/208:32:042
2912399334,14cyclictest1300-21snmpd08:19:412
29123993328,3cyclictest33-21ksoftirqd/210:17:192
29123993327,4cyclictest33-21ksoftirqd/212:33:442
29122993329,3cyclictest25-21ksoftirqd/108:01:181
29122993328,3cyclictest25-21ksoftirqd/110:23:041
29122993328,3cyclictest25-21ksoftirqd/109:22:261
29122993327,4cyclictest25-21ksoftirqd/111:08:021
29122993327,4cyclictest25-21ksoftirqd/108:58:311
29122993327,4cyclictest25-21ksoftirqd/108:27:191
29122993327,4cyclictest25-21ksoftirqd/107:51:411
29122993327,4cyclictest25-21ksoftirqd/107:32:191
29122993326,4cyclictest25-21ksoftirqd/112:30:081
29121993328,3cyclictest9-21ksoftirqd/007:15:010
29121993327,4cyclictest9-21ksoftirqd/012:09:300
29121993327,4cyclictest9-21ksoftirqd/011:48:190
29121993327,4cyclictest9-21ksoftirqd/011:24:170
29121993327,4cyclictest9-21ksoftirqd/008:23:080
29123993226,3cyclictest32647-21cron08:25:002
29122993227,3cyclictest25-21ksoftirqd/111:22:321
29122993227,3cyclictest25-21ksoftirqd/109:37:351
29122993227,3cyclictest25-21ksoftirqd/109:26:031
29122993227,3cyclictest25-21ksoftirqd/107:25:121
29122993226,4cyclictest25-21ksoftirqd/112:24:151
29122993226,4cyclictest25-21ksoftirqd/112:24:151
29122993226,4cyclictest25-21ksoftirqd/110:52:161
29122993226,4cyclictest25-21ksoftirqd/110:33:551
29122993226,4cyclictest25-21ksoftirqd/110:26:541
29122993226,4cyclictest25-21ksoftirqd/110:01:541
29122993226,4cyclictest25-21ksoftirqd/109:06:181
29122993226,4cyclictest25-21ksoftirqd/107:46:151
29121993226,4cyclictest9-21ksoftirqd/008:30:460
29121993226,4cyclictest9-21ksoftirqd/008:13:540
2912199320,18cyclictest23859-21fschecks_time08:05:160
29123993126,3cyclictest33-21ksoftirqd/208:55:282
29123993122,5cyclictest33-21ksoftirqd/207:20:132
29123993119,10cyclictest33-21ksoftirqd/207:25:282
29122993126,3cyclictest25-21ksoftirqd/111:19:191
29122993126,3cyclictest25-21ksoftirqd/111:04:041
29122993126,3cyclictest25-21ksoftirqd/111:04:041
29122993126,3cyclictest25-21ksoftirqd/109:53:261
29122993126,3cyclictest25-21ksoftirqd/108:15:401
29122993126,3cyclictest25-21ksoftirqd/108:13:371
29122993126,3cyclictest25-21ksoftirqd/108:07:211
29122993126,3cyclictest25-21ksoftirqd/107:14:401
29122993125,4cyclictest25-21ksoftirqd/111:10:511
29121993127,3cyclictest9-21ksoftirqd/008:02:580
29121993125,4cyclictest9-21ksoftirqd/011:30:010
29121993125,4cyclictest9-21ksoftirqd/009:16:520
29121993125,4cyclictest9-21ksoftirqd/008:27:170
29121993125,4cyclictest9-21ksoftirqd/007:58:380
676823024,3sleep233-21ksoftirqd/212:00:142
29123993025,3cyclictest33-21ksoftirqd/211:45:102
29123993024,4cyclictest33-21ksoftirqd/211:11:312
29123993024,4cyclictest33-21ksoftirqd/208:44:052
29122993025,3cyclictest25-21ksoftirqd/111:40:371
29122993025,3cyclictest25-21ksoftirqd/107:15:161
29122993024,4cyclictest25-21ksoftirqd/112:05:451
29122993024,4cyclictest25-21ksoftirqd/110:18:111
29122993023,5cyclictest25-21ksoftirqd/109:19:061
29121993025,3cyclictest9-21ksoftirqd/012:31:290
29121993025,3cyclictest9-21ksoftirqd/012:13:000
29121993025,3cyclictest9-21ksoftirqd/011:59:260
29121993025,3cyclictest9-21ksoftirqd/007:37:240
29121993024,4cyclictest9-21ksoftirqd/011:09:400
29121993024,4cyclictest9-21ksoftirqd/010:54:570
29121993024,4cyclictest9-21ksoftirqd/010:32:290
29121993024,4cyclictest9-21ksoftirqd/009:59:570
2912399293,10cyclictest639-21mailstats09:30:242
29123992922,5cyclictest33-21ksoftirqd/208:28:042
29122992924,3cyclictest25-21ksoftirqd/107:59:141
29122992923,4cyclictest25-21ksoftirqd/109:46:411
29122992923,4cyclictest25-21ksoftirqd/108:23:461
29122992923,4cyclictest25-21ksoftirqd/107:20:111
29121992924,3cyclictest9-21ksoftirqd/012:22:330
29121992924,3cyclictest9-21ksoftirqd/012:22:330
29121992923,4cyclictest9-21ksoftirqd/010:58:530
29121992923,4cyclictest9-21ksoftirqd/008:15:270
29121992923,4cyclictest9-21ksoftirqd/007:54:410
2912399285,7cyclictest6300-21ls08:35:192
29123992825,2cyclictest33-21ksoftirqd/210:50:232
29123992823,3cyclictest33-21ksoftirqd/212:28:532
29123992823,3cyclictest33-21ksoftirqd/209:55:142
29123992822,4cyclictest33-21ksoftirqd/212:12:082
29123992822,4cyclictest33-21ksoftirqd/208:49:512
2912399280,27cyclictest13037-21kworker/2:210:00:222
29122992822,4cyclictest25-21ksoftirqd/109:02:241
29121992823,3cyclictest9-21ksoftirqd/009:20:100
29121992823,3cyclictest9-21ksoftirqd/007:32:390
29121992822,4cyclictest9-21ksoftirqd/010:37:560
29121992822,4cyclictest9-21ksoftirqd/009:41:030
29121992822,3cyclictest9-21ksoftirqd/009:30:340
2912399275,11cyclictest0-21swapper/211:20:172
29123992723,3cyclictest33-21ksoftirqd/211:35:192
2912399271,25cyclictest26186-21kworker/2:007:52:402
29122992721,4cyclictest25-21ksoftirqd/110:45:461
2912199277,6cyclictest9-21ksoftirqd/008:56:330
29121992721,4cyclictest9-21ksoftirqd/009:12:030
29121992721,3cyclictest9-21ksoftirqd/009:50:010
29122992621,3cyclictest25-21ksoftirqd/112:12:431
29122992621,3cyclictest25-21ksoftirqd/110:11:281
29122992620,3cyclictest207-21systemd-journal08:50:011
29121992621,3cyclictest9-21ksoftirqd/011:52:450
29121992621,3cyclictest9-21ksoftirqd/011:52:450
29121992621,3cyclictest9-21ksoftirqd/010:07:590
29121992621,3cyclictest9-21ksoftirqd/007:46:310
29122992520,3cyclictest25-21ksoftirqd/111:51:061
29122992520,3cyclictest25-21ksoftirqd/111:51:061
2912199253,7cyclictest9-21ksoftirqd/010:25:270
29121992520,3cyclictest9-21ksoftirqd/012:36:460
29121992520,3cyclictest9-21ksoftirqd/012:01:190
29121992519,4cyclictest9-21ksoftirqd/012:27:110
29122992419,3cyclictest25-21ksoftirqd/112:36:161
29121992418,3cyclictest9-21ksoftirqd/011:35:200
2912199233,8cyclictest9-21ksoftirqd/010:45:210
29121992318,3cyclictest9-21ksoftirqd/010:14:590
29121992317,4cyclictest9-21ksoftirqd/010:02:220
29121992317,4cyclictest9-21ksoftirqd/007:29:580
29122992217,3cyclictest25-21ksoftirqd/110:08:501
29122992216,4cyclictest25-21ksoftirqd/110:35:311
29122992116,3cyclictest25-21ksoftirqd/112:17:441
29122991914,3cyclictest1778-21sendmail_mailst10:40:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional