You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 09:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Mon May 25, 2026 00:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
139491207173,22phc2sys0-21swapper/319:08:413
156592204171,22sleep10-21swapper/119:05:591
156302204169,23sleep20-21swapper/219:05:362
158572203170,22sleep00-21swapper/019:08:270
2098521590,3sleep11626999cyclictest20:25:221
1230021380,5sleep11626999cyclictest23:30:181
139391730,1ptp4l391rcuc/323:55:183
16269996713,52cyclictest0-21swapper/100:35:531
63642650,7sleep21627099cyclictest19:55:222
263082610,5sleep10-21swapper/120:35:291
1627199618,6cyclictest3867-21awk20:59:593
134391610,6getstats1627199cyclictest20:22:213
168112580,3sleep2311rcuc/219:10:182
1627199578,7cyclictest6661-21tr21:05:143
1627199571,16cyclictest20973-21sort22:40:193
1627199569,9cyclictest11054-21sed20:05:203
1627199567,7cyclictest6554-21latency_hist23:20:013
1627199564,17cyclictest8789-21iwlist00:30:163
1627199561,16cyclictest19476-21irqrtprio19:15:193
1627199561,12cyclictest13845-21cat23:34:593
1627199561,11cyclictest15009-21latency_hist22:29:593
1627199554,5cyclictest0-21swapper/320:40:143
1627199546,7cyclictest13014-21cut20:10:163
1627199543,10cyclictest24581-21cat22:50:013
1627199540,12cyclictest0-21swapper/319:20:183
16270995422,3cyclictest33-21ksoftirqd/223:50:152
139391540,1ptp4l391rcuc/323:25:153
1627199536,6cyclictest30340-21idleruntime-cro19:40:013
1627199534,11cyclictest20393-21ls23:45:263
1627199534,10cyclictest3180-21expr19:50:143
1627199534,10cyclictest22100-21latency23:50:193
1627199532,16cyclictest27095-21/usr/sbin/munin22:55:153
1627199531,11cyclictest18171-21sshd19:11:523
1627199530,9cyclictest12471-21phc2sys-jitter21:15:243
1627199527,6cyclictest2431-21if_enp4s023:10:163
1627199526,7cyclictest11262-21sed22:20:183
1627199524,11cyclictest29806-21awk21:50:283
1627199523,9cyclictest7583-21grep23:20:193
1627199521,9cyclictest29822-21df_abs23:00:143
1627199521,9cyclictest0-21swapper/320:50:013
1627199512,9cyclictest1210-21cstates00:15:153
1627199511,19cyclictest14485-21cut21:20:183
1627099518,14cyclictest33-21ksoftirqd/219:50:202
16270995120,4cyclictest33-21ksoftirqd/222:15:162
1627199502,5cyclictest0-21swapper/321:10:263
1627199502,10cyclictest16933-21awk22:30:273
1627199500,11cyclictest310-21ls19:45:003
1627199500,11cyclictest22004-21cat21:35:203
16270995019,5cyclictest33-21ksoftirqd/220:40:142
1627199493,6cyclictest0-21swapper/300:20:193
1627199492,6cyclictest0-21swapper/321:34:593
1627199491,17cyclictest17759-21sed21:25:273
1627199490,11cyclictest25136-21sed19:25:273
1627199490,11cyclictest25136-21sed19:25:273
16270994921,3cyclictest33-21ksoftirqd/222:25:142
16270994918,6cyclictest33-21ksoftirqd/220:55:232
1627199482,16cyclictest29940-21sed00:05:293
1627199482,14cyclictest26319-21if_enp1s021:45:153
1627199482,11cyclictest24778-21mailstats21:40:233
1627199481,17cyclictest17419-21cat23:40:193
1627199481,10cyclictest3110-21/usr/sbin/munin22:05:203
1627199481,10cyclictest3110-21/usr/sbin/munin22:05:203
1627199480,10cyclictest6180-21sed19:55:193
16270994820,4cyclictest33-21ksoftirqd/223:10:232
16270994819,5cyclictest33-21ksoftirqd/200:20:182
16270994816,6cyclictest33-21ksoftirqd/200:20:002
16270994816,6cyclictest33-21ksoftirqd/200:15:002
1627199476,7cyclictest5694-21cstates22:10:143
1627199476,6cyclictest6049-21cstates00:25:103
1627199473,5cyclictest0-21swapper/321:55:183
1627199472,11cyclictest31981-21df_abs20:50:143
1627199472,11cyclictest18440-21sed22:35:193
1627199471,5cyclictest0-21swapper/322:50:163
1627199471,5cyclictest0-21swapper/320:20:003
1627199471,16cyclictest7673-21/usr/sbin/munin20:00:233
1627199470,17cyclictest22182-21/usr/sbin/munin20:30:173
16270994717,8cyclictest33-21ksoftirqd/223:40:012
16270994717,8cyclictest33-21ksoftirqd/223:40:012
16270994715,4cyclictest33-21ksoftirqd/221:45:112
16270994615,5cyclictest33-21ksoftirqd/222:00:132
16270994615,4cyclictest33-21ksoftirqd/220:15:012
1627199452,14cyclictest1300-21snmpd20:35:113
16270994533,9cyclictest33-21ksoftirqd/200:25:222
16270994515,3cyclictest33-21ksoftirqd/223:55:132
16270994514,5cyclictest33-21ksoftirqd/221:10:012
1627199441,7cyclictest1237-21if_enp1s022:00:163
1627199441,16cyclictest26060-21cstates19:30:133
1627199441,15cyclictest760-21expr19:45:133
1627199441,11cyclictest1799-21cut23:10:003
1627099444,11cyclictest121rcu_preempt00:05:322
16270994418,4cyclictest33-21ksoftirqd/222:35:202
16270994415,4cyclictest33-21ksoftirqd/223:40:262
16270994413,5cyclictest33-21ksoftirqd/223:05:172
16270994412,6cyclictest33-21ksoftirqd/219:45:232
16270994412,4cyclictest33-21ksoftirqd/223:20:132
16270994411,4cyclictest33-21ksoftirqd/220:10:012
1626999440,20cyclictest0-21swapper/123:02:031
1627199431,11cyclictest26920-21ls00:00:203
1627199430,11cyclictest12219-21sed00:35:273
1627099438,4cyclictest33-21ksoftirqd/221:55:162
16270994339,2cyclictest321ktimersoftd/220:50:272
16270994317,3cyclictest33-21ksoftirqd/222:30:162
16270994311,4cyclictest33-21ksoftirqd/223:15:182
139391430,0ptp4l401ktimersoftd/300:13:473
16270994210,11cyclictest33-21ksoftirqd/220:00:122
1627199412,9cyclictest20111-21df20:25:133
1627099418,4cyclictest33-21ksoftirqd/219:20:182
1627099417,4cyclictest33-21ksoftirqd/219:35:142
1627099412,2cyclictest121rcu_preempt20:25:252
1627099411,5cyclictest121rcu_preempt20:20:122
16270994112,6cyclictest33-21ksoftirqd/221:20:132
1627099410,2cyclictest121rcu_preempt23:00:142
16268994125,13cyclictest9-21ksoftirqd/019:35:120
1627099408,5cyclictest33-21ksoftirqd/220:15:242
1627099407,4cyclictest33-21ksoftirqd/221:25:192
16270994035,3cyclictest33-21ksoftirqd/200:05:002
16270994011,4cyclictest33-21ksoftirqd/223:25:132
16269994011,27cyclictest0-21swapper/120:40:431
1627099398,4cyclictest33-21ksoftirqd/219:30:002
1627099398,4cyclictest33-21ksoftirqd/219:30:002
1627099398,10cyclictest33-21ksoftirqd/220:50:012
16270993934,3cyclictest33-21ksoftirqd/221:30:132
16270993934,3cyclictest33-21ksoftirqd/220:40:012
16270993927,4cyclictest33-21ksoftirqd/221:40:182
16270993920,2cyclictest33-21ksoftirqd/219:15:232
1627099391,3cyclictest121rcu_preempt21:04:582
16270993833,3cyclictest33-21ksoftirqd/221:20:002
16270993833,3cyclictest33-21ksoftirqd/219:41:592
16270993833,3cyclictest33-21ksoftirqd/200:30:142
16270993832,3cyclictest33-21ksoftirqd/222:45:162
1627099382,2cyclictest121rcu_preempt22:40:172
16270993810,4cyclictest33-21ksoftirqd/223:45:132
1627099380,2cyclictest121rcu_preempt22:55:242
16269993831,5cyclictest25-21ksoftirqd/120:51:331
16268993833,3cyclictest24497-21cron22:50:000
1627199373,5cyclictest0-21swapper/323:35:163
1627199373,5cyclictest0-21swapper/323:35:163
1627099379,4cyclictest33-21ksoftirqd/200:35:162
16270993731,3cyclictest33-21ksoftirqd/221:50:192
16270993731,3cyclictest33-21ksoftirqd/219:30:212
1627099371,3cyclictest121rcu_preempt23:30:172
16269993731,4cyclictest25-21ksoftirqd/121:59:331
1627199361,12cyclictest10304-21cat22:20:013
16270993632,3cyclictest33-21ksoftirqd/222:15:002
16270993632,3cyclictest33-21ksoftirqd/220:30:182
16270993632,2cyclictest33-21ksoftirqd/222:05:202
16270993632,2cyclictest33-21ksoftirqd/222:05:202
16270993632,2cyclictest33-21ksoftirqd/221:10:212
16270993623,4cyclictest33-21ksoftirqd/222:50:382
1626999368,27cyclictest0-21swapper/123:25:541
16269993630,4cyclictest25-21ksoftirqd/121:45:491
16269993630,4cyclictest25-21ksoftirqd/119:32:181
16269993629,5cyclictest25-21ksoftirqd/122:37:161
16269993629,4cyclictest25-21ksoftirqd/123:58:161
16268993631,3cyclictest9-21ksoftirqd/023:35:000
16271993529,4cyclictest41-21ksoftirqd/321:03:473
16270993531,2cyclictest33-21ksoftirqd/222:20:162
1627099350,2cyclictest121rcu_preempt21:35:012
1626999355,28cyclictest0-21swapper/100:15:441
16269993530,3cyclictest25-21ksoftirqd/122:42:501
16269993530,3cyclictest25-21ksoftirqd/122:09:401
16269993530,3cyclictest25-21ksoftirqd/122:09:401
16269993530,3cyclictest25-21ksoftirqd/119:47:191
16269993529,4cyclictest25-21ksoftirqd/123:13:221
16269993529,4cyclictest25-21ksoftirqd/122:01:251
16269993529,4cyclictest25-21ksoftirqd/121:32:441
16269993529,4cyclictest25-21ksoftirqd/121:10:591
16269993529,4cyclictest25-21ksoftirqd/119:42:091
16269993529,4cyclictest25-21ksoftirqd/100:25:391
1626999350,34cyclictest0-21swapper/122:20:431
16269993428,4cyclictest25-21ksoftirqd/123:40:291
16269993428,4cyclictest25-21ksoftirqd/122:54:451
16269993428,4cyclictest25-21ksoftirqd/120:34:351
16269993428,4cyclictest25-21ksoftirqd/120:11:051
16269993427,5cyclictest25-21ksoftirqd/120:46:161
16269993427,5cyclictest25-21ksoftirqd/119:52:441
16269993411,20cyclictest32137-21expr23:05:121
16268993428,4cyclictest9-21ksoftirqd/022:35:100
16268993428,4cyclictest9-21ksoftirqd/019:45:290
16268993428,4cyclictest9-21ksoftirqd/000:30:080
16268993427,5cyclictest9-21ksoftirqd/019:30:000
16268993427,5cyclictest9-21ksoftirqd/019:30:000
16269993327,4cyclictest25-21ksoftirqd/122:28:571
16269993327,4cyclictest25-21ksoftirqd/121:39:591
16269993327,4cyclictest25-21ksoftirqd/121:02:121
16269993327,4cyclictest25-21ksoftirqd/120:15:111
16269993327,4cyclictest25-21ksoftirqd/120:09:171
16269993327,4cyclictest25-21ksoftirqd/100:00:231
16269993327,3cyclictest25-21ksoftirqd/100:15:001
16269993326,5cyclictest25-21ksoftirqd/121:28:361
16269993313,17cyclictest23787-21sed19:25:151
16269993313,17cyclictest23787-21sed19:25:151
16268993328,3cyclictest9-21ksoftirqd/021:36:280
16268993327,4cyclictest9-21ksoftirqd/022:25:320
16268993327,4cyclictest9-21ksoftirqd/021:17:350
16268993327,4cyclictest9-21ksoftirqd/020:12:530
16268993327,4cyclictest9-21ksoftirqd/019:53:190
16268993327,4cyclictest9-21ksoftirqd/019:30:530
16268993327,4cyclictest9-21ksoftirqd/000:00:060
16269993226,4cyclictest25-21ksoftirqd/121:44:411
16269993226,4cyclictest25-21ksoftirqd/121:24:111
16269993226,4cyclictest25-21ksoftirqd/120:56:061
16269993226,4cyclictest25-21ksoftirqd/100:33:331
16269993226,4cyclictest25-21ksoftirqd/100:06:491
16268993227,3cyclictest9-21ksoftirqd/023:53:160
16268993227,3cyclictest9-21ksoftirqd/021:56:350
16268993227,3cyclictest9-21ksoftirqd/019:44:160
16268993226,4cyclictest9-21ksoftirqd/023:45:470
16268993226,4cyclictest9-21ksoftirqd/022:56:250
16268993226,4cyclictest9-21ksoftirqd/022:50:140
16268993226,4cyclictest9-21ksoftirqd/022:17:280
16268993226,4cyclictest9-21ksoftirqd/021:54:020
16268993226,4cyclictest9-21ksoftirqd/020:47:500
16268993226,4cyclictest9-21ksoftirqd/020:42:220
16268993226,4cyclictest9-21ksoftirqd/020:07:110
16269993126,3cyclictest25-21ksoftirqd/123:18:241
16269993126,3cyclictest25-21ksoftirqd/122:12:381
16269993125,4cyclictest25-21ksoftirqd/123:38:011
16269993125,4cyclictest25-21ksoftirqd/123:38:011
16269993125,4cyclictest25-21ksoftirqd/122:17:141
16269993125,3cyclictest25-21ksoftirqd/122:49:461
16269993110,19cyclictest29332-21cut22:59:591
16268993126,3cyclictest9-21ksoftirqd/021:49:420
16268993126,3cyclictest9-21ksoftirqd/021:10:460
16268993126,3cyclictest9-21ksoftirqd/019:58:210
16268993126,3cyclictest9-21ksoftirqd/019:17:090
16268993126,3cyclictest9-21ksoftirqd/000:37:540
16268993125,4cyclictest9-21ksoftirqd/022:42:560
1626999308,8cyclictest207-21systemd-journal21:20:011
16269993025,3cyclictest25-21ksoftirqd/123:20:071
16269993025,3cyclictest25-21ksoftirqd/120:25:001
16269993025,3cyclictest25-21ksoftirqd/119:10:391
16269993024,4cyclictest25-21ksoftirqd/122:32:141
16269993024,4cyclictest25-21ksoftirqd/119:16:381
16269993023,5cyclictest25-21ksoftirqd/119:55:571
16268993025,3cyclictest9-21ksoftirqd/021:26:220
16268993025,3cyclictest9-21ksoftirqd/000:28:140
16268993024,4cyclictest9-21ksoftirqd/023:28:550
16268993024,4cyclictest9-21ksoftirqd/023:24:250
16268993024,4cyclictest9-21ksoftirqd/023:16:260
16268993024,4cyclictest9-21ksoftirqd/022:23:190
16268993024,4cyclictest9-21ksoftirqd/022:12:390
16268993024,4cyclictest9-21ksoftirqd/021:01:470
16268993024,4cyclictest9-21ksoftirqd/020:17:250
16269992924,3cyclictest25-21ksoftirqd/121:50:121
16268992924,3cyclictest9-21ksoftirqd/023:08:320
16268992924,3cyclictest9-21ksoftirqd/020:51:020
16268992924,3cyclictest9-21ksoftirqd/020:26:180
16268992924,3cyclictest9-21ksoftirqd/019:25:000
16268992923,4cyclictest9-21ksoftirqd/021:32:280
16268992923,4cyclictest9-21ksoftirqd/020:30:060
16268992923,4cyclictest9-21ksoftirqd/020:04:510
16269992823,3cyclictest25-21ksoftirqd/100:21:211
16269992822,4cyclictest25-21ksoftirqd/121:06:461
16268992823,3cyclictest9-21ksoftirqd/023:42:410
16268992823,3cyclictest9-21ksoftirqd/022:05:460
16268992823,3cyclictest9-21ksoftirqd/022:05:460
16268992823,3cyclictest9-21ksoftirqd/020:20:390
16268992823,3cyclictest9-21ksoftirqd/019:11:150
16268992822,4cyclictest9-21ksoftirqd/020:57:300
16268992822,4cyclictest9-21ksoftirqd/000:21:160
1626999278,3cyclictest8118-21fschecks_count20:00:141
1626999277,2cyclictest19030-21ls23:45:131
16268992722,3cyclictest9-21ksoftirqd/000:16:590
16268992721,4cyclictest9-21ksoftirqd/023:35:400
16268992721,4cyclictest9-21ksoftirqd/023:35:400
16268992721,4cyclictest9-21ksoftirqd/023:12:050
16268992721,4cyclictest9-21ksoftirqd/021:41:550
16268992721,4cyclictest9-21ksoftirqd/021:23:540
16268992721,4cyclictest9-21ksoftirqd/021:05:320
1626999264,3cyclictest22762-21cat23:50:261
16268992620,4cyclictest9-21ksoftirqd/023:02:460
16268992620,4cyclictest9-21ksoftirqd/022:02:530
16268992620,4cyclictest9-21ksoftirqd/000:11:420
16269992519,3cyclictest25-21ksoftirqd/119:35:071
16269992510,13cyclictest1317-21runrttasks19:21:461
16268992419,3cyclictest9-21ksoftirqd/023:57:130
16268992419,3cyclictest9-21ksoftirqd/000:05:490
16268992116,3cyclictest9-21ksoftirqd/022:33:130
16268991813,3cyclictest26920-21sed20:40:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional