You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 06:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Sun May 24, 2026 00:45:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
286232229164,21sleep30-21swapper/319:06:343
286062201168,22sleep10-21swapper/119:06:201
286052201167,22sleep00-21swapper/019:06:180
286372200167,22sleep20-21swapper/219:06:442
2889729071,10sleep00-21swapper/019:10:000
157052670,1sleep115706-21/usr/sbin/munin23:10:141
29188996516,4cyclictest9-21ksoftirqd/022:04:590
14072560,3sleep31406-21tune2fs22:40:153
8892550,4sleep1241ktimersoftd/121:30:211
139391550,1ptp4l401ktimersoftd/322:11:313
29189995417,10cyclictest25-21ksoftirqd/122:40:141
29189995322,3cyclictest121rcu_preempt20:35:131
139391530,1ptp4l401ktimersoftd/323:08:103
29191995247,3cyclictest4326-21idleruntime-cro21:39:593
2919199522,47cyclictest18718-21basename00:25:003
29189995219,7cyclictest25-21ksoftirqd/122:20:261
114342520,2sleep00-21swapper/020:45:190
114342520,2sleep00-21swapper/020:45:180
29189995112,4cyclictest25-21ksoftirqd/100:37:291
29189995016,7cyclictest25-21ksoftirqd/123:50:231
29189995014,5cyclictest25-21ksoftirqd/121:15:181
29189995014,5cyclictest25-21ksoftirqd/121:15:181
29189994934,3cyclictest25-21ksoftirqd/123:35:181
29189994911,9cyclictest25-21ksoftirqd/121:20:261
29189994910,7cyclictest25-21ksoftirqd/119:29:311
2919099482,44cyclictest27783-21kworker/2:021:40:252
2918999489,10cyclictest25-21ksoftirqd/123:05:161
2918999485,3cyclictest25-21ksoftirqd/121:00:161
2918999484,2cyclictest24792-21apt21:15:001
29189994813,4cyclictest25-21ksoftirqd/120:28:211
2919099470,45cyclictest0-21swapper/223:35:232
2918999479,8cyclictest25-21ksoftirqd/122:09:421
2918999479,4cyclictest25-21ksoftirqd/100:30:261
2918999476,7cyclictest25-21ksoftirqd/120:00:001
29189994735,4cyclictest25-21ksoftirqd/100:00:001
2918999473,2cyclictest25-21ksoftirqd/119:20:141
29189994711,4cyclictest25-21ksoftirqd/120:40:011
29189994615,4cyclictest25-21ksoftirqd/119:35:161
29189994614,8cyclictest25-21ksoftirqd/120:30:151
29189994610,2cyclictest121rcu_preempt19:41:331
2919099459,33cyclictest11084-21kworker/2:223:44:242
2918999459,4cyclictest25-21ksoftirqd/121:45:161
2918999459,4cyclictest25-21ksoftirqd/121:45:161
2918999459,3cyclictest25-21ksoftirqd/122:35:121
2918999456,3cyclictest25-21ksoftirqd/122:45:261
2918999454,5cyclictest25-21ksoftirqd/122:55:211
2918999454,5cyclictest25-21ksoftirqd/121:50:181
2918999454,3cyclictest25-21ksoftirqd/122:30:201
2918999453,2cyclictest25-21ksoftirqd/100:15:231
2918999452,4cyclictest25-21ksoftirqd/100:00:221
29189994516,8cyclictest25-21ksoftirqd/123:40:161
29189994513,4cyclictest25-21ksoftirqd/119:10:251
29189994510,9cyclictest25-21ksoftirqd/123:20:351
29190994415,27cyclictest16139-21kworker/2:119:55:242
2918999445,2cyclictest25-21ksoftirqd/122:15:081
2918999444,6cyclictest25-21ksoftirqd/123:30:201
2918999443,2cyclictest25-21ksoftirqd/120:50:261
29189994416,10cyclictest25-21ksoftirqd/121:40:231
29189994411,3cyclictest25-21ksoftirqd/120:18:151
29189994410,3cyclictest25-21ksoftirqd/119:48:141
29189994410,3cyclictest25-21ksoftirqd/119:48:141
2918899442,3cyclictest9-21ksoftirqd/000:25:190
139391440,0ptp4l401ktimersoftd/321:55:023
139391440,0ptp4l401ktimersoftd/321:47:533
139391440,0ptp4l401ktimersoftd/321:47:533
2918999438,3cyclictest25-21ksoftirqd/119:15:261
2918999436,3cyclictest25-21ksoftirqd/120:10:451
2918999435,2cyclictest25-21ksoftirqd/120:24:481
2918999433,7cyclictest25-21ksoftirqd/120:45:261
2918999433,7cyclictest25-21ksoftirqd/120:45:261
29189994333,3cyclictest25-21ksoftirqd/119:50:271
29189994332,3cyclictest25-21ksoftirqd/100:29:351
29189994328,5cyclictest25-21ksoftirqd/122:02:021
2918999432,2cyclictest25-21ksoftirqd/123:25:241
2918999432,2cyclictest25-21ksoftirqd/121:05:251
29189994313,4cyclictest25-21ksoftirqd/120:05:231
29189994310,4cyclictest25-21ksoftirqd/122:10:121
2918999430,3cyclictest25-21ksoftirqd/123:45:181
2918999430,3cyclictest25-21ksoftirqd/120:55:251
139391430,0ptp4l401ktimersoftd/321:25:243
2919199421,39cyclictest31842-21cron23:45:003
2918999425,3cyclictest25-21ksoftirqd/120:02:261
2918999421,3cyclictest25-21ksoftirqd/119:30:241
2918999421,3cyclictest25-21ksoftirqd/100:05:271
29189994210,7cyclictest25-21ksoftirqd/100:24:551
29188994214,4cyclictest9-21ksoftirqd/022:25:260
29188994213,3cyclictest9-21ksoftirqd/021:05:140
29188994212,3cyclictest9-21ksoftirqd/021:45:310
29188994212,3cyclictest9-21ksoftirqd/021:45:310
29191994136,3cyclictest41-21ksoftirqd/319:30:003
29190994134,4cyclictest8912-21cron19:35:002
2918999414,3cyclictest121rcu_preempt21:55:181
29189994136,3cyclictest25-21ksoftirqd/121:25:211
2918999411,2cyclictest25-21ksoftirqd/122:25:271
29188994110,3cyclictest9-21ksoftirqd/021:25:130
57898400,8rtkit-daemon0-21swapper/319:52:463
2918999405,2cyclictest1317-21runrttasks00:12:101
29189994035,2cyclictest25-21ksoftirqd/121:40:001
29189994034,3cyclictest25-21ksoftirqd/123:00:131
29188994013,3cyclictest9-21ksoftirqd/022:55:260
29188994012,3cyclictest9-21ksoftirqd/022:20:140
29190993912,26cyclictest16139-21kworker/2:119:50:252
2918999393,3cyclictest25-21ksoftirqd/123:15:211
2918999391,6cyclictest121rcu_preempt22:50:141
2918899396,2cyclictest9-21ksoftirqd/022:35:170
2918899394,3cyclictest9-21ksoftirqd/023:45:000
29188993911,3cyclictest9-21ksoftirqd/019:40:230
29188993911,3cyclictest9-21ksoftirqd/000:15:280
29191993831,4cyclictest8988-21cron00:05:013
2918899385,3cyclictest9-21ksoftirqd/023:45:160
29188993834,2cyclictest9-21ksoftirqd/000:40:000
29188993833,3cyclictest9-21ksoftirqd/023:40:000
29188993833,3cyclictest9-21ksoftirqd/021:39:590
2918899381,3cyclictest121rcu_preempt00:05:010
29188993810,3cyclictest9-21ksoftirqd/019:25:260
29191993731,4cyclictest41-21ksoftirqd/320:26:363
2919099378,27cyclictest0-21swapper/200:05:232
29190993731,4cyclictest33-21ksoftirqd/221:53:202
2918899375,3cyclictest9-21ksoftirqd/022:15:010
29188993732,3cyclictest9-21ksoftirqd/022:05:190
29188993732,3cyclictest9-21ksoftirqd/019:40:000
2918899371,4cyclictest9-21ksoftirqd/019:20:010
2918899371,2cyclictest121rcu_preempt00:10:000
139391370,1ptp4l391rcuc/320:45:263
139391370,1ptp4l391rcuc/320:45:263
29191993631,3cyclictest41-21ksoftirqd/321:20:003
29191993631,3cyclictest41-21ksoftirqd/321:20:003
29190993630,4cyclictest33-21ksoftirqd/223:06:572
29190993630,3cyclictest33-21ksoftirqd/220:47:562
29190993630,3cyclictest33-21ksoftirqd/220:47:562
2918899367,3cyclictest9-21ksoftirqd/021:20:190
2918899364,3cyclictest9-21ksoftirqd/023:25:180
2918899363,3cyclictest9-21ksoftirqd/019:50:010
2918899363,3cyclictest9-21ksoftirqd/019:50:000
29188993632,3cyclictest9-21ksoftirqd/023:30:280
29188993632,2cyclictest9-21ksoftirqd/022:45:180
29188993632,2cyclictest9-21ksoftirqd/020:55:010
29188993631,3cyclictest9-21ksoftirqd/019:50:150
29188993631,3cyclictest9-21ksoftirqd/000:20:280
29188993631,3cyclictest25799-21sh20:09:590
29188993631,2cyclictest9-21ksoftirqd/023:20:230
29188993630,3cyclictest9-21ksoftirqd/023:55:130
29188993630,3cyclictest9-21ksoftirqd/000:35:000
29188993623,3cyclictest9-21ksoftirqd/020:20:200
57898350,2rtkit-daemon0-21swapper/220:27:192
29191993530,3cyclictest41-21ksoftirqd/321:40:313
29191993529,4cyclictest41-21ksoftirqd/322:22:423
29190993529,4cyclictest33-21ksoftirqd/223:31:572
29190993529,4cyclictest33-21ksoftirqd/223:25:352
29190993529,4cyclictest33-21ksoftirqd/222:55:022
29190993529,4cyclictest33-21ksoftirqd/222:38:092
29190993529,4cyclictest33-21ksoftirqd/222:27:502
29190993529,4cyclictest33-21ksoftirqd/221:32:062
2918899356,4cyclictest9-21ksoftirqd/021:50:200
2918899355,3cyclictest9-21ksoftirqd/000:10:170
2918899354,3cyclictest9-21ksoftirqd/019:55:170
2918899353,3cyclictest121rcu_preempt21:55:240
29188993531,3cyclictest9-21ksoftirqd/023:55:010
29188993531,2cyclictest9-21ksoftirqd/021:10:230
29188993531,2cyclictest9-21ksoftirqd/020:15:150
29188993531,2cyclictest9-21ksoftirqd/019:20:180
29188993530,3cyclictest9-21ksoftirqd/022:50:000
29188993530,3cyclictest9-21ksoftirqd/022:30:240
29188993530,3cyclictest9-21ksoftirqd/020:35:160
29188993530,3cyclictest9-21ksoftirqd/020:30:010
139391350,1ptp4l391rcuc/323:20:123
29191993429,3cyclictest41-21ksoftirqd/322:55:113
29191993429,3cyclictest41-21ksoftirqd/320:05:113
29191993428,4cyclictest41-21ksoftirqd/321:00:513
29191993428,4cyclictest41-21ksoftirqd/300:34:203
2919099344,27cyclictest4332-21latency_hist21:40:002
29190993429,3cyclictest33-21ksoftirqd/221:45:472
29190993429,3cyclictest33-21ksoftirqd/221:45:472
29190993429,3cyclictest33-21ksoftirqd/219:36:582
29190993428,4cyclictest33-21ksoftirqd/221:15:022
29190993428,4cyclictest33-21ksoftirqd/221:15:022
29190993428,4cyclictest33-21ksoftirqd/220:36:222
29190993428,4cyclictest33-21ksoftirqd/220:17:322
29190993428,4cyclictest33-21ksoftirqd/219:49:332
29190993428,4cyclictest33-21ksoftirqd/219:49:322
29190993427,4cyclictest20950-21irqrtprio21:05:192
29190993413,18cyclictest3973-21idleruntime-cro19:25:012
2918899346,4cyclictest9-21ksoftirqd/019:30:210
2918899343,3cyclictest9-21ksoftirqd/023:10:150
2918899343,2cyclictest9-21ksoftirqd/023:15:270
29188993430,3cyclictest9-21ksoftirqd/020:30:150
29188993430,2cyclictest9-21ksoftirqd/021:15:140
29188993430,2cyclictest9-21ksoftirqd/021:15:140
29188993429,3cyclictest9-21ksoftirqd/022:15:260
29188993429,3cyclictest9-21ksoftirqd/021:04:590
29188993429,3cyclictest9-21ksoftirqd/020:55:250
29188993429,3cyclictest9-21ksoftirqd/020:40:150
29188993429,2cyclictest9-21ksoftirqd/023:10:000
29188993429,2cyclictest9-21ksoftirqd/020:05:000
29191993328,3cyclictest41-21ksoftirqd/323:25:113
29191993328,3cyclictest25614-21irqrtprio23:30:203
29191993327,4cyclictest41-21ksoftirqd/320:39:253
29191993327,4cyclictest41-21ksoftirqd/319:22:533
29191993326,4cyclictest31348-21awk19:15:003
29190993328,3cyclictest33-21ksoftirqd/223:45:402
29190993328,3cyclictest33-21ksoftirqd/200:36:062
29190993328,3cyclictest33-21ksoftirqd/200:32:302
29190993327,4cyclictest33-21ksoftirqd/221:02:542
29190993327,4cyclictest33-21ksoftirqd/220:32:132
29190993327,4cyclictest33-21ksoftirqd/220:06:252
29190993327,3cyclictest33-21ksoftirqd/223:02:022
2919099332,30cyclictest31025-21kworker/2:119:25:532
29190993311,19cyclictest19929-21latency_hist23:20:002
2918899334,4cyclictest9-21ksoftirqd/022:40:250
29188993328,3cyclictest9-21ksoftirqd/020:10:120
29188993327,4cyclictest9-21ksoftirqd/023:04:510
29188993327,4cyclictest9-21ksoftirqd/021:30:520
139491337,3phc2sys41-21ksoftirqd/320:52:213
29191993228,2cyclictest41-21ksoftirqd/300:20:003
29191993227,3cyclictest41-21ksoftirqd/322:02:003
29191993227,3cyclictest41-21ksoftirqd/321:14:593
29191993227,3cyclictest41-21ksoftirqd/300:25:403
29191993226,4cyclictest41-21ksoftirqd/322:54:243
29191993226,4cyclictest41-21ksoftirqd/321:22:203
29191993226,4cyclictest41-21ksoftirqd/321:09:413
29191993226,4cyclictest41-21ksoftirqd/320:01:543
29191993226,4cyclictest41-21ksoftirqd/300:05:403
2919099323,28cyclictest27783-21kworker/2:021:27:332
29190993227,3cyclictest33-21ksoftirqd/222:52:102
29190993227,3cyclictest33-21ksoftirqd/220:54:542
29190993227,3cyclictest33-21ksoftirqd/200:18:252
29190993226,4cyclictest33-21ksoftirqd/222:19:092
29190993226,4cyclictest33-21ksoftirqd/221:10:052
29190993226,4cyclictest33-21ksoftirqd/219:16:202
2919099322,29cyclictest11084-21kworker/2:200:20:572
29190993211,18cyclictest14550-21expr22:00:152
2919099320,29cyclictest207-21systemd-journal22:20:502
29188993227,3cyclictest9-21ksoftirqd/021:40:160
139391320,1ptp4l401ktimersoftd/320:40:113
313562310,3sleep20-21swapper/220:20:182
29191993126,3cyclictest41-21ksoftirqd/323:18:233
29191993126,3cyclictest41-21ksoftirqd/319:40:073
29191993126,3cyclictest41-21ksoftirqd/319:35:123
29191993125,4cyclictest41-21ksoftirqd/320:19:113
29191993125,4cyclictest41-21ksoftirqd/319:34:023
2919099313,27cyclictest27783-21kworker/2:020:58:452
29190993126,3cyclictest33-21ksoftirqd/223:51:292
29190993126,3cyclictest33-21ksoftirqd/220:02:512
29190993125,4cyclictest33-21ksoftirqd/222:30:552
29190993125,4cyclictest33-21ksoftirqd/219:43:062
2919099312,28cyclictest27783-21kworker/2:021:23:412
2919099312,28cyclictest27783-21kworker/2:020:10:492
2919099311,29cyclictest14210-21kworker/2:019:10:002
29190993111,17cyclictest22426-21latency_hist23:25:002
139391310,0ptp4l401ktimersoftd/300:35:203
29191993025,3cyclictest41-21ksoftirqd/323:01:483
29191993025,3cyclictest41-21ksoftirqd/322:30:233
29191993024,4cyclictest41-21ksoftirqd/323:58:463
29191993024,4cyclictest41-21ksoftirqd/323:47:263
2919099309,18cyclictest11827-21apt-get00:10:132
2919099306,22cyclictest11084-21kworker/2:200:26:052
2919099303,26cyclictest11084-21kworker/2:200:04:252
29190993025,3cyclictest33-21ksoftirqd/222:48:382
29190993024,4cyclictest33-21ksoftirqd/222:41:352
2919099302,27cyclictest11084-21kworker/2:222:09:092
139391300,0ptp4l401ktimersoftd/320:20:403
29191992924,3cyclictest41-21ksoftirqd/323:12:563
29191992924,3cyclictest41-21ksoftirqd/322:37:303
29191992924,3cyclictest41-21ksoftirqd/322:25:413
29191992924,3cyclictest41-21ksoftirqd/320:55:103
29191992923,4cyclictest41-21ksoftirqd/322:48:173
29190992924,3cyclictest33-21ksoftirqd/223:59:352
29190992923,4cyclictest33-21ksoftirqd/220:43:122
29190992910,3cyclictest13463-21timerwakeupswit21:55:262
29191992823,3cyclictest41-21ksoftirqd/323:38:403
29191992823,3cyclictest41-21ksoftirqd/321:50:113
29191992823,3cyclictest41-21ksoftirqd/321:34:093
29191992823,3cyclictest41-21ksoftirqd/320:31:053
29191992823,3cyclictest41-21ksoftirqd/319:48:393
29191992823,3cyclictest41-21ksoftirqd/319:48:383
29191992822,4cyclictest41-21ksoftirqd/320:10:323
29191992822,3cyclictest41-21ksoftirqd/322:07:343
2919099283,24cyclictest15010-21kworker/2:123:13:172
2919099283,24cyclictest11084-21kworker/2:222:13:502
139391270,0ptp4l401ktimersoftd/319:57:303
29191992621,3cyclictest41-21ksoftirqd/300:12:413
29191992620,4cyclictest41-21ksoftirqd/322:16:403
29191992614,10cyclictest41-21ksoftirqd/323:50:233
29191992520,3cyclictest41-21ksoftirqd/319:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional