You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-23 - 06:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Thu Oct 23, 2025 00:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191207170,25phc2sys0-21swapper/319:08:413
168752202168,23sleep00-21swapper/019:07:460
169532201167,22sleep10-21swapper/119:08:491
167262201168,22sleep20-21swapper/219:05:522
1760021340,3sleep21734399cyclictest20:15:242
1704828262,11sleep10-21swapper/119:10:021
17344996832,10cyclictest41-21ksoftirqd/322:40:003
17344996529,10cyclictest41-21ksoftirqd/319:45:013
17344996130,8cyclictest41-21ksoftirqd/300:20:013
17344996129,9cyclictest41-21ksoftirqd/300:25:013
17344996129,4cyclictest41-21ksoftirqd/320:50:003
17344996128,4cyclictest41-21ksoftirqd/319:15:013
17344996124,10cyclictest41-21ksoftirqd/300:15:003
17344996123,4cyclictest41-21ksoftirqd/322:45:003
17344996025,10cyclictest41-21ksoftirqd/323:05:003
17344995929,9cyclictest41-21ksoftirqd/320:45:013
17344995928,4cyclictest41-21ksoftirqd/319:55:003
17344995926,5cyclictest41-21ksoftirqd/321:10:003
17344995828,8cyclictest41-21ksoftirqd/319:35:223
17344995826,4cyclictest41-21ksoftirqd/323:25:143
17344995826,4cyclictest41-21ksoftirqd/320:55:273
17344995826,4cyclictest41-21ksoftirqd/320:55:273
17344995825,9cyclictest41-21ksoftirqd/319:50:013
17344995824,4cyclictest41-21ksoftirqd/321:35:243
17344995824,12cyclictest41-21ksoftirqd/319:19:593
17344995824,10cyclictest41-21ksoftirqd/319:55:183
17344995822,10cyclictest41-21ksoftirqd/320:50:213
17344995726,4cyclictest41-21ksoftirqd/322:45:163
17344995726,4cyclictest41-21ksoftirqd/321:50:153
17344995725,8cyclictest41-21ksoftirqd/319:30:003
17344995725,10cyclictest41-21ksoftirqd/321:00:163
17344995725,10cyclictest41-21ksoftirqd/320:25:003
17344995724,4cyclictest41-21ksoftirqd/320:05:003
17344995723,8cyclictest41-21ksoftirqd/319:30:203
17344995723,8cyclictest41-21ksoftirqd/319:30:203
17344995628,4cyclictest41-21ksoftirqd/322:15:153
17344995624,10cyclictest41-21ksoftirqd/300:30:303
17344995622,9cyclictest41-21ksoftirqd/322:30:183
17344995622,10cyclictest41-21ksoftirqd/300:05:183
193372550,1sleep10-21swapper/121:25:241
17344995527,8cyclictest41-21ksoftirqd/323:10:263
17344995527,8cyclictest41-21ksoftirqd/323:10:263
17344995527,4cyclictest41-21ksoftirqd/323:30:233
17344995527,4cyclictest41-21ksoftirqd/321:25:113
17344995526,9cyclictest41-21ksoftirqd/322:55:143
17344995526,7cyclictest41-21ksoftirqd/300:35:243
17344995526,4cyclictest41-21ksoftirqd/323:25:013
17344995526,4cyclictest41-21ksoftirqd/300:25:133
17344995525,4cyclictest41-21ksoftirqd/323:35:153
17344995522,7cyclictest41-21ksoftirqd/323:55:203
17344995522,4cyclictest41-21ksoftirqd/323:05:213
1734499545,7cyclictest12193-21apt-get21:15:013
17344995425,4cyclictest41-21ksoftirqd/321:15:153
17344995424,9cyclictest41-21ksoftirqd/323:50:133
17344995423,4cyclictest41-21ksoftirqd/323:40:153
17344995423,4cyclictest41-21ksoftirqd/322:00:133
17344995422,5cyclictest41-21ksoftirqd/320:35:133
17344995421,8cyclictest41-21ksoftirqd/321:20:033
17344995419,9cyclictest41-21ksoftirqd/320:15:133
17344995417,6cyclictest41-21ksoftirqd/320:05:133
17344995325,8cyclictest41-21ksoftirqd/322:10:213
17344995324,9cyclictest41-21ksoftirqd/322:20:263
17344995321,9cyclictest41-21ksoftirqd/323:45:163
17344995321,8cyclictest41-21ksoftirqd/321:55:183
17344995318,8cyclictest41-21ksoftirqd/321:30:173
232852520,2sleep10-21swapper/123:50:171
1734499525,4cyclictest16221-21dump-pmu-power22:30:003
17344995228,6cyclictest41-21ksoftirqd/321:45:133
17344995225,9cyclictest41-21ksoftirqd/323:15:183
17344995224,5cyclictest41-21ksoftirqd/320:30:173
17344995219,5cyclictest41-21ksoftirqd/322:50:233
1734199524,10cyclictest5403-21cpuspeed_turbos21:00:140
17344995124,4cyclictest41-21ksoftirqd/321:40:223
17344995116,8cyclictest41-21ksoftirqd/320:25:263
17344995115,7cyclictest41-21ksoftirqd/300:00:203
1734199503,9cyclictest8735-21latency_hist20:00:010
1734499493,7cyclictest41-21ksoftirqd/322:05:203
1734199497,6cyclictest28449-21df_abs20:40:140
131552490,2sleep20-21swapper/223:30:132
1734499487,2cyclictest41-21ksoftirqd/320:10:223
1734199480,11cyclictest12029-21grep00:35:140
1734499474,7cyclictest41-21ksoftirqd/319:20:153
1734199476,6cyclictest1377-21irqrtprio20:50:190
1734199452,10cyclictest31267-21runrttasks23:00:160
1734199441,7cyclictest19671-21meminfo20:20:220
17342994136,3cyclictest25-21ksoftirqd/121:00:001
17342994136,3cyclictest25-21ksoftirqd/121:00:001
1734199411,7cyclictest2257-21gnome-shell00:30:580
17343994033,5cyclictest33-21ksoftirqd/219:43:392
17342994034,3cyclictest10281-21cron23:25:001
1734199403,4cyclictest0-21swapper/022:10:270
1734199401,7cyclictest17609-21python20:15:240
1734199398,6cyclictest15192-21cat23:35:010
1734199392,7cyclictest21564-21df22:40:150
59298380,7rtkit-daemon0-21swapper/123:49:351
17343993832,4cyclictest33-21ksoftirqd/219:12:092
17342993833,3cyclictest25-21ksoftirqd/121:10:001
59298370,3rtkit-daemon13448-21users22:20:281
17343993731,4cyclictest33-21ksoftirqd/219:31:442
17343993731,4cyclictest33-21ksoftirqd/219:31:432
17343993730,4cyclictest33-21ksoftirqd/221:50:122
17342993732,3cyclictest25-21ksoftirqd/120:55:001
17342993731,4cyclictest25-21ksoftirqd/120:48:421
1734299370,35cyclictest11675-21cron00:35:001
1734199370,8cyclictest4162-21users00:15:290
1734199370,8cyclictest32665-21df00:10:140
17343993630,4cyclictest33-21ksoftirqd/221:19:232
17343993630,4cyclictest33-21ksoftirqd/221:10:442
17342993631,3cyclictest25-21ksoftirqd/123:00:001
17342993631,3cyclictest25-21ksoftirqd/100:15:001
17342993630,4cyclictest25-21ksoftirqd/121:01:081
17342993629,5cyclictest25-21ksoftirqd/123:19:531
17342993629,5cyclictest25-21ksoftirqd/122:13:541
1734199360,8cyclictest10917-21diskstats23:25:160
1734199360,7cyclictest4924-21users23:10:330
1734199360,7cyclictest4924-21users23:10:330
1734199360,7cyclictest22047-21memory20:25:240
1734199360,7cyclictest10344-21df21:10:160
17343993530,3cyclictest33-21ksoftirqd/223:15:102
17343993529,4cyclictest33-21ksoftirqd/221:43:022
17343993529,4cyclictest33-21ksoftirqd/220:41:202
17343993529,4cyclictest33-21ksoftirqd/220:08:262
17343993529,4cyclictest33-21ksoftirqd/220:01:562
17343993529,4cyclictest33-21ksoftirqd/200:32:192
17343993529,4cyclictest33-21ksoftirqd/200:28:552
17342993531,2cyclictest25-21ksoftirqd/100:10:001
17342993530,3cyclictest25-21ksoftirqd/122:30:001
17342993529,4cyclictest25-21ksoftirqd/121:16:131
17342993529,4cyclictest25-21ksoftirqd/120:26:541
17342993528,4cyclictest25-21ksoftirqd/122:45:121
1734199351,8cyclictest2749-21meminfo19:45:220
1734199351,5cyclictest6060-21ps00:20:250
17343993429,3cyclictest33-21ksoftirqd/219:27:172
17343993428,4cyclictest33-21ksoftirqd/223:51:482
17343993428,4cyclictest33-21ksoftirqd/223:36:552
17343993428,4cyclictest33-21ksoftirqd/222:52:142
17343993428,4cyclictest33-21ksoftirqd/222:12:432
17343993428,4cyclictest33-21ksoftirqd/221:35:402
17343993428,4cyclictest33-21ksoftirqd/220:49:142
17343993428,4cyclictest33-21ksoftirqd/220:35:022
17343993428,4cyclictest33-21ksoftirqd/219:53:342
17343993428,4cyclictest33-21ksoftirqd/200:03:062
17343993427,5cyclictest33-21ksoftirqd/223:22:312
17342993428,4cyclictest25-21ksoftirqd/123:06:251
17342993428,4cyclictest25-21ksoftirqd/121:30:051
17342993428,4cyclictest25-21ksoftirqd/120:43:521
17342993428,4cyclictest25-21ksoftirqd/120:14:561
17342993428,3cyclictest15915-21irqrtprio21:20:211
17341993428,4cyclictest9-21ksoftirqd/022:56:460
17341993427,5cyclictest9-21ksoftirqd/021:16:480
17343993328,3cyclictest33-21ksoftirqd/223:26:352
17343993327,4cyclictest33-21ksoftirqd/222:41:312
17343993327,4cyclictest33-21ksoftirqd/220:28:492
17343993327,4cyclictest33-21ksoftirqd/220:24:582
17343993327,4cyclictest33-21ksoftirqd/219:15:542
17343993327,4cyclictest33-21ksoftirqd/200:09:092
17343993327,3cyclictest33-21ksoftirqd/219:39:032
17342993328,3cyclictest25-21ksoftirqd/122:40:001
17342993328,3cyclictest25-21ksoftirqd/121:11:121
17342993328,3cyclictest25-21ksoftirqd/119:25:531
17342993328,3cyclictest25-21ksoftirqd/100:00:001
17342993327,4cyclictest25-21ksoftirqd/122:50:531
17342993327,4cyclictest25-21ksoftirqd/121:40:091
17342993327,4cyclictest25-21ksoftirqd/119:15:301
17342993326,5cyclictest25-21ksoftirqd/122:16:031
17341993329,3cyclictest9-21ksoftirqd/020:10:210
17341993327,4cyclictest9-21ksoftirqd/021:39:350
17343993227,3cyclictest33-21ksoftirqd/222:55:102
17343993227,3cyclictest33-21ksoftirqd/222:27:452
17343993227,3cyclictest33-21ksoftirqd/219:48:232
17343993227,3cyclictest33-21ksoftirqd/200:22:072
17343993227,3cyclictest33-21ksoftirqd/200:10:092
17343993226,4cyclictest33-21ksoftirqd/222:45:322
17343993226,4cyclictest33-21ksoftirqd/222:07:452
17343993226,4cyclictest33-21ksoftirqd/220:56:002
17343993226,4cyclictest33-21ksoftirqd/220:56:002
17343993226,4cyclictest33-21ksoftirqd/220:53:232
17343993226,4cyclictest33-21ksoftirqd/220:33:542
17343993226,4cyclictest33-21ksoftirqd/220:13:472
17343993225,4cyclictest33-21ksoftirqd/221:23:362
17342993228,3cyclictest25-21ksoftirqd/119:24:421
17342993227,3cyclictest25-21ksoftirqd/120:16:581
17342993227,3cyclictest25-21ksoftirqd/120:09:011
17342993227,3cyclictest25-21ksoftirqd/120:02:421
17342993227,3cyclictest25-21ksoftirqd/119:45:541
17342993227,3cyclictest25-21ksoftirqd/119:40:491
17342993226,4cyclictest25-21ksoftirqd/122:43:271
17342993226,4cyclictest25-21ksoftirqd/122:02:391
17342993226,4cyclictest25-21ksoftirqd/121:51:311
17342993226,4cyclictest25-21ksoftirqd/119:50:211
17341993227,3cyclictest9-21ksoftirqd/023:50:430
17341993226,4cyclictest9-21ksoftirqd/021:27:440
17341993226,4cyclictest9-21ksoftirqd/021:22:140
17343993126,3cyclictest33-21ksoftirqd/222:00:422
17343993126,3cyclictest33-21ksoftirqd/221:46:322
17343993125,4cyclictest33-21ksoftirqd/223:47:352
17343993125,4cyclictest33-21ksoftirqd/223:08:112
17343993125,4cyclictest33-21ksoftirqd/222:21:372
17343993125,4cyclictest33-21ksoftirqd/222:18:402
17342993125,4cyclictest25-21ksoftirqd/100:39:211
17341993126,3cyclictest9-21ksoftirqd/023:24:050
17341993125,4cyclictest9-21ksoftirqd/022:46:510
17341993125,4cyclictest9-21ksoftirqd/022:36:070
17341993125,4cyclictest9-21ksoftirqd/022:22:480
17341993125,4cyclictest9-21ksoftirqd/022:17:180
17341993125,4cyclictest9-21ksoftirqd/019:51:390
17341993125,4cyclictest9-21ksoftirqd/019:34:390
17341993125,4cyclictest9-21ksoftirqd/019:34:390
17341993125,4cyclictest9-21ksoftirqd/019:20:440
17341993125,4cyclictest9-21ksoftirqd/019:19:370
17341993125,4cyclictest9-21ksoftirqd/019:10:030
17343993025,3cyclictest33-21ksoftirqd/221:30:162
17343993025,3cyclictest33-21ksoftirqd/221:04:182
17343993025,3cyclictest33-21ksoftirqd/219:23:372
17343993024,4cyclictest4579-21latency_hist00:20:012
17343993024,4cyclictest33-21ksoftirqd/223:42:132
17343993024,4cyclictest33-21ksoftirqd/219:55:432
17342993026,3cyclictest25-21ksoftirqd/123:00:131
17342993025,3cyclictest25-21ksoftirqd/100:28:421
17342993025,3cyclictest25-21ksoftirqd/100:03:131
17342993024,4cyclictest25-21ksoftirqd/123:41:201
17342993024,4cyclictest25-21ksoftirqd/120:30:111
17342993024,3cyclictest25-21ksoftirqd/123:35:131
17342993024,3cyclictest25-21ksoftirqd/123:27:511
17341993026,3cyclictest9-21ksoftirqd/023:36:430
17341993024,4cyclictest9-21ksoftirqd/022:53:250
17341993024,4cyclictest9-21ksoftirqd/022:01:050
17341993024,4cyclictest9-21ksoftirqd/020:49:200
17341993024,4cyclictest9-21ksoftirqd/019:38:270
17343992923,4cyclictest33-21ksoftirqd/223:04:222
17343992923,4cyclictest33-21ksoftirqd/221:08:562
17342992924,3cyclictest25-21ksoftirqd/122:05:131
17342992924,3cyclictest25-21ksoftirqd/121:35:501
17342992923,3cyclictest25-21ksoftirqd/120:20:201
17341992923,4cyclictest9-21ksoftirqd/023:06:280
17341992923,4cyclictest9-21ksoftirqd/021:32:170
17341992923,4cyclictest9-21ksoftirqd/020:30:180
17341992923,4cyclictest9-21ksoftirqd/019:44:450
17343992823,3cyclictest33-21ksoftirqd/223:14:222
17343992823,3cyclictest33-21ksoftirqd/223:14:222
17343992822,4cyclictest33-21ksoftirqd/200:38:302
17342992823,3cyclictest25-21ksoftirqd/123:30:131
17342992823,3cyclictest25-21ksoftirqd/120:00:001
17342992823,3cyclictest25-21ksoftirqd/119:34:111
17342992823,3cyclictest25-21ksoftirqd/119:34:111
17342992822,4cyclictest25-21ksoftirqd/119:39:481
17342992822,4cyclictest25-21ksoftirqd/100:21:031
17343992722,3cyclictest33-21ksoftirqd/222:34:162
17342992722,3cyclictest25-21ksoftirqd/121:59:451
17341992723,3cyclictest9-21ksoftirqd/023:46:500
17341992722,3cyclictest9-21ksoftirqd/023:42:470
17341992722,3cyclictest9-21ksoftirqd/019:28:450
17341992721,4cyclictest9-21ksoftirqd/020:02:030
17341992720,5cyclictest9-21ksoftirqd/023:16:470
17342992622,3cyclictest25-21ksoftirqd/100:15:231
17342992621,3cyclictest25-21ksoftirqd/123:10:161
17342992621,3cyclictest25-21ksoftirqd/123:10:161
17342992621,3cyclictest25-21ksoftirqd/121:45:161
17342992620,4cyclictest25-21ksoftirqd/122:34:121
17341992621,3cyclictest9-21ksoftirqd/021:55:300
17341992621,3cyclictest9-21ksoftirqd/020:05:030
17341992620,4cyclictest9-21ksoftirqd/022:28:250
17343992520,3cyclictest33-21ksoftirqd/222:36:282
17342992519,3cyclictest25-21ksoftirqd/120:35:141
17341992521,3cyclictest9-21ksoftirqd/021:05:210
17341992520,3cyclictest9-21ksoftirqd/000:00:160
17341992519,4cyclictest9-21ksoftirqd/021:50:020
17341992519,4cyclictest9-21ksoftirqd/021:47:290
1734199234,4cyclictest0-21swapper/021:40:190
17341992317,4cyclictest9-21ksoftirqd/000:07:380
1734399222,18cyclictest10785-21kworker/2:221:26:502
1734199226,6cyclictest9-21ksoftirqd/020:35:220
17341992217,3cyclictest9-21ksoftirqd/020:55:510
17341992217,3cyclictest9-21ksoftirqd/020:55:500
1734199215,5cyclictest9-21ksoftirqd/000:26:460
17341992116,3cyclictest9-21ksoftirqd/023:55:180
17341992015,3cyclictest9-21ksoftirqd/022:05:470
17341992014,4cyclictest9-21ksoftirqd/022:34:310
17343991915,3cyclictest33-21ksoftirqd/223:55:212
1734399160,14cyclictest804-21cat21:55:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional