You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 20:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Thu Nov 20, 2025 12:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
103442212180,21sleep30-21swapper/307:05:413
103442212180,21sleep30-21swapper/307:05:413
85452202169,22sleep20-21swapper/207:05:042
85452202169,22sleep20-21swapper/207:05:042
104192202169,22sleep10-21swapper/107:06:401
104192202169,22sleep10-21swapper/107:06:401
104182201168,22sleep00-21swapper/007:06:400
104182201168,22sleep00-21swapper/007:06:390
1371918363,10phc2sys0-21swapper/307:10:013
132691700,2getstats0-21swapper/309:15:213
1097999641,26cyclictest27309-21awk09:55:280
64992620,2sleep00-21swapper/012:35:210
68272580,37sleep342650irq/143-enp4s0-08:05:263
326692550,3sleep132672-21mailstats11:15:231
136991550,1ptp4l391rcuc/311:55:483
136991550,0ptp4l391rcuc/310:40:583
136182535,6sleep125-21ksoftirqd/111:45:181
136182535,6sleep125-21ksoftirqd/111:45:181
1097999530,17cyclictest3729-21ls08:00:190
136991520,0ptp4l391rcuc/310:12:253
136991520,0ptp4l391rcuc/310:12:253
132691480,1getstats0-21swapper/310:00:223
49062460,1sleep00-21swapper/011:25:220
132691450,1getstats0-21swapper/307:50:223
10979994539,4cyclictest13133-21cron07:15:000
1098299446,7cyclictest28874-21/usr/sbin/munin08:55:253
1098299446,7cyclictest28874-21/usr/sbin/munin08:55:253
1098299432,5cyclictest0-21swapper/312:10:203
136991420,0ptp4l401ktimersoftd/311:52:373
136991420,0ptp4l401ktimersoftd/308:41:183
1098299425,6cyclictest28906-21/usr/sbin/munin11:10:143
136991410,0ptp4l401ktimersoftd/311:45:483
136991410,0ptp4l401ktimersoftd/311:45:473
136991410,0ptp4l401ktimersoftd/307:47:113
1098299405,6cyclictest1285-21snmpd10:08:303
10980993934,3cyclictest25-21ksoftirqd/107:15:011
59298360,2rtkit-daemon0-21swapper/011:06:240
10982993630,4cyclictest41-21ksoftirqd/312:17:463
10982993630,4cyclictest41-21ksoftirqd/312:17:453
10981993630,4cyclictest33-21ksoftirqd/212:19:322
10981993630,4cyclictest33-21ksoftirqd/212:19:322
10981993630,4cyclictest33-21ksoftirqd/211:35:592
10981993630,4cyclictest33-21ksoftirqd/211:17:132
10981993630,4cyclictest33-21ksoftirqd/211:10:072
10981993630,4cyclictest33-21ksoftirqd/209:38:332
10981993629,5cyclictest33-21ksoftirqd/211:46:262
10981993629,5cyclictest33-21ksoftirqd/211:46:262
10981993629,4cyclictest27711-21cron12:15:002
10980993630,4cyclictest25-21ksoftirqd/109:28:331
1098299353,6cyclictest41-21ksoftirqd/308:46:133
10982993528,5cyclictest41-21ksoftirqd/307:31:083
1098299352,4cyclictest41-21ksoftirqd/311:15:353
1098299350,5cyclictest41-21ksoftirqd/307:55:183
10981993529,4cyclictest33-21ksoftirqd/210:06:532
10981993529,4cyclictest33-21ksoftirqd/208:42:162
10981993529,4cyclictest33-21ksoftirqd/208:22:432
10981993529,4cyclictest33-21ksoftirqd/208:16:332
10981993529,4cyclictest33-21ksoftirqd/208:16:332
10980993531,3cyclictest25-21ksoftirqd/109:10:001
10980993530,3cyclictest25-21ksoftirqd/109:01:581
10980993528,5cyclictest25-21ksoftirqd/110:29:541
10979993529,4cyclictest9-21ksoftirqd/011:35:470
59298340,1rtkit-daemon0-21swapper/011:33:110
10982993428,4cyclictest41-21ksoftirqd/309:30:113
1098299342,6cyclictest41-21ksoftirqd/312:36:533
10981993429,3cyclictest33-21ksoftirqd/207:52:102
10981993428,4cyclictest33-21ksoftirqd/212:28:502
10981993428,4cyclictest33-21ksoftirqd/211:23:432
10981993428,4cyclictest33-21ksoftirqd/210:35:572
10981993428,4cyclictest33-21ksoftirqd/209:23:482
10981993428,4cyclictest33-21ksoftirqd/208:32:212
10981993428,4cyclictest33-21ksoftirqd/208:10:352
10981993427,5cyclictest33-21ksoftirqd/211:55:002
10981993427,5cyclictest33-21ksoftirqd/207:32:372
10980993430,3cyclictest25-21ksoftirqd/111:25:001
10980993429,3cyclictest25-21ksoftirqd/109:55:001
10980993428,4cyclictest25-21ksoftirqd/111:44:361
10980993428,4cyclictest25-21ksoftirqd/110:37:211
10980993428,4cyclictest25-21ksoftirqd/109:30:411
10980993428,4cyclictest25-21ksoftirqd/108:49:091
10980993428,4cyclictest25-21ksoftirqd/108:21:501
10980993428,4cyclictest25-21ksoftirqd/107:47:231
10980993427,5cyclictest25-21ksoftirqd/112:02:301
10979993428,4cyclictest9-21ksoftirqd/011:51:130
10979993419,13cyclictest9-21ksoftirqd/009:35:090
1097999341,19cyclictest478-21dbus-daemon10:40:250
10982993328,3cyclictest41-21ksoftirqd/311:08:423
10982993328,3cyclictest41-21ksoftirqd/307:15:143
10982993327,4cyclictest41-21ksoftirqd/312:34:453
10982993327,4cyclictest41-21ksoftirqd/310:55:403
10982993327,4cyclictest41-21ksoftirqd/310:49:063
10982993327,4cyclictest41-21ksoftirqd/309:54:583
10982993327,4cyclictest41-21ksoftirqd/308:22:523
1098299330,6cyclictest41-21ksoftirqd/311:43:253
10981993328,3cyclictest33-21ksoftirqd/212:05:022
10981993328,3cyclictest33-21ksoftirqd/211:43:482
10981993328,3cyclictest33-21ksoftirqd/207:22:352
10981993327,4cyclictest33-21ksoftirqd/210:49:052
10981993327,4cyclictest33-21ksoftirqd/210:41:112
10981993327,4cyclictest33-21ksoftirqd/209:52:172
10981993327,4cyclictest33-21ksoftirqd/209:11:052
10981993327,4cyclictest33-21ksoftirqd/209:02:422
10981993327,4cyclictest33-21ksoftirqd/207:35:092
10981993327,4cyclictest33-21ksoftirqd/207:19:322
1098199330,2cyclictest121rcu_preempt09:25:182
10980993327,4cyclictest25-21ksoftirqd/112:22:581
10980993327,4cyclictest25-21ksoftirqd/112:18:221
10980993327,4cyclictest25-21ksoftirqd/112:18:221
10980993327,4cyclictest25-21ksoftirqd/111:37:381
10980993327,4cyclictest25-21ksoftirqd/111:26:231
10980993327,4cyclictest25-21ksoftirqd/110:57:561
10980993327,4cyclictest25-21ksoftirqd/110:19:241
10980993327,4cyclictest25-21ksoftirqd/108:14:511
10980993327,4cyclictest25-21ksoftirqd/107:57:541
10979993327,4cyclictest9-21ksoftirqd/012:14:230
10979993327,4cyclictest9-21ksoftirqd/011:24:540
10979993327,4cyclictest9-21ksoftirqd/011:16:190
10979993327,4cyclictest9-21ksoftirqd/010:58:060
10979993327,4cyclictest9-21ksoftirqd/010:27:050
10979993327,4cyclictest9-21ksoftirqd/010:09:280
10979993327,4cyclictest9-21ksoftirqd/008:16:190
10979993327,4cyclictest9-21ksoftirqd/008:16:190
10979993326,5cyclictest9-21ksoftirqd/009:33:290
1098299324,8cyclictest41-21ksoftirqd/310:30:183
1098299322,7cyclictest41-21ksoftirqd/311:35:113
10982993227,3cyclictest41-21ksoftirqd/311:35:013
10982993227,3cyclictest41-21ksoftirqd/308:13:073
1098299322,5cyclictest41-21ksoftirqd/310:16:373
1098299322,4cyclictest41-21ksoftirqd/312:05:163
1098299320,5cyclictest41-21ksoftirqd/309:56:073
1098299320,5cyclictest41-21ksoftirqd/309:42:513
1098299320,5cyclictest41-21ksoftirqd/309:06:403
1098299320,5cyclictest41-21ksoftirqd/309:03:193
10981993226,4cyclictest33-21ksoftirqd/211:32:342
10981993226,4cyclictest33-21ksoftirqd/211:02:252
10980993227,3cyclictest25-21ksoftirqd/112:15:001
10980993227,3cyclictest25-21ksoftirqd/111:15:001
10980993227,3cyclictest25-21ksoftirqd/109:45:001
10980993227,3cyclictest25-21ksoftirqd/107:50:251
10980993227,3cyclictest25-21ksoftirqd/107:41:001
10980993227,3cyclictest25-21ksoftirqd/107:25:281
10980993226,4cyclictest25-21ksoftirqd/111:50:571
10980993226,4cyclictest25-21ksoftirqd/111:31:051
10980993226,4cyclictest25-21ksoftirqd/111:05:371
10980993226,4cyclictest25-21ksoftirqd/110:31:471
10980993226,4cyclictest25-21ksoftirqd/109:49:031
10980993226,4cyclictest25-21ksoftirqd/109:20:501
1098099321,2cyclictest121rcu_preempt07:32:421
10979993227,3cyclictest9-21ksoftirqd/009:45:000
10979993226,4cyclictest9-21ksoftirqd/012:23:030
10979993226,4cyclictest9-21ksoftirqd/010:38:380
10979993226,4cyclictest9-21ksoftirqd/010:23:320
10979993226,4cyclictest9-21ksoftirqd/009:29:120
10979993226,4cyclictest9-21ksoftirqd/009:05:410
10979993226,4cyclictest9-21ksoftirqd/009:03:410
10979993226,4cyclictest9-21ksoftirqd/008:48:040
10979993226,4cyclictest9-21ksoftirqd/007:28:050
10979993226,3cyclictest9-21ksoftirqd/009:15:000
1097999320,1cyclictest0-21swapper/008:42:430
10982993126,3cyclictest41-21ksoftirqd/309:47:003
10982993125,4cyclictest41-21ksoftirqd/311:01:343
10982993125,4cyclictest41-21ksoftirqd/309:28:193
10982993125,4cyclictest41-21ksoftirqd/308:27:173
1098299310,5cyclictest41-21ksoftirqd/312:02:163
1098299310,5cyclictest41-21ksoftirqd/310:50:123
10981993126,3cyclictest33-21ksoftirqd/212:22:412
10981993126,3cyclictest33-21ksoftirqd/212:01:562
10981993126,3cyclictest33-21ksoftirqd/211:07:082
10981993125,4cyclictest33-21ksoftirqd/209:47:312
10981993125,4cyclictest33-21ksoftirqd/209:42:062
10981993125,4cyclictest33-21ksoftirqd/209:09:122
10981993125,4cyclictest33-21ksoftirqd/208:35:022
10981993125,4cyclictest33-21ksoftirqd/208:08:392
10981993125,4cyclictest33-21ksoftirqd/207:12:502
10980993126,3cyclictest25-21ksoftirqd/107:40:001
10980993126,3cyclictest25-21ksoftirqd/107:24:461
10980993125,4cyclictest25-21ksoftirqd/112:33:311
10980993125,4cyclictest25-21ksoftirqd/110:48:041
10980993125,4cyclictest25-21ksoftirqd/110:24:451
10980993125,4cyclictest25-21ksoftirqd/108:40:311
10980993124,4cyclictest25-21ksoftirqd/109:15:131
10979993126,3cyclictest9-21ksoftirqd/011:58:310
10979993126,3cyclictest9-21ksoftirqd/008:30:350
10979993126,3cyclictest9-21ksoftirqd/007:16:250
10979993125,4cyclictest9-21ksoftirqd/012:28:560
10979993125,4cyclictest9-21ksoftirqd/011:11:260
10979993125,4cyclictest9-21ksoftirqd/010:49:500
10979993125,4cyclictest9-21ksoftirqd/010:13:130
10979993125,4cyclictest9-21ksoftirqd/010:13:130
10979993125,4cyclictest9-21ksoftirqd/009:49:500
10979993125,4cyclictest9-21ksoftirqd/007:35:040
10979993113,16cyclictest7213-21latency_hist08:10:000
1097999310,1cyclictest0-21swapper/008:36:560
136991300,0ptp4l401ktimersoftd/311:27:283
136991300,0ptp4l401ktimersoftd/309:20:163
136991300,0ptp4l401ktimersoftd/307:42:233
10982993025,3cyclictest41-21ksoftirqd/307:38:353
10982993024,4cyclictest41-21ksoftirqd/308:52:483
1098299301,4cyclictest41-21ksoftirqd/307:26:233
1098299300,5cyclictest41-21ksoftirqd/308:15:383
1098299300,5cyclictest41-21ksoftirqd/308:15:373
10981993025,3cyclictest33-21ksoftirqd/212:31:072
10981993025,3cyclictest33-21ksoftirqd/210:11:462
10981993025,3cyclictest33-21ksoftirqd/210:11:462
10981993025,3cyclictest33-21ksoftirqd/208:48:102
10981993025,3cyclictest33-21ksoftirqd/207:49:352
10981993024,4cyclictest33-21ksoftirqd/212:39:202
10981993024,4cyclictest33-21ksoftirqd/210:26:512
10981993024,4cyclictest33-21ksoftirqd/209:57:542
10981993024,4cyclictest33-21ksoftirqd/208:50:392
10981993024,4cyclictest33-21ksoftirqd/208:00:042
10980993027,2cyclictest25-21ksoftirqd/112:10:001
10980993025,3cyclictest25-21ksoftirqd/108:01:091
10980993024,4cyclictest25-21ksoftirqd/110:50:331
10980993024,4cyclictest25-21ksoftirqd/108:37:101
10979993025,3cyclictest9-21ksoftirqd/007:58:290
10979993024,4cyclictest9-21ksoftirqd/012:09:550
10979993013,15cyclictest30463-21expr07:50:130
10979993013,15cyclictest14843-21expr08:25:110
10979993011,16cyclictest13673-21tr11:45:170
10979993011,16cyclictest13673-21tr11:45:170
10979993010,17cyclictest29428-21switchtime10:00:240
10982992924,3cyclictest41-21ksoftirqd/309:37:253
10982992914,7cyclictest41-21ksoftirqd/308:04:093
1098299290,6cyclictest41-21ksoftirqd/311:23:113
1098299290,4cyclictest41-21ksoftirqd/312:23:013
10981992924,3cyclictest33-21ksoftirqd/210:24:482
10981992924,3cyclictest33-21ksoftirqd/210:00:012
10981992923,4cyclictest33-21ksoftirqd/207:59:282
10981992923,4cyclictest33-21ksoftirqd/207:25:352
10980992924,3cyclictest25-21ksoftirqd/112:39:191
10980992924,3cyclictest25-21ksoftirqd/111:55:091
10980992924,3cyclictest25-21ksoftirqd/111:01:481
10980992924,3cyclictest25-21ksoftirqd/110:14:191
10980992924,3cyclictest25-21ksoftirqd/110:14:191
10980992924,3cyclictest25-21ksoftirqd/110:02:061
10980992924,3cyclictest25-21ksoftirqd/108:17:271
10980992924,3cyclictest25-21ksoftirqd/108:17:271
10980992924,3cyclictest25-21ksoftirqd/108:07:461
10980992923,4cyclictest25-21ksoftirqd/112:29:161
10980992923,4cyclictest25-21ksoftirqd/110:41:341
10980992923,4cyclictest25-21ksoftirqd/110:09:091
10980992923,4cyclictest25-21ksoftirqd/108:55:111
10980992923,4cyclictest25-21ksoftirqd/108:55:111
10980992923,4cyclictest25-21ksoftirqd/108:31:161
10980992923,3cyclictest25-21ksoftirqd/107:17:451
10979992924,3cyclictest9578-21cron08:15:010
10979992924,3cyclictest9-21ksoftirqd/009:16:000
10979992923,4cyclictest9-21ksoftirqd/011:02:590
10979992922,5cyclictest9-21ksoftirqd/012:15:360
10979992922,5cyclictest9-21ksoftirqd/012:15:360
1098299284,6cyclictest41-21ksoftirqd/309:12:583
10982992824,3cyclictest41-21ksoftirqd/312:29:563
1098299280,4cyclictest41-21ksoftirqd/310:38:433
1098299280,4cyclictest41-21ksoftirqd/308:35:353
10981992823,3cyclictest33-21ksoftirqd/210:15:372
10981992822,4cyclictest33-21ksoftirqd/210:57:522
1098199280,2cyclictest121rcu_preempt10:50:152
10980992821,5cyclictest25-21ksoftirqd/109:57:251
10979992823,3cyclictest9-21ksoftirqd/011:40:470
10979992823,3cyclictest9-21ksoftirqd/010:53:320
10979992822,4cyclictest9-21ksoftirqd/010:18:420
10979992822,4cyclictest9-21ksoftirqd/009:51:220
10979992822,4cyclictest9-21ksoftirqd/007:34:070
1097999280,1cyclictest0-21swapper/009:24:070
1098299273,5cyclictest41-21ksoftirqd/310:24:023
10982992722,3cyclictest41-21ksoftirqd/310:26:043
10981992722,3cyclictest33-21ksoftirqd/209:30:222
10981992721,4cyclictest33-21ksoftirqd/211:27:092
10980992722,3cyclictest25-21ksoftirqd/109:36:271
10981992621,3cyclictest33-21ksoftirqd/211:58:312
10981992621,3cyclictest33-21ksoftirqd/208:59:192
10981992621,3cyclictest33-21ksoftirqd/208:59:192
10981992621,3cyclictest33-21ksoftirqd/207:41:102
10981992615,10cyclictest15638-21kworker/2:008:25:372
10980992621,3cyclictest25-21ksoftirqd/108:25:151
1097999267,16cyclictest22635-21seq12:00:480
10979992621,3cyclictest9-21ksoftirqd/010:31:340
10979992621,3cyclictest9-21ksoftirqd/008:59:150
10979992621,3cyclictest9-21ksoftirqd/008:59:150
10979992621,3cyclictest9-21ksoftirqd/008:20:360
10979992621,3cyclictest9-21ksoftirqd/007:40:120
10979992620,4cyclictest9-21ksoftirqd/007:50:000
1097999260,23cyclictest4668-21grep12:30:270
1097999260,23cyclictest27935-21/usr/sbin/munin08:50:250
1098299252,5cyclictest41-21ksoftirqd/307:24:233
10982992519,4cyclictest41-21ksoftirqd/308:32:503
10981992519,4cyclictest33-21ksoftirqd/210:32:492
1097999251,21cyclictest15976-21/usr/sbin/munin07:20:130
10980992317,4cyclictest25-21ksoftirqd/108:52:111
1098199213,16cyclictest8459-21latency_hist09:20:012
10980992016,3cyclictest25-21ksoftirqd/109:10:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional