You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 23:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Mon Nov 17, 2025 12:45:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131552207170,25sleep30-21swapper/307:09:163
129092205172,22sleep00-21swapper/007:06:020
131542204171,22sleep20-21swapper/207:09:142
129102203170,22sleep10-21swapper/107:06:031
614121740,3sleep31351999cyclictest11:24:593
2228221330,4sleep11351799cyclictest10:50:161
1371918363,11phc2sys0-21swapper/307:10:023
136991650,2ptp4l401ktimersoftd/309:50:263
13517996110,17cyclictest13563-21date11:40:011
13517996010,11cyclictest23201-21sed09:45:011
13518995821,4cyclictest33-21ksoftirqd/209:45:152
13518995728,4cyclictest33-21ksoftirqd/211:15:302
13518995727,6cyclictest33-21ksoftirqd/208:20:022
13518995718,6cyclictest33-21ksoftirqd/210:15:272
1351799566,48cyclictest18172-21kworker/1:212:15:471
1351799564,17cyclictest0-21swapper/110:35:001
13517995611,10cyclictest15140-21sed07:10:281
136991550,1ptp4l401ktimersoftd/308:53:133
13518995529,7cyclictest33-21ksoftirqd/207:50:002
13518995525,6cyclictest33-21ksoftirqd/207:45:012
13518995525,4cyclictest33-21ksoftirqd/210:30:222
1351799559,11cyclictest18926-21cat07:20:181
13517995510,18cyclictest31164-21idleruntime-cro11:10:001
13518995429,7cyclictest33-21ksoftirqd/211:00:182
13518995426,8cyclictest33-21ksoftirqd/212:05:002
13518995426,4cyclictest33-21ksoftirqd/209:15:152
13518995424,6cyclictest33-21ksoftirqd/208:05:242
13518995418,6cyclictest33-21ksoftirqd/209:05:242
13518995417,5cyclictest33-21ksoftirqd/210:45:192
13518995416,7cyclictest33-21ksoftirqd/211:10:182
13518995416,6cyclictest33-21ksoftirqd/208:25:252
13518995415,6cyclictest33-21ksoftirqd/210:55:252
13518995326,8cyclictest33-21ksoftirqd/207:35:182
1351899532,2cyclictest121rcu_preempt11:10:002
13518995322,7cyclictest33-21ksoftirqd/209:45:002
13518995322,4cyclictest33-21ksoftirqd/209:10:282
13518995228,7cyclictest33-21ksoftirqd/210:05:002
13518995225,4cyclictest33-21ksoftirqd/210:50:232
13518995224,3cyclictest33-21ksoftirqd/210:10:272
13518995221,4cyclictest33-21ksoftirqd/208:35:182
13518995220,8cyclictest33-21ksoftirqd/210:25:172
13518995219,4cyclictest33-21ksoftirqd/209:20:292
1351799529,17cyclictest0-21swapper/109:05:261
1351799527,9cyclictest0-21swapper/108:35:241
13518995126,7cyclictest33-21ksoftirqd/211:55:002
13518995126,4cyclictest33-21ksoftirqd/212:15:202
13518995125,7cyclictest33-21ksoftirqd/209:30:272
13518995124,4cyclictest33-21ksoftirqd/211:20:222
13518995123,4cyclictest33-21ksoftirqd/207:55:192
13518995120,4cyclictest33-21ksoftirqd/209:50:222
13518995117,4cyclictest33-21ksoftirqd/208:40:182
13518995117,4cyclictest33-21ksoftirqd/207:20:262
13518995116,6cyclictest33-21ksoftirqd/210:45:012
13518995114,6cyclictest33-21ksoftirqd/208:45:172
13518995113,5cyclictest33-21ksoftirqd/209:05:002
13518995023,7cyclictest33-21ksoftirqd/211:55:262
13518995023,4cyclictest33-21ksoftirqd/212:30:202
13518995021,4cyclictest33-21ksoftirqd/207:30:202
13518995021,3cyclictest33-21ksoftirqd/207:10:202
13518995020,4cyclictest33-21ksoftirqd/207:15:492
13518995019,6cyclictest33-21ksoftirqd/209:35:212
13518995018,6cyclictest33-21ksoftirqd/212:35:292
13518995017,4cyclictest33-21ksoftirqd/207:25:272
13518995013,5cyclictest33-21ksoftirqd/212:25:002
13518994926,8cyclictest33-21ksoftirqd/211:45:202
13518994926,7cyclictest33-21ksoftirqd/210:20:182
13518994925,6cyclictest33-21ksoftirqd/208:20:272
13518994924,4cyclictest33-21ksoftirqd/211:25:172
13518994921,4cyclictest33-21ksoftirqd/211:30:162
13518994919,3cyclictest33-21ksoftirqd/209:25:232
13518994916,5cyclictest33-21ksoftirqd/208:10:282
13518994914,7cyclictest33-21ksoftirqd/211:40:142
13518994914,5cyclictest33-21ksoftirqd/212:20:152
13518994823,7cyclictest33-21ksoftirqd/208:55:192
13518994819,11cyclictest33-21ksoftirqd/210:35:202
1351899481,3cyclictest31129-21apt-get08:55:012
13518994723,7cyclictest33-21ksoftirqd/211:35:282
13518994719,7cyclictest33-21ksoftirqd/212:10:212
13518994719,7cyclictest33-21ksoftirqd/208:30:262
13518994614,5cyclictest33-21ksoftirqd/209:55:212
1351799469,7cyclictest21022-21ls10:45:261
1351799469,14cyclictest28542-21perl09:55:191
13517994639,4cyclictest9741-21wc08:10:001
98842450,2sleep30-21swapper/309:15:223
13518994521,4cyclictest33-21ksoftirqd/212:10:012
13518994434,3cyclictest33-21ksoftirqd/207:50:172
136991430,0ptp4l401ktimersoftd/311:57:343
13518994337,3cyclictest33-21ksoftirqd/210:10:002
13518994229,11cyclictest33-21ksoftirqd/208:05:002
13517994210,8cyclictest27317-21iostat_ios11:00:211
1351699421,38cyclictest18102-21cron11:50:010
13519994135,4cyclictest41-21ksoftirqd/307:25:003
137191403,2phc2sys121rcu_preempt07:30:003
13517993811,16cyclictest654-21gdbus07:50:261
13519993732,3cyclictest41-21ksoftirqd/311:05:003
1351799379,16cyclictest19872-21sendmail_mailqu09:35:261
13516993732,3cyclictest9-21ksoftirqd/012:00:000
13519993631,3cyclictest41-21ksoftirqd/307:19:593
13519993531,3cyclictest41-21ksoftirqd/310:40:003
13519993529,4cyclictest41-21ksoftirqd/312:26:143
13519993529,4cyclictest41-21ksoftirqd/309:30:393
13519993529,4cyclictest41-21ksoftirqd/308:24:403
13519993528,5cyclictest41-21ksoftirqd/309:28:023
1351999351,3cyclictest121rcu_preempt10:25:503
1351799358,17cyclictest0-21swapper/108:40:161
1351799358,16cyclictest0-21swapper/109:20:231
1351799356,9cyclictest0-21swapper/108:00:281
13517993530,3cyclictest25-21ksoftirqd/112:40:011
13517993530,3cyclictest25-21ksoftirqd/111:50:221
13517993529,3cyclictest25-21ksoftirqd/109:30:121
1351799350,9cyclictest31459-21meminfo10:00:241
1351799350,8cyclictest30778-21df_inode07:45:171
13516993529,4cyclictest30219-21latency_hist12:15:010
136991340,1ptp4l391rcuc/307:58:163
13519993429,3cyclictest41-21ksoftirqd/311:07:163
13519993428,4cyclictest41-21ksoftirqd/312:07:443
13519993428,4cyclictest41-21ksoftirqd/310:33:133
13519993428,4cyclictest41-21ksoftirqd/310:03:413
13519993428,4cyclictest41-21ksoftirqd/309:41:463
13519993426,4cyclictest41-21ksoftirqd/309:10:143
13517993429,3cyclictest25-21ksoftirqd/112:01:141
13517993428,4cyclictest25-21ksoftirqd/108:33:491
13517993428,4cyclictest25-21ksoftirqd/107:27:211
13516993428,4cyclictest9-21ksoftirqd/012:06:090
13516993428,4cyclictest9-21ksoftirqd/009:21:170
13516993428,4cyclictest9-21ksoftirqd/008:56:510
13519993327,4cyclictest41-21ksoftirqd/311:19:423
13519993327,4cyclictest41-21ksoftirqd/310:54:033
13519993327,4cyclictest41-21ksoftirqd/310:23:583
13519993327,4cyclictest41-21ksoftirqd/310:17:123
13519993327,4cyclictest41-21ksoftirqd/309:09:173
13519993327,4cyclictest41-21ksoftirqd/307:53:243
13519993326,4cyclictest41-21ksoftirqd/312:11:103
13517993327,4cyclictest25-21ksoftirqd/110:14:061
13517993327,4cyclictest25-21ksoftirqd/107:17:431
13517993310,7cyclictest9494-21iostat_ios11:30:201
13516993328,3cyclictest9-21ksoftirqd/011:14:420
13516993327,4cyclictest9-21ksoftirqd/010:37:550
13516993327,4cyclictest9-21ksoftirqd/009:31:320
13516993327,4cyclictest9-21ksoftirqd/009:13:070
13516993327,4cyclictest9-21ksoftirqd/008:40:410
13516993327,4cyclictest9-21ksoftirqd/008:26:330
13516993327,4cyclictest9-21ksoftirqd/007:52:470
13516993326,5cyclictest9-21ksoftirqd/010:32:380
136991320,0ptp4l401ktimersoftd/308:45:183
13519993227,3cyclictest41-21ksoftirqd/312:04:593
13519993227,3cyclictest41-21ksoftirqd/309:00:143
13519993227,3cyclictest41-21ksoftirqd/308:05:183
13519993226,4cyclictest41-21ksoftirqd/312:31:523
13519993226,4cyclictest41-21ksoftirqd/311:49:473
13519993226,4cyclictest41-21ksoftirqd/308:44:373
13519993225,4cyclictest41-21ksoftirqd/311:54:593
1351799327,23cyclictest0-21swapper/111:25:151
1351799326,10cyclictest0-21swapper/109:00:211
13517993226,4cyclictest25-21ksoftirqd/111:56:221
13517993226,4cyclictest25-21ksoftirqd/110:39:531
13517993214,14cyclictest29743-21grep07:40:301
13516993227,3cyclictest9-21ksoftirqd/012:32:120
13516993227,3cyclictest9-21ksoftirqd/008:53:340
13516993227,3cyclictest9-21ksoftirqd/007:15:370
13516993226,4cyclictest9-21ksoftirqd/012:20:570
13516993226,4cyclictest9-21ksoftirqd/011:52:370
13516993226,4cyclictest9-21ksoftirqd/011:34:200
13516993226,4cyclictest9-21ksoftirqd/011:06:510
13516993226,4cyclictest9-21ksoftirqd/011:01:460
13516993226,4cyclictest9-21ksoftirqd/010:51:480
13516993226,4cyclictest9-21ksoftirqd/010:13:040
13516993226,4cyclictest9-21ksoftirqd/009:57:560
13516993226,4cyclictest9-21ksoftirqd/009:44:360
13516993226,4cyclictest9-21ksoftirqd/007:12:200
13519993126,3cyclictest41-21ksoftirqd/310:57:273
13519993126,3cyclictest41-21ksoftirqd/308:36:123
13519993125,4cyclictest41-21ksoftirqd/311:42:403
13519993125,4cyclictest41-21ksoftirqd/310:07:143
13519993125,4cyclictest41-21ksoftirqd/308:33:033
1351799319,8cyclictest15772-21ls08:20:231
1351799316,18cyclictest0-21swapper/111:49:351
1351799315,8cyclictest0-21swapper/109:50:191
13517993125,4cyclictest25-21ksoftirqd/110:41:051
13517993125,4cyclictest25-21ksoftirqd/109:10:591
13517993125,4cyclictest25-21ksoftirqd/108:56:591
13517993125,4cyclictest25-21ksoftirqd/108:14:191
13517993124,5cyclictest25-21ksoftirqd/107:58:511
13517993110,7cyclictest26920-21ls07:35:271
13516993126,3cyclictest9-21ksoftirqd/011:27:010
13516993126,3cyclictest9-21ksoftirqd/010:56:490
13516993125,4cyclictest9-21ksoftirqd/010:48:350
13516993125,4cyclictest9-21ksoftirqd/009:50:540
13516993125,4cyclictest9-21ksoftirqd/008:34:400
13516993125,4cyclictest9-21ksoftirqd/008:21:000
13516993125,4cyclictest9-21ksoftirqd/008:08:240
13516993125,4cyclictest9-21ksoftirqd/008:01:180
13516993125,4cyclictest9-21ksoftirqd/007:34:550
13516993124,5cyclictest9-21ksoftirqd/012:39:150
13516993123,5cyclictest9-21ksoftirqd/009:46:370
136991300,0ptp4l401ktimersoftd/312:37:403
136991300,0ptp4l401ktimersoftd/307:45:143
13519993025,3cyclictest41-21ksoftirqd/312:21:293
13519993025,3cyclictest41-21ksoftirqd/309:59:143
13519993025,3cyclictest41-21ksoftirqd/307:42:433
13519993025,3cyclictest41-21ksoftirqd/307:31:273
13519993024,4cyclictest41-21ksoftirqd/311:37:203
13519993024,4cyclictest41-21ksoftirqd/311:31:063
13519993024,4cyclictest41-21ksoftirqd/310:42:283
13519993024,4cyclictest41-21ksoftirqd/309:49:323
13519993024,4cyclictest41-21ksoftirqd/308:57:573
13519993024,4cyclictest41-21ksoftirqd/308:19:423
1351799307,9cyclictest0-21swapper/108:28:341
1351799305,9cyclictest0-21swapper/110:25:231
13517993024,4cyclictest25-21ksoftirqd/112:06:051
13517993024,4cyclictest25-21ksoftirqd/110:58:301
13516993025,3cyclictest9-21ksoftirqd/011:43:470
13516993025,3cyclictest9-21ksoftirqd/009:27:040
13516993024,4cyclictest9-21ksoftirqd/009:16:320
13516993024,4cyclictest9-21ksoftirqd/007:55:580
136991290,0ptp4l401ktimersoftd/312:15:263
136991290,0ptp4l401ktimersoftd/309:21:243
13519992923,4cyclictest41-21ksoftirqd/308:25:453
1351799296,15cyclictest0-21swapper/110:20:231
13517992924,3cyclictest25-21ksoftirqd/112:14:451
13517992924,3cyclictest25-21ksoftirqd/108:19:001
13517992923,4cyclictest25-21ksoftirqd/108:51:461
13517992923,4cyclictest25-21ksoftirqd/107:34:471
13517992910,6cyclictest24792-21ssh09:45:271
13516992924,3cyclictest9-21ksoftirqd/011:21:320
13516992924,3cyclictest9-21ksoftirqd/010:28:090
13516992923,4cyclictest9-21ksoftirqd/011:18:270
13516992923,4cyclictest9-21ksoftirqd/010:01:490
13516992923,4cyclictest9-21ksoftirqd/009:38:580
13516992923,4cyclictest9-21ksoftirqd/008:35:560
13516992923,4cyclictest9-21ksoftirqd/007:26:240
13516992922,4cyclictest9-21ksoftirqd/010:21:110
13519992822,4cyclictest41-21ksoftirqd/311:25:553
13517992823,3cyclictest25-21ksoftirqd/110:10:001
13517992822,4cyclictest25-21ksoftirqd/111:41:511
13517992822,4cyclictest25-21ksoftirqd/111:23:131
13517992822,4cyclictest25-21ksoftirqd/111:13:311
13516992823,3cyclictest9-21ksoftirqd/012:00:560
13516992823,3cyclictest9-21ksoftirqd/010:20:010
13516992823,3cyclictest9-21ksoftirqd/007:43:580
136991270,0ptp4l401ktimersoftd/308:11:313
13519992723,2cyclictest391rcuc/309:35:203
13519992722,3cyclictest41-21ksoftirqd/311:13:503
13519992722,3cyclictest41-21ksoftirqd/307:37:493
13519992721,4cyclictest41-21ksoftirqd/310:12:113
13517992722,3cyclictest25-21ksoftirqd/108:47:071
13517992712,12cyclictest9253-21cut09:15:171
13516992722,3cyclictest9-21ksoftirqd/012:15:360
13516992721,4cyclictest9-21ksoftirqd/012:27:340
13516992721,4cyclictest9-21ksoftirqd/010:06:460
13519992622,3cyclictest41-21ksoftirqd/308:00:223
13519992620,4cyclictest41-21ksoftirqd/310:47:213
13517992621,3cyclictest25-21ksoftirqd/110:15:151
13517992612,12cyclictest4110-21meminfo12:25:221
13517992612,12cyclictest2538-21/usr/sbin/munin11:15:241
13516992621,3cyclictest9-21ksoftirqd/008:14:300
13516992620,4cyclictest9-21ksoftirqd/010:42:170
13516992620,4cyclictest9-21ksoftirqd/009:02:440
13516992620,4cyclictest9-21ksoftirqd/007:38:560
13516992620,4cyclictest9-21ksoftirqd/007:21:500
13517992515,7cyclictest898-21grep12:20:191
13517992515,7cyclictest15948-21sed09:30:001
13517992514,8cyclictest5626-21grep12:30:161
13516992520,3cyclictest9-21ksoftirqd/007:47:460
13516992519,4cyclictest9-21ksoftirqd/009:07:330
13516992419,3cyclictest9-21ksoftirqd/008:19:550
13516992218,3cyclictest9-21ksoftirqd/008:50:010
13516992217,3cyclictest9-21ksoftirqd/011:38:530
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional