You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-28 - 10:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Tue Oct 28, 2025 00:45:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6182203170,22sleep20-21swapper/219:07:242
7592202168,22sleep30-21swapper/319:08:583
5012202169,22sleep10-21swapper/119:06:021
5992196162,23sleep00-21swapper/019:07:100
879721330,5sleep0113299cyclictest20:30:220
1371918464,11phc2sys0-21swapper/319:10:013
1132996011,19cyclictest24758-21seq19:56:520
113399597,15cyclictest478-21dbus-daemon19:45:251
113399595,16cyclictest25817-21grep21:05:251
157682570,2sleep30-21swapper/319:40:143
136991540,0ptp4l401ktimersoftd/300:39:443
113399534,16cyclictest30448-21systemctl21:15:251
113399517,10cyclictest479-21in:imuxsock22:35:441
113299510,4cyclictest12071-21taskset20:39:230
59298500,2rtkit-daemon0-21swapper/322:22:063
59298490,2rtkit-daemon0-21swapper/222:15:052
113399494,11cyclictest30010-21sshd20:07:351
113399493,10cyclictest3341-21sshd23:40:251
59298480,2rtkit-daemon0-21swapper/320:27:263
59298480,2rtkit-daemon0-21swapper/300:32:453
59298480,2rtkit-daemon0-21swapper/223:59:452
59298480,2rtkit-daemon0-21swapper/222:42:152
59298480,2rtkit-daemon0-21swapper/222:21:052
59298480,2rtkit-daemon0-21swapper/222:02:062
59298480,2rtkit-daemon0-21swapper/221:14:062
59298470,2rtkit-daemon0-21swapper/321:32:063
59298470,2rtkit-daemon0-21swapper/223:30:452
59298470,2rtkit-daemon0-21swapper/221:38:062
59298470,2rtkit-daemon0-21swapper/221:30:462
113499477,38cyclictest33-21ksoftirqd/219:15:272
113399471,44cyclictest23722-21kworker/1:119:18:271
59298450,2rtkit-daemon0-21swapper/300:14:253
59298450,2rtkit-daemon0-21swapper/221:40:062
59298450,2rtkit-daemon0-21swapper/221:15:462
113399453,7cyclictest12421-21python21:45:271
113299459,24cyclictest1297-21runrttasks20:20:350
84124433,6sleep20-21swapper/219:10:002
59298440,33rtkit-daemon25792-21cat21:05:262
59298440,2rtkit-daemon0-21swapper/321:38:253
113299440,4cyclictest26849-21taskset23:24:100
59298430,8rtkit-daemon0-21swapper/222:35:062
59298430,2rtkit-daemon0-21swapper/321:18:063
136991430,1ptp4l401ktimersoftd/322:25:493
136991430,0ptp4l401ktimersoftd/319:30:233
132891430,2getstats0-21swapper/320:40:423
59298420,8rtkit-daemon0-21swapper/323:30:263
59298420,2rtkit-daemon0-21swapper/320:23:153
59298420,2rtkit-daemon0-21swapper/320:16:463
59298420,2rtkit-daemon0-21swapper/319:52:153
59298410,2rtkit-daemon0-21swapper/321:59:163
59298410,2rtkit-daemon0-21swapper/321:41:053
136991410,0ptp4l401ktimersoftd/322:10:403
1134994131,6cyclictest33-21ksoftirqd/222:50:042
59298400,9rtkit-daemon0-21swapper/221:47:252
59298400,2rtkit-daemon0-21swapper/319:47:363
1134994035,3cyclictest33-21ksoftirqd/200:19:592
113399405,11cyclictest27020-21df_abs21:10:151
113399403,7cyclictest600-21df_inode22:30:141
1135993933,3cyclictest19792-21dump-pmu-power23:10:013
1134993934,3cyclictest33-21ksoftirqd/221:24:592
1134993928,10cyclictest33-21ksoftirqd/200:35:272
113299392,22cyclictest25503-21apt-get20:00:150
136991380,0ptp4l401ktimersoftd/320:30:093
1134993826,10cyclictest33-21ksoftirqd/219:50:222
1134993726,9cyclictest33-21ksoftirqd/220:25:272
1133993711,15cyclictest25-21ksoftirqd/123:10:011
113299371,19cyclictest0-21swapper/022:36:390
136991360,1ptp4l401ktimersoftd/319:29:243
1135993630,4cyclictest41-21ksoftirqd/300:28:513
1135993629,5cyclictest41-21ksoftirqd/323:12:133
1134993630,4cyclictest33-21ksoftirqd/223:46:532
1134993630,4cyclictest33-21ksoftirqd/200:30:392
113299361,20cyclictest0-21swapper/021:56:450
113299360,3cyclictest8118-21seq19:24:550
136991350,0ptp4l401ktimersoftd/323:46:453
1135993529,4cyclictest41-21ksoftirqd/323:39:493
1135993529,4cyclictest41-21ksoftirqd/322:47:053
1135993529,4cyclictest41-21ksoftirqd/321:14:413
1135993529,4cyclictest41-21ksoftirqd/300:00:103
1134993532,2cyclictest33-21ksoftirqd/222:35:012
1134993530,3cyclictest33-21ksoftirqd/223:50:562
1134993530,3cyclictest33-21ksoftirqd/223:40:192
1134993530,3cyclictest33-21ksoftirqd/223:00:242
1134993530,3cyclictest33-21ksoftirqd/219:35:002
1134993530,3cyclictest33-21ksoftirqd/219:25:002
1134993529,4cyclictest33-21ksoftirqd/223:08:062
1134993529,4cyclictest33-21ksoftirqd/219:42:142
1134993529,4cyclictest33-21ksoftirqd/200:22:522
1134993528,4cyclictest33-21ksoftirqd/200:15:002
1133993529,4cyclictest25-21ksoftirqd/122:13:011
1133993529,4cyclictest25-21ksoftirqd/120:46:271
1132993530,3cyclictest30222-21grep20:10:000
1132993528,5cyclictest9-21ksoftirqd/022:45:050
1132993528,5cyclictest9-21ksoftirqd/022:28:440
113299352,20cyclictest2394-21taskset22:34:260
113299350,3cyclictest16781-21seq23:00:340
1135993428,4cyclictest41-21ksoftirqd/323:59:043
1135993428,4cyclictest41-21ksoftirqd/322:01:593
1135993428,4cyclictest41-21ksoftirqd/321:47:403
1135993428,4cyclictest41-21ksoftirqd/320:09:513
1135993428,4cyclictest41-21ksoftirqd/300:05:323
1135993427,5cyclictest41-21ksoftirqd/323:43:263
1135993427,5cyclictest41-21ksoftirqd/321:52:573
1134993429,3cyclictest33-21ksoftirqd/222:15:002
1134993429,3cyclictest33-21ksoftirqd/220:50:002
1134993429,3cyclictest33-21ksoftirqd/200:28:452
1134993428,4cyclictest33-21ksoftirqd/222:48:122
1134993428,4cyclictest33-21ksoftirqd/222:08:492
1134993428,4cyclictest33-21ksoftirqd/200:09:012
1134993428,3cyclictest33-21ksoftirqd/223:00:012
1133993428,4cyclictest25-21ksoftirqd/123:38:111
1133993428,4cyclictest25-21ksoftirqd/100:01:531
1132993428,4cyclictest9-21ksoftirqd/023:11:130
1132993428,4cyclictest9-21ksoftirqd/019:52:270
1132993428,4cyclictest9-21ksoftirqd/000:27:190
113299341,30cyclictest12568-21needreboot00:00:230
113299340,3cyclictest14601-21seq22:58:140
59298330,2rtkit-daemon0-21swapper/223:29:452
1135993328,3cyclictest41-21ksoftirqd/323:50:383
1135993328,3cyclictest41-21ksoftirqd/322:35:123
1135993327,4cyclictest41-21ksoftirqd/323:23:363
1135993327,4cyclictest41-21ksoftirqd/323:04:053
1135993327,4cyclictest41-21ksoftirqd/321:28:343
1135993327,4cyclictest41-21ksoftirqd/320:54:483
1135993326,5cyclictest41-21ksoftirqd/321:00:503
1134993329,3cyclictest33-21ksoftirqd/219:25:172
1134993328,3cyclictest33-21ksoftirqd/223:20:142
1134993328,3cyclictest33-21ksoftirqd/222:25:222
1134993328,3cyclictest33-21ksoftirqd/221:29:592
1134993328,3cyclictest33-21ksoftirqd/220:40:152
1134993328,3cyclictest33-21ksoftirqd/220:30:182
1134993328,3cyclictest33-21ksoftirqd/220:24:222
1134993328,3cyclictest33-21ksoftirqd/219:45:142
1134993327,4cyclictest33-21ksoftirqd/221:59:342
1134993327,3cyclictest33-21ksoftirqd/220:05:012
1134993327,3cyclictest33-21ksoftirqd/220:00:002
1133993328,3cyclictest25-21ksoftirqd/121:52:371
1133993327,4cyclictest25-21ksoftirqd/123:28:281
1133993327,4cyclictest25-21ksoftirqd/123:18:131
1133993327,4cyclictest25-21ksoftirqd/121:59:211
1133993327,4cyclictest25-21ksoftirqd/120:36:291
1133993326,4cyclictest25-21ksoftirqd/119:25:481
1132993328,3cyclictest9-21ksoftirqd/021:20:110
1132993327,4cyclictest9-21ksoftirqd/023:07:190
1132993327,4cyclictest9-21ksoftirqd/022:40:560
1132993327,4cyclictest9-21ksoftirqd/021:04:590
1132993327,4cyclictest9-21ksoftirqd/020:45:310
1132993327,4cyclictest9-21ksoftirqd/019:17:160
113299330,3cyclictest6189-21chrt23:46:470
1135993226,4cyclictest41-21ksoftirqd/322:55:453
1135993226,4cyclictest41-21ksoftirqd/320:01:533
1135993226,4cyclictest41-21ksoftirqd/319:37:333
1134993228,3cyclictest33-21ksoftirqd/223:15:222
1134993227,3cyclictest33-21ksoftirqd/221:00:212
1134993227,3cyclictest33-21ksoftirqd/200:00:142
1134993226,4cyclictest33-21ksoftirqd/220:36:342
1134993226,4cyclictest33-21ksoftirqd/220:10:062
1134993218,12cyclictest33-21ksoftirqd/221:50:432
113399324,17cyclictest6689-21/usr/sbin/munin23:50:231
113399323,7cyclictest9059-21/usr/sbin/munin23:55:211
1133993227,3cyclictest25-21ksoftirqd/119:14:131
1133993226,4cyclictest25-21ksoftirqd/123:47:331
1133993226,4cyclictest25-21ksoftirqd/120:58:151
1132993227,3cyclictest9-21ksoftirqd/019:33:260
1132993226,4cyclictest9-21ksoftirqd/022:16:490
1132993226,4cyclictest9-21ksoftirqd/022:01:130
1132993226,4cyclictest9-21ksoftirqd/020:43:340
1132993226,4cyclictest9-21ksoftirqd/020:17:540
1132993226,4cyclictest9-21ksoftirqd/020:11:440
1132993226,4cyclictest9-21ksoftirqd/000:38:470
1132993226,4cyclictest9-21ksoftirqd/000:12:440
113299322,27cyclictest29296-21cron23:30:000
113299320,3cyclictest9286-21/usr/sbin/munin21:40:200
136991310,0ptp4l401ktimersoftd/322:30:003
136991310,0ptp4l401ktimersoftd/320:10:533
1135993126,3cyclictest41-21ksoftirqd/322:53:513
1135993126,3cyclictest41-21ksoftirqd/320:45:543
1135993126,3cyclictest41-21ksoftirqd/319:24:463
1135993125,4cyclictest41-21ksoftirqd/319:56:273
1135993125,4cyclictest41-21ksoftirqd/300:17:483
1134993128,2cyclictest33-21ksoftirqd/220:55:172
1134993125,4cyclictest33-21ksoftirqd/219:37:562
1134993120,9cyclictest33-21ksoftirqd/223:35:162
113399314,11cyclictest16529-21awk23:00:291
113399313,17cyclictest10752-21apt-get19:30:141
1133993125,4cyclictest25-21ksoftirqd/122:03:581
1133993125,4cyclictest25-21ksoftirqd/121:45:001
1133993125,4cyclictest25-21ksoftirqd/120:32:531
1133993125,4cyclictest25-21ksoftirqd/120:21:441
1133993125,4cyclictest25-21ksoftirqd/120:10:491
1133993125,4cyclictest25-21ksoftirqd/100:32:421
1133993125,4cyclictest25-21ksoftirqd/100:25:401
1133993125,4cyclictest25-21ksoftirqd/100:18:061
1133993125,4cyclictest25-21ksoftirqd/100:09:351
1132993126,3cyclictest9-21ksoftirqd/022:50:430
1132993126,3cyclictest9-21ksoftirqd/020:52:200
1132993125,4cyclictest9-21ksoftirqd/023:52:090
1132993125,4cyclictest9-21ksoftirqd/021:05:360
1132993125,4cyclictest9-21ksoftirqd/019:10:430
1132993114,14cyclictest5758-21perl20:25:170
1132993111,17cyclictest30608-21cat23:30:220
136991300,0ptp4l401ktimersoftd/323:25:413
1135993024,4cyclictest41-21ksoftirqd/320:36:433
1134993024,4cyclictest33-21ksoftirqd/220:54:192
113399303,10cyclictest9803-21latency_hist22:50:001
1133993025,3cyclictest25-21ksoftirqd/120:40:141
1133993025,3cyclictest25-21ksoftirqd/119:21:261
1133993024,4cyclictest25-21ksoftirqd/122:29:181
1133993024,4cyclictest25-21ksoftirqd/121:34:251
1133993024,4cyclictest25-21ksoftirqd/121:24:071
1133993023,5cyclictest25-21ksoftirqd/122:23:371
1132993025,3cyclictest9-21ksoftirqd/023:15:150
1132993024,4cyclictest9-21ksoftirqd/020:57:010
1132993024,4cyclictest9-21ksoftirqd/000:31:210
1132993011,16cyclictest10679-21latency_hist19:30:000
113299300,4cyclictest13534-21expr21:50:150
113299300,3cyclictest27351-21ps21:10:200
136991290,0ptp4l401ktimersoftd/322:16:223
136991290,0ptp4l401ktimersoftd/319:16:273
113399293,7cyclictest27142-21ls20:00:291
113399293,16cyclictest10242-21/usr/sbin/munin22:50:231
1133992924,3cyclictest25-21ksoftirqd/100:20:341
1133992923,4cyclictest25-21ksoftirqd/122:17:031
113299296,21cyclictest12471-21ls21:45:270
1132992924,3cyclictest9-21ksoftirqd/000:19:290
1132992924,3cyclictest9-21ksoftirqd/000:09:310
1132992923,4cyclictest9-21ksoftirqd/000:21:330
113299292,21cyclictest27914-21apt-get22:20:140
1132992910,16cyclictest6189-21sed21:35:010
113299290,2cyclictest0-21swapper/022:10:240
136991280,0ptp4l401ktimersoftd/322:08:463
1135992823,3cyclictest41-21ksoftirqd/322:43:073
1135992823,3cyclictest41-21ksoftirqd/321:05:543
1134992823,3cyclictest33-21ksoftirqd/223:12:092
1134992817,9cyclictest33-21ksoftirqd/220:15:282
1134992817,9cyclictest33-21ksoftirqd/220:05:192
113399284,8cyclictest368-21apt-get20:15:141
113399284,8cyclictest2870-21mailstats21:25:241
1133992822,4cyclictest25-21ksoftirqd/121:37:501
1133992822,4cyclictest25-21ksoftirqd/121:04:331
1132992822,4cyclictest9-21ksoftirqd/023:45:000
113299282,20cyclictest29063-21apt-get21:15:120
113299282,20cyclictest13124-21apt-get19:35:130
113299280,3cyclictest6617-21df_inode21:35:160
113299280,3cyclictest18598-21irqrtprio19:45:200
1135992722,3cyclictest41-21ksoftirqd/323:16:583
1135992721,4cyclictest41-21ksoftirqd/300:22:053
113399274,7cyclictest16787-21df_inode00:10:151
1133992722,4cyclictest25-21ksoftirqd/122:10:001
1133992721,4cyclictest25-21ksoftirqd/123:33:491
1133992721,4cyclictest25-21ksoftirqd/122:57:541
113299275,19cyclictest32328-21tune2fs23:35:180
1132992722,3cyclictest9-21ksoftirqd/021:25:250
1132992721,4cyclictest9-21ksoftirqd/023:56:020
1132992721,3cyclictest9-21ksoftirqd/019:45:010
113399265,7cyclictest2257-21gnome-shell19:44:591
113399263,7cyclictest24532-21ls19:55:281
1133992621,3cyclictest25-21ksoftirqd/122:40:141
1135992520,3cyclictest41-21ksoftirqd/320:57:183
1135992519,4cyclictest41-21ksoftirqd/321:23:413
113399253,6cyclictest14616-21ls19:35:271
1133992520,3cyclictest25-21ksoftirqd/120:29:191
113299252,19cyclictest20564-21apt-get22:05:140
113399240,10cyclictest0-21swapper/120:50:201
113399231,9cyclictest0-21swapper/123:10:171
1133992317,4cyclictest25-21ksoftirqd/100:39:001
113399225,4cyclictest0-21swapper/123:23:411
1133992010,7cyclictest22154-21sshd19:51:351
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional