You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 17:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot2.osadl.org (updated Wed Sep 17, 2025 12:45:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21752207174,22sleep20-21swapper/207:08:212
22962206174,21sleep10-21swapper/107:09:441
22662206173,22sleep30-21swapper/307:09:223
20342205171,22sleep00-21swapper/007:06:300
1192021540,1sleep20-21swapper/210:50:172
64521440,6sleep3265899cyclictest08:10:233
1373918464,11phc2sys0-21swapper/307:10:013
210282740,3sleep10-21swapper/107:45:271
231727038,26sleep10-21swapper/107:10:011
146812630,5sleep314651-21cron12:05:003
265599612,11cyclictest30347-21awk09:15:010
265599602,18cyclictest32110-21df_abs10:25:150
265599552,11cyclictest18034-21sed08:45:270
265599550,11cyclictest24310-21latency_hist07:55:000
42882530,3sleep04287-21sort11:40:260
265599532,10cyclictest25549-21latency_hist11:20:010
141302530,2sleep10-21swapper/110:55:181
137291530,1ptp4l401ktimersoftd/308:15:063
2657995244,5cyclictest2527-21cron11:40:002
2657995244,5cyclictest2527-21cron11:40:002
137291520,1ptp4l391rcuc/309:09:523
265599512,16cyclictest2494-21gnome-shell09:30:580
265599501,11cyclictest6516-21sed10:40:010
2656994929,17cyclictest25-21ksoftirqd/107:40:111
265599495,15cyclictest24549-21cat07:55:130
265599491,18cyclictest28438-21ls08:00:260
265599491,16cyclictest2494-21gnome-shell09:48:580
265599490,10cyclictest1234-21cut11:35:210
265599490,10cyclictest1234-21cut11:35:210
265599481,15cyclictest22301-21sensors_temp11:10:260
265599480,16cyclictest25811-21/usr/sbin/munin09:05:270
129312480,5sleep012936-21irqrtprio07:30:210
265599471,11cyclictest6918-21sed10:40:150
265599470,19cyclictest4869-21latency_hist07:15:000
265599470,17cyclictest29692-21df_abs08:05:160
52742460,2sleep20-21swapper/211:45:132
2657994636,7cyclictest33-21ksoftirqd/212:20:012
265599451,17cyclictest2494-21gnome-shell08:53:580
265799445,6cyclictest33-21ksoftirqd/208:05:262
265699440,1cyclictest0-21swapper/110:31:101
137291440,0ptp4l401ktimersoftd/309:00:223
137291440,0ptp4l401ktimersoftd/307:25:153
42098430,2rtkit-daemon0-21swapper/307:41:483
2657994317,7cyclictest33-21ksoftirqd/211:10:002
2657994317,7cyclictest33-21ksoftirqd/211:10:002
265599430,7cyclictest526-21ls08:10:220
265799427,3cyclictest33-21ksoftirqd/207:30:262
2657994237,3cyclictest33-21ksoftirqd/212:10:002
2656994235,4cyclictest29070-21cron08:05:001
265599426,5cyclictest9-21ksoftirqd/007:40:180
137291420,0ptp4l401ktimersoftd/307:37:513
2657994115,3cyclictest33-21ksoftirqd/207:45:262
2657994113,7cyclictest33-21ksoftirqd/211:15:002
2657994112,3cyclictest33-21ksoftirqd/207:20:212
265599417,7cyclictest9-21ksoftirqd/010:10:190
265599410,8cyclictest7656-21gpgv11:50:020
2657994035,3cyclictest33-21ksoftirqd/207:20:002
2657994034,3cyclictest33-21ksoftirqd/211:55:002
2657994027,11cyclictest33-21ksoftirqd/210:40:142
2657994025,12cyclictest33-21ksoftirqd/211:05:002
265599401,7cyclictest10736-21if_enp4s011:55:180
137291400,0ptp4l401ktimersoftd/311:12:383
2658993934,3cyclictest30288-21sshd09:14:493
2657993926,10cyclictest33-21ksoftirqd/212:00:192
2657993921,5cyclictest33-21ksoftirqd/211:30:212
265799391,36cyclictest20646-21kworker/2:210:05:292
265799390,37cyclictest14455-21kworker/2:012:20:222
2656993919,18cyclictest25-21ksoftirqd/109:15:111
2658993831,4cyclictest41-21ksoftirqd/310:15:003
265799388,7cyclictest33-21ksoftirqd/209:15:192
265799388,4cyclictest33-21ksoftirqd/209:35:192
265799386,3cyclictest33-21ksoftirqd/211:20:222
2657993833,3cyclictest33-21ksoftirqd/212:40:002
2657993832,3cyclictest33-21ksoftirqd/208:40:242
2657993832,3cyclictest33-21ksoftirqd/208:40:242
2657993811,7cyclictest33-21ksoftirqd/212:25:182
265599381,7cyclictest11325-21apt10:50:110
265599380,7cyclictest2913-21ls10:30:230
265599380,6cyclictest20024-21ssh11:05:280
265599380,6cyclictest20024-21ssh11:05:280
2658993730,4cyclictest41-21ksoftirqd/308:35:143
2658993725,10cyclictest41-21ksoftirqd/309:30:113
265799378,7cyclictest33-21ksoftirqd/209:40:182
2657993732,3cyclictest414-21dbus-daemon07:25:282
2657993732,3cyclictest33-21ksoftirqd/212:35:002
2657993732,3cyclictest33-21ksoftirqd/208:40:002
2657993732,3cyclictest33-21ksoftirqd/207:10:152
2657993731,3cyclictest33-21ksoftirqd/208:30:112
2657993731,3cyclictest33-21ksoftirqd/208:25:212
2657993730,5cyclictest33-21ksoftirqd/211:00:002
2656993712,22cyclictest29609-21ls10:20:161
2655993711,5cyclictest9-21ksoftirqd/009:55:210
265599370,7cyclictest25397-21hddtemp_smartct12:25:160
265599370,16cyclictest22047-21apt-get12:20:030
137391372,2phc2sys121rcu_preempt12:20:023
137291370,0ptp4l401ktimersoftd/312:35:283
2658993631,3cyclictest41-21ksoftirqd/309:22:593
265799365,6cyclictest33-21ksoftirqd/210:25:012
265799364,3cyclictest33-21ksoftirqd/210:35:142
2657993632,2cyclictest33-21ksoftirqd/211:45:002
2657993632,2cyclictest33-21ksoftirqd/209:05:002
2657993631,3cyclictest33-21ksoftirqd/210:19:592
2657993630,4cyclictest33-21ksoftirqd/211:26:202
2657993629,4cyclictest33-21ksoftirqd/209:10:052
2657993610,6cyclictest33-21ksoftirqd/207:35:142
2656993613,20cyclictest24459-21ls07:55:021
2656993613,20cyclictest23171-21sed11:15:011
265599364,4cyclictest9-21ksoftirqd/007:16:460
2655993630,4cyclictest9-21ksoftirqd/009:27:430
265599360,7cyclictest7829-21df_inode07:20:140
265599360,7cyclictest14951-21diskstats07:35:150
137291360,0ptp4l401ktimersoftd/307:22:303
2658993530,3cyclictest41-21ksoftirqd/308:55:013
2658993529,4cyclictest41-21ksoftirqd/309:42:343
2658993529,4cyclictest41-21ksoftirqd/308:22:043
265799357,4cyclictest33-21ksoftirqd/209:50:282
265799353,6cyclictest33-21ksoftirqd/210:00:222
2657993531,3cyclictest33-21ksoftirqd/211:55:152
2657993531,3cyclictest33-21ksoftirqd/207:40:272
2657993531,2cyclictest33-21ksoftirqd/208:12:492
2657993530,3cyclictest33-21ksoftirqd/209:55:132
2657993530,3cyclictest33-21ksoftirqd/209:45:152
2657993530,3cyclictest33-21ksoftirqd/208:15:202
2657993529,3cyclictest33-21ksoftirqd/209:20:182
265799351,5cyclictest33-21ksoftirqd/208:55:142
2656993529,4cyclictest25-21ksoftirqd/111:19:371
2656993529,4cyclictest25-21ksoftirqd/110:01:031
2656993529,3cyclictest25-21ksoftirqd/110:50:001
2656993528,4cyclictest25-21ksoftirqd/108:40:341
2656993528,4cyclictest25-21ksoftirqd/108:40:341
2656993527,5cyclictest25-21ksoftirqd/108:47:581
2655993529,4cyclictest9-21ksoftirqd/010:16:250
2655993529,4cyclictest9-21ksoftirqd/008:28:460
2658993430,3cyclictest41-21ksoftirqd/311:20:123
2658993428,4cyclictest41-21ksoftirqd/312:32:363
2658993428,4cyclictest41-21ksoftirqd/311:16:183
2658993428,4cyclictest41-21ksoftirqd/307:50:583
2658993427,5cyclictest41-21ksoftirqd/311:56:263
265799348,3cyclictest33-21ksoftirqd/209:30:192
265799347,3cyclictest33-21ksoftirqd/208:20:232
265799344,5cyclictest33-21ksoftirqd/210:25:152
2657993430,3cyclictest33-21ksoftirqd/211:15:152
2657993429,3cyclictest33-21ksoftirqd/209:05:272
2657993429,3cyclictest33-21ksoftirqd/207:55:202
2657993428,4cyclictest33-21ksoftirqd/210:47:202
2657993428,4cyclictest33-21ksoftirqd/210:13:062
2657993428,4cyclictest33-21ksoftirqd/208:50:422
2657993410,6cyclictest33-21ksoftirqd/209:25:282
2657993410,4cyclictest33-21ksoftirqd/212:15:002
2656993428,4cyclictest25-21ksoftirqd/112:18:021
2656993428,4cyclictest25-21ksoftirqd/107:59:461
2656993411,3cyclictest19217-21grep12:10:271
2655993428,4cyclictest9-21ksoftirqd/009:23:580
2655993428,4cyclictest9-21ksoftirqd/007:48:100
2658993328,3cyclictest41-21ksoftirqd/309:50:373
2658993327,4cyclictest41-21ksoftirqd/312:08:573
2658993327,4cyclictest41-21ksoftirqd/311:44:223
2658993327,4cyclictest41-21ksoftirqd/309:29:523
2658993327,4cyclictest41-21ksoftirqd/308:49:153
2658993327,4cyclictest41-21ksoftirqd/308:06:103
2658993327,4cyclictest41-21ksoftirqd/307:31:403
2657993328,3cyclictest33-21ksoftirqd/210:35:002
265699339,3cyclictest4829-21seq11:43:431
265699339,3cyclictest19758-21latency_hist10:00:001
265699339,3cyclictest13142-21unixbench_multi08:35:291
265699339,23cyclictest0-21swapper/109:26:111
2656993328,3cyclictest25-21ksoftirqd/112:05:131
2656993328,3cyclictest25-21ksoftirqd/111:10:001
2656993328,3cyclictest25-21ksoftirqd/111:10:001
2656993327,4cyclictest25-21ksoftirqd/111:52:141
2656993327,4cyclictest25-21ksoftirqd/111:32:201
2656993327,4cyclictest25-21ksoftirqd/109:50:151
2656993327,4cyclictest25-21ksoftirqd/108:20:531
2656993327,4cyclictest11243-21cron08:35:001
2656993326,5cyclictest25-21ksoftirqd/112:03:341
2656993313,17cyclictest24646-21seq10:10:111
2656993312,19cyclictest27752-21cut12:30:161
2655993328,3cyclictest9-21ksoftirqd/009:16:280
2655993328,3cyclictest9-21ksoftirqd/008:30:090
2655993327,4cyclictest9-21ksoftirqd/012:03:080
2655993327,4cyclictest9-21ksoftirqd/011:26:500
2655993327,4cyclictest9-21ksoftirqd/009:03:000
2655993327,4cyclictest9-21ksoftirqd/008:42:270
2655993327,4cyclictest9-21ksoftirqd/008:42:270
2655993327,4cyclictest9-21ksoftirqd/008:19:230
2658993227,3cyclictest41-21ksoftirqd/311:48:083
2658993226,4cyclictest41-21ksoftirqd/311:31:103
2658993226,4cyclictest41-21ksoftirqd/311:02:463
2658993226,4cyclictest41-21ksoftirqd/310:58:043
2658993226,4cyclictest41-21ksoftirqd/310:04:383
2658993226,4cyclictest41-21ksoftirqd/309:39:053
2657993226,4cyclictest33-21ksoftirqd/208:02:132
265699328,3cyclictest22626-21df10:05:151
265699327,4cyclictest6341-21latency_hist10:40:011
2656993226,4cyclictest25-21ksoftirqd/109:37:391
2656993226,4cyclictest25-21ksoftirqd/108:58:071
2656993226,4cyclictest25-21ksoftirqd/108:28:401
2656993226,4cyclictest25-21ksoftirqd/107:30:381
2656993226,4cyclictest25-21ksoftirqd/107:25:481
2655993227,3cyclictest9-21ksoftirqd/010:47:580
2655993227,3cyclictest9-21ksoftirqd/009:41:590
2655993227,3cyclictest9-21ksoftirqd/008:55:110
2655993226,4cyclictest9-21ksoftirqd/010:01:370
2655993226,4cyclictest9-21ksoftirqd/009:37:460
2655993226,4cyclictest9-21ksoftirqd/008:35:030
2655993226,4cyclictest9-21ksoftirqd/007:27:200
2658993126,3cyclictest41-21ksoftirqd/310:25:513
2658993126,3cyclictest41-21ksoftirqd/308:55:123
2658993125,4cyclictest41-21ksoftirqd/311:38:483
2658993125,4cyclictest41-21ksoftirqd/311:38:483
2658993125,4cyclictest41-21ksoftirqd/310:17:573
2658993125,4cyclictest41-21ksoftirqd/308:34:263
2658993125,4cyclictest41-21ksoftirqd/307:47:093
2658993124,4cyclictest41-21ksoftirqd/310:20:153
2657993126,3cyclictest33-21ksoftirqd/208:45:192
265799310,5cyclictest33-21ksoftirqd/207:50:152
265699319,3cyclictest6149-21grep11:45:201
265699319,3cyclictest5681-21if_err_enp4s007:15:191
265699319,3cyclictest23742-21df_abs09:00:161
265699318,3cyclictest11008-21irqrtprio11:55:191
265699318,3cyclictest10982-21cut09:40:221
265699313,6cyclictest22496-21apt-get12:20:041
2656993127,3cyclictest25-21ksoftirqd/108:09:341
2656993125,4cyclictest25-21ksoftirqd/111:23:381
2656993125,4cyclictest25-21ksoftirqd/107:37:071
2655993125,4cyclictest9-21ksoftirqd/012:09:540
2655993125,4cyclictest9-21ksoftirqd/011:03:510
153122310,3sleep00-21swapper/010:55:330
137291310,0ptp4l401ktimersoftd/310:54:263
137291310,0ptp4l401ktimersoftd/307:56:283
2658993025,3cyclictest41-21ksoftirqd/311:09:523
2658993025,3cyclictest41-21ksoftirqd/311:09:523
2658993025,3cyclictest41-21ksoftirqd/308:00:333
2658993024,4cyclictest41-21ksoftirqd/308:44:133
2658993024,4cyclictest41-21ksoftirqd/308:44:133
265699309,3cyclictest7542-21cpuspeed_turbos07:20:141
265699307,3cyclictest676-21df_abs11:35:171
265699307,3cyclictest676-21df_abs11:35:171
265699307,3cyclictest2494-21gnome-shell10:27:581
265699306,4cyclictest5497-21tr09:30:161
2656993025,3cyclictest25-21ksoftirqd/110:15:411
2656993023,5cyclictest25-21ksoftirqd/109:13:441
2656993010,3cyclictest27018-21phc2sys09:05:261
2655993026,3cyclictest9-21ksoftirqd/012:37:280
2655993024,4cyclictest9-21ksoftirqd/012:15:440
137291300,0ptp4l401ktimersoftd/312:14:463
2658992924,3cyclictest41-21ksoftirqd/311:25:423
2658992924,3cyclictest41-21ksoftirqd/310:38:133
2658992924,3cyclictest41-21ksoftirqd/309:15:113
2658992923,4cyclictest41-21ksoftirqd/312:15:073
2658992923,4cyclictest41-21ksoftirqd/307:17:213
265699298,3cyclictest31179-21timerandwakeup12:35:291
265699296,21cyclictest0-21swapper/110:50:191
265699295,4cyclictest2494-21gnome-shell09:47:581
265699295,4cyclictest18263-21latency_hist11:05:001
2656992924,3cyclictest25-21ksoftirqd/111:27:561
2656992923,3cyclictest25-21ksoftirqd/108:15:121
265699291,7cyclictest18682-21apt-get08:50:121
2655992923,4cyclictest9-21ksoftirqd/012:34:100
2655992923,4cyclictest9-21ksoftirqd/011:46:360
2658992823,3cyclictest41-21ksoftirqd/312:29:423
2658992823,3cyclictest41-21ksoftirqd/310:31:173
2658992823,3cyclictest41-21ksoftirqd/308:26:153
2656992823,3cyclictest25-21ksoftirqd/109:23:371
2656992822,4cyclictest25-21ksoftirqd/112:28:251
2655992822,4cyclictest9-21ksoftirqd/011:30:110
2658992722,3cyclictest41-21ksoftirqd/310:45:343
2658992722,3cyclictest41-21ksoftirqd/310:06:563
2658992722,3cyclictest41-21ksoftirqd/309:46:053
2655992723,3cyclictest9-21ksoftirqd/009:52:540
2655992721,4cyclictest9-21ksoftirqd/010:23:320
2658992621,3cyclictest41-21ksoftirqd/310:41:573
2658992620,4cyclictest41-21ksoftirqd/309:55:103
2656992621,3cyclictest25-21ksoftirqd/110:40:401
2655992621,3cyclictest9-21ksoftirqd/012:11:430
2658992520,3cyclictest41-21ksoftirqd/311:51:183
2655992519,4cyclictest9-21ksoftirqd/010:05:100
2656992419,3cyclictest25-21ksoftirqd/108:10:381
2655992418,4cyclictest9-21ksoftirqd/008:23:240
265599232,5cyclictest9-21ksoftirqd/011:20:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional