You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 11:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot3.osadl.org (updated Wed Dec 31, 2025 00:45:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83402204170,22sleep30-21swapper/319:08:423
81982202169,22sleep10-21swapper/119:06:511
81122202170,22sleep00-21swapper/019:05:510
81992201168,23sleep20-21swapper/219:06:532
239142770,2sleep10-21swapper/120:45:271
241922680,3sleep224196-21fschecks_count21:55:172
873499630,19cyclictest21972-21/usr/sbin/munin00:05:203
276992610,2sleep00-21swapper/023:10:120
100422550,2sleep110046-21irqrtprio21:25:191
139391520,1ptp4l391rcuc/321:45:223
139391450,0ptp4l401ktimersoftd/319:55:223
8733994430,12cyclictest33-21ksoftirqd/221:00:002
8731994416,3cyclictest9-21ksoftirqd/022:50:160
8732994336,4cyclictest25-21ksoftirqd/120:39:591
8731994311,8cyclictest9-21ksoftirqd/020:15:010
139391430,0ptp4l401ktimersoftd/319:30:493
8734994237,3cyclictest4475-21turbostat.cron23:30:003
8733994236,3cyclictest33-21ksoftirqd/219:40:002
139391420,0ptp4l401ktimersoftd/323:21:363
139391420,0ptp4l401ktimersoftd/322:09:193
873499419,17cyclictest21723-21unixbench_multi20:40:283
139391410,0ptp4l401ktimersoftd/319:24:523
8733994035,3cyclictest33-21ksoftirqd/223:00:022
8731994035,2cyclictest9-21ksoftirqd/020:39:590
844024031,3sleep00-21swapper/019:10:010
8733993930,6cyclictest33-21ksoftirqd/222:20:132
8731993934,3cyclictest9-21ksoftirqd/022:30:000
8731993934,3cyclictest9-21ksoftirqd/000:10:000
8734993833,3cyclictest29998-21fschecks_count21:00:163
8733993833,3cyclictest33-21ksoftirqd/223:40:002
8731993833,3cyclictest9-21ksoftirqd/023:55:000
8731993833,3cyclictest9-21ksoftirqd/022:40:000
8731993833,3cyclictest9-21ksoftirqd/019:25:000
8733993732,3cyclictest33-21ksoftirqd/219:50:192
8733993732,3cyclictest33-21ksoftirqd/200:00:012
8731993732,3cyclictest9-21ksoftirqd/021:04:590
8731993732,3cyclictest9-21ksoftirqd/019:40:010
8731993732,3cyclictest9-21ksoftirqd/000:00:010
8731993731,3cyclictest9-21ksoftirqd/022:15:010
8731993731,3cyclictest9-21ksoftirqd/020:46:580
873499360,20cyclictest23886-21/usr/sbin/munin00:10:253
8733993633,2cyclictest33-21ksoftirqd/200:15:002
8733993631,3cyclictest33-21ksoftirqd/222:50:142
8733993631,3cyclictest33-21ksoftirqd/221:40:002
8733993631,3cyclictest33-21ksoftirqd/221:15:002
8733993631,3cyclictest33-21ksoftirqd/221:04:592
8733993631,3cyclictest33-21ksoftirqd/200:05:212
8733993630,3cyclictest33-21ksoftirqd/219:10:202
8733993624,9cyclictest33-21ksoftirqd/200:35:282
8732993630,4cyclictest25-21ksoftirqd/122:45:131
8732993630,4cyclictest25-21ksoftirqd/122:45:121
8732993630,4cyclictest25-21ksoftirqd/121:04:261
8731993632,3cyclictest9-21ksoftirqd/022:34:590
8731993631,3cyclictest9-21ksoftirqd/020:25:000
8731993631,3cyclictest9-21ksoftirqd/000:30:300
8731993630,3cyclictest9-21ksoftirqd/023:20:000
8731993630,3cyclictest9-21ksoftirqd/021:40:000
8731993630,3cyclictest9-21ksoftirqd/000:25:580
873199361,10cyclictest9-21ksoftirqd/020:40:190
134391360,2getstats0-21swapper/319:45:303
8734993529,4cyclictest41-21ksoftirqd/320:17:343
8734993528,4cyclictest41-21ksoftirqd/320:27:563
8733993530,3cyclictest33-21ksoftirqd/223:32:152
8733993530,3cyclictest33-21ksoftirqd/223:20:182
8733993530,3cyclictest33-21ksoftirqd/221:50:112
8733993530,3cyclictest33-21ksoftirqd/219:16:262
8733993530,2cyclictest33-21ksoftirqd/221:45:152
8733993529,4cyclictest33-21ksoftirqd/223:08:462
8733993529,4cyclictest33-21ksoftirqd/220:45:002
8733993529,4cyclictest33-21ksoftirqd/219:41:312
8733993529,3cyclictest33-21ksoftirqd/222:20:002
8733993529,3cyclictest33-21ksoftirqd/219:25:132
8733993528,4cyclictest33-21ksoftirqd/200:30:372
8732993531,2cyclictest25-21ksoftirqd/100:20:001
8732993530,3cyclictest25-21ksoftirqd/123:52:201
8732993529,4cyclictest25-21ksoftirqd/123:24:371
8732993529,4cyclictest25-21ksoftirqd/123:07:081
8732993529,4cyclictest25-21ksoftirqd/122:36:111
8732993529,4cyclictest25-21ksoftirqd/100:37:301
8732993529,3cyclictest25-21ksoftirqd/120:00:111
8731993531,2cyclictest9-21ksoftirqd/019:30:190
8731993530,3cyclictest9-21ksoftirqd/023:25:010
8731993530,3cyclictest9-21ksoftirqd/022:24:580
8731993530,3cyclictest9-21ksoftirqd/022:10:000
8731993530,3cyclictest9-21ksoftirqd/021:30:200
8731993530,3cyclictest9-21ksoftirqd/021:20:010
139391350,1ptp4l391rcuc/323:47:583
139391350,1ptp4l391rcuc/323:47:583
8734993429,3cyclictest41-21ksoftirqd/321:18:473
8734993428,4cyclictest41-21ksoftirqd/300:37:193
8734993428,4cyclictest41-21ksoftirqd/300:28:143
8733993430,3cyclictest33-21ksoftirqd/220:20:182
8733993429,3cyclictest33-21ksoftirqd/223:45:002
8733993429,3cyclictest33-21ksoftirqd/222:34:522
8733993429,3cyclictest33-21ksoftirqd/222:30:002
8733993429,3cyclictest33-21ksoftirqd/220:50:012
8733993429,3cyclictest33-21ksoftirqd/220:05:002
8733993428,4cyclictest33-21ksoftirqd/222:35:332
8733993428,4cyclictest33-21ksoftirqd/200:18:422
8733993428,3cyclictest33-21ksoftirqd/223:00:142
8733993428,3cyclictest33-21ksoftirqd/221:25:482
8733993428,3cyclictest33-21ksoftirqd/219:55:212
8732993428,4cyclictest25-21ksoftirqd/123:33:361
8732993428,4cyclictest25-21ksoftirqd/121:39:111
8732993428,4cyclictest25-21ksoftirqd/121:00:001
8732993428,4cyclictest25-21ksoftirqd/120:12:421
8732993428,4cyclictest25-21ksoftirqd/119:26:501
8732993428,3cyclictest25-21ksoftirqd/120:25:581
8731993430,3cyclictest9-21ksoftirqd/020:50:210
8731993430,2cyclictest9-21ksoftirqd/023:45:000
8731993430,2cyclictest9-21ksoftirqd/023:00:000
8731993430,2cyclictest9-21ksoftirqd/021:50:150
8731993429,3cyclictest9-21ksoftirqd/021:55:200
8731993429,3cyclictest9-21ksoftirqd/019:29:590
8731993429,3cyclictest9-21ksoftirqd/019:15:180
8731993429,3cyclictest9-21ksoftirqd/000:20:200
8731993428,4cyclictest9-21ksoftirqd/000:39:020
873199340,2cyclictest121rcu_preempt21:05:230
8734993328,3cyclictest41-21ksoftirqd/322:37:383
8734993328,3cyclictest41-21ksoftirqd/321:39:253
8734993327,4cyclictest41-21ksoftirqd/319:16:453
8734993327,4cyclictest41-21ksoftirqd/319:11:503
8734993327,4cyclictest29339-21sh21:00:003
8734993326,4cyclictest41-21ksoftirqd/320:00:123
8733993329,2cyclictest33-21ksoftirqd/222:04:592
8733993329,2cyclictest33-21ksoftirqd/220:39:592
8733993329,2cyclictest33-21ksoftirqd/219:45:192
8733993328,3cyclictest33-21ksoftirqd/222:50:002
8733993328,3cyclictest33-21ksoftirqd/222:50:002
8733993328,3cyclictest33-21ksoftirqd/200:20:152
8733993328,3cyclictest16071-21kworker/2:200:00:152
8733993327,3cyclictest33-21ksoftirqd/223:10:122
8732993328,3cyclictest25-21ksoftirqd/122:22:351
8732993328,3cyclictest25-21ksoftirqd/122:20:001
8732993328,3cyclictest25-21ksoftirqd/122:10:001
8732993328,3cyclictest25-21ksoftirqd/121:09:511
8732993327,4cyclictest25-21ksoftirqd/122:34:071
8732993327,4cyclictest25-21ksoftirqd/122:00:091
8732993327,4cyclictest25-21ksoftirqd/120:51:251
8732993327,4cyclictest25-21ksoftirqd/120:44:201
8732993327,4cyclictest25-21ksoftirqd/120:34:481
8732993327,4cyclictest25-21ksoftirqd/120:18:091
8732993327,4cyclictest25-21ksoftirqd/119:36:151
8731993329,3cyclictest9-21ksoftirqd/020:55:150
8731993329,3cyclictest9-21ksoftirqd/019:55:290
8731993328,3cyclictest9-21ksoftirqd/023:35:000
8731993328,3cyclictest9-21ksoftirqd/023:10:000
8731993328,3cyclictest9-21ksoftirqd/022:20:000
8731993327,4cyclictest9-21ksoftirqd/023:47:190
8731993327,4cyclictest9-21ksoftirqd/023:47:190
8731993327,3cyclictest9-21ksoftirqd/022:05:000
873199331,3cyclictest9-21ksoftirqd/000:00:420
873199330,2cyclictest121rcu_preempt22:45:270
873199330,2cyclictest121rcu_preempt22:45:270
8734993227,3cyclictest41-21ksoftirqd/322:51:333
8734993227,3cyclictest41-21ksoftirqd/322:45:003
8734993227,3cyclictest41-21ksoftirqd/320:07:483
8734993226,4cyclictest41-21ksoftirqd/323:50:113
8734993226,4cyclictest41-21ksoftirqd/322:34:133
8734993226,4cyclictest41-21ksoftirqd/321:05:363
8733993228,2cyclictest33-21ksoftirqd/222:45:002
8733993227,3cyclictest33-21ksoftirqd/221:25:012
8733993227,3cyclictest33-21ksoftirqd/220:50:422
8733993227,3cyclictest33-21ksoftirqd/200:25:202
8733993226,4cyclictest33-21ksoftirqd/220:15:522
8733993226,4cyclictest33-21ksoftirqd/219:33:332
8733993226,4cyclictest33-21ksoftirqd/219:20:562
8733993221,9cyclictest33-21ksoftirqd/223:15:262
8732993227,3cyclictest25-21ksoftirqd/121:51:341
8732993227,3cyclictest25-21ksoftirqd/121:10:031
8732993227,3cyclictest25-21ksoftirqd/120:20:531
8732993227,3cyclictest25-21ksoftirqd/100:30:251
8732993227,3cyclictest25-21ksoftirqd/100:00:211
8732993226,4cyclictest25-21ksoftirqd/123:28:021
8732993226,4cyclictest25-21ksoftirqd/123:13:021
8732993226,4cyclictest25-21ksoftirqd/122:28:211
8732993226,4cyclictest25-21ksoftirqd/121:47:051
8732993226,4cyclictest25-21ksoftirqd/119:22:531
8731993228,3cyclictest9-21ksoftirqd/021:35:190
8731993228,3cyclictest9-21ksoftirqd/021:30:000
8731993228,2cyclictest9-21ksoftirqd/020:10:010
8731993227,3cyclictest9-21ksoftirqd/022:40:270
8731993227,3cyclictest9-21ksoftirqd/021:50:010
8731993227,3cyclictest9-21ksoftirqd/019:50:000
8731993227,3cyclictest10103-21grep20:20:000
8731993226,3cyclictest9-21ksoftirqd/020:30:010
873199321,4cyclictest9-21ksoftirqd/019:50:260
873199321,4cyclictest9-21ksoftirqd/019:40:250
8734993126,3cyclictest41-21ksoftirqd/322:15:493
8734993126,3cyclictest41-21ksoftirqd/321:30:013
8734993125,4cyclictest41-21ksoftirqd/322:21:503
8734993125,4cyclictest41-21ksoftirqd/321:10:413
8734993125,4cyclictest41-21ksoftirqd/320:51:193
8734993125,4cyclictest41-21ksoftirqd/319:41:073
8734993125,4cyclictest41-21ksoftirqd/300:32:033
8733993125,4cyclictest33-21ksoftirqd/220:27:162
8733993120,9cyclictest33-21ksoftirqd/220:05:262
8732993126,3cyclictest25-21ksoftirqd/122:57:441
8732993125,4cyclictest25-21ksoftirqd/123:41:581
8732993125,4cyclictest25-21ksoftirqd/121:42:521
8732993125,4cyclictest25-21ksoftirqd/121:18:251
8732993125,4cyclictest25-21ksoftirqd/119:58:111
8732993125,4cyclictest25-21ksoftirqd/119:33:081
8731993127,2cyclictest9-21ksoftirqd/023:00:170
8731993126,3cyclictest9-21ksoftirqd/023:29:300
8731993126,3cyclictest9-21ksoftirqd/021:25:010
8731993126,3cyclictest9-21ksoftirqd/021:10:190
8731993126,3cyclictest9-21ksoftirqd/020:03:550
8731993125,4cyclictest9-21ksoftirqd/000:15:510
8731993125,4cyclictest9-21ksoftirqd/000:14:070
8734993025,3cyclictest41-21ksoftirqd/323:10:203
8734993025,3cyclictest41-21ksoftirqd/322:58:323
8734993025,3cyclictest41-21ksoftirqd/320:33:073
8734993025,3cyclictest41-21ksoftirqd/300:20:133
8734993024,3cyclictest41-21ksoftirqd/323:16:093
8733993027,2cyclictest33-21ksoftirqd/220:10:182
8733993026,3cyclictest33-21ksoftirqd/221:30:492
8733993026,3cyclictest33-21ksoftirqd/221:15:142
8733993025,3cyclictest33-21ksoftirqd/221:10:002
8732993025,3cyclictest25-21ksoftirqd/123:55:331
8732993025,3cyclictest25-21ksoftirqd/121:24:271
8732993025,3cyclictest25-21ksoftirqd/119:43:411
8732993024,4cyclictest25-21ksoftirqd/120:09:571
8732993024,4cyclictest25-21ksoftirqd/119:12:291
8732993024,4cyclictest25-21ksoftirqd/100:05:051
8732993024,3cyclictest25-21ksoftirqd/123:46:581
8732993024,3cyclictest25-21ksoftirqd/123:46:581
8732993023,4cyclictest25-21ksoftirqd/119:19:281
8731993024,4cyclictest9-21ksoftirqd/020:31:270
8734992924,3cyclictest41-21ksoftirqd/323:59:373
8734992924,3cyclictest41-21ksoftirqd/322:00:013
8734992924,3cyclictest41-21ksoftirqd/321:40:113
8734992924,3cyclictest41-21ksoftirqd/319:26:293
8734992924,3cyclictest41-21ksoftirqd/300:18:593
8734992923,4cyclictest41-21ksoftirqd/322:13:553
8734992912,15cyclictest10338-21/usr/sbin/munin20:20:153
8734992912,14cyclictest6949-21/usr/sbin/munin21:20:243
8733992925,3cyclictest33-21ksoftirqd/222:10:232
8733992924,3cyclictest33-21ksoftirqd/220:30:562
8733992923,4cyclictest33-21ksoftirqd/223:27:472
8733992923,4cyclictest33-21ksoftirqd/221:40:092
8733992919,9cyclictest33-21ksoftirqd/223:45:252
8733992919,9cyclictest33-21ksoftirqd/223:45:252
8732992923,4cyclictest25-21ksoftirqd/121:33:181
8732992923,4cyclictest25-21ksoftirqd/100:26:431
8732992919,9cyclictest25-21ksoftirqd/122:50:131
8731992924,3cyclictest9-21ksoftirqd/023:35:140
139391290,0ptp4l401ktimersoftd/322:28:183
8734992823,3cyclictest41-21ksoftirqd/323:07:273
8734992823,3cyclictest41-21ksoftirqd/320:35:033
8734992811,15cyclictest22409-21/usr/sbin/munin20:45:243
8734992810,16cyclictest21647-21expr21:50:133
8734992810,15cyclictest13881-21cat21:35:013
873499280,25cyclictest0-21swapper/320:10:153
8733992822,4cyclictest33-21ksoftirqd/223:50:422
8732992823,3cyclictest25-21ksoftirqd/123:39:011
8732992823,3cyclictest25-21ksoftirqd/119:46:191
8732992823,3cyclictest25-21ksoftirqd/100:24:181
8734992722,3cyclictest41-21ksoftirqd/323:44:043
8734992722,3cyclictest41-21ksoftirqd/323:03:533
8734992721,4cyclictest41-21ksoftirqd/322:04:243
873499271,23cyclictest5167-21fschecks_time23:30:153
873499271,22cyclictest2518-21gnome-shell19:50:023
8733992722,3cyclictest33-21ksoftirqd/222:05:132
8732992722,3cyclictest25-21ksoftirqd/100:11:311
873499269,14cyclictest19152-21cpuspeed_turbos00:00:153
8734992621,3cyclictest41-21ksoftirqd/323:37:433
873499260,1cyclictest0-21swapper/319:35:203
8732992621,3cyclictest25-21ksoftirqd/123:01:591
8732992620,4cyclictest25-21ksoftirqd/122:41:171
8732992519,4cyclictest25-21ksoftirqd/121:55:531
8732992519,4cyclictest25-21ksoftirqd/119:50:131
139391240,0ptp4l401ktimersoftd/322:45:283
139391240,0ptp4l401ktimersoftd/322:45:273
8732992216,4cyclictest25-21ksoftirqd/123:15:551
8732991914,3cyclictest31234-21df22:10:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional